Multi-target Compiler for the Deployment of Machine Learning Models

Video recording:

Speaker: Oscar Castro (Luxembourg Institute of Science and Technology (LIST))
Title: Multi-target Compiler for the Deployment of Machine Learning Models
Time: Wednesday, 2022.10.26, 10:00 a.m. (CET)
Place: fully virtual (contact Dr. Jakub Lengiewicz to register)
Format: 30 min. presentation + 30 min. discussion

Abstract: Data availability and advances in computing power nowadays have enabled a huge growth in Machine Learning (ML) research and practice. In this wave, many tools to build machine learning models have been developed. These tools are used by data scientists for fast model building and prototyping. But obtaining actual value from ML models requires their deployment into production environments. A repeatable, fast, and reliable deployment process is vital for successful ML workflows. To facilitate deployment, we have designed and developed a special-purpose compiler to automate the translation of ML models from their formal description into source code. The design of the compiler supports a dynamic architecture that allows many different types of models as inputs and many target programming languages as outputs. When compiling a ML model, we aim for running time efficiency of the deployed model on the target computer architecture. Therefore, not only we can deploy to several programming languages, but we also exploit specific underlying characteristics of the architecture such as multiple cores and the availability of graphic processing cards.

Oscar Castro is a postdoctoral researcher at Luxembourg Institute of Science and Technology.