OctoML

No description provided.

Start here to learn more about OctoML

TVMCon covers state of the art of deep learning compilation and optimization, with a range of tutorials, research talks, case studies, and industry presentations. Apache TVM is an open-source deep learning compiler stack for CPUs, GPUs, and specialized accelerators. It aims to close the gap between the productivity-focused deep learning frameworks, and the performance- or efficiency-oriented hardware backends.

Deploying innovative AI models in different production environments becomes a common problem as AI applications become more ubiquitous in our daily lives. Deployment of both training and inference workloads bring great challenges as we start to support a combinatorial choice of models and environment. Additionally, real world applications bring with a multitude of goals, such as minimizing dependencies, broader model coverage, leveraging the emerging hardware primitives for performance, reducing memory footprint, and scaling to larger environments. Solving these problems for training and inference involves a combination of ML programming abstractions, learning-driven search, compilation, and optimized library runtime. These themes form an emerging topic – machine learning compilation that contains active ongoing developments. In this tutorials sequence, we offer the first comprehensive treatment of its kind to study key elements in this emerging field systematically. We will learn the key abstractions to represent machine learning programs, automatic optimization techniques, and approaches to optimize dependency, memory, and performance in end-to-end machine learning deployment. This course aims to target audiences who are working on machine learning in the wild. ML in practice is a broad topic that involves collaborations among multiple audiences, including machine learning scientists, machine learning engineers, and hardware providers. The course requires a minimum set of prerequisites in data science and machine learning: - Python, familiarity with numpy. - Some background in one deep learning framework (e.g. PyTorch, TensorFlow, JAX) - Experiences in system programming (e.g. C/CUDA) would be beneficial but not required.

No description provided.

No description provided.

Recordings from the Dec 2021 virtual Apache TVM and Open Source Machine Learning Acceleration Conference. TVMCon covers the state of the art of deep learning compilation and optimization, with a range of tutorials, research talks, case studies, and industry presentations. We discuss recent advances in ML frameworks, compilers, systems and architecture support, security, training and hardware acceleration. https://www.tvmcon.org

No description provided.