Skymizer tutorial on Open Neural Network Compiler porting (ONNC) and optimization for NVDLA-Based Neural Network at MICRO 2019
Skymizer will be presenting “ONNC Compiler Porting and Optimization for NVDLA-Based Neural NEtwork Inference Engines” at 52nd IEEE/ACM International Symposium on Microarchitecture (MICRO 2019) on Oct 12.
The NVIDIA Deep Learning Accelerator provides free intellectual property licensing to anyone wanting to build a chip that uses deep neural networks for inference applications. With extensive documentation and tools, many business proposals and research projects choose NVDLA as their inference engine design. However, lack of extensible compiler support becomes the major bottleneck for supporting more AI models and optimizations. This tutorial presents the first open source compiler that supports NVDLA-based designs. The ONNC compiler has more support than the official NVDLA compiler and relieves programmers from manually specifying the low-level details of models that are not supported by the official NVDLA compiler. It also enables the opportunities for hardware customization and proprietary optimization. We will cover the overview, porting and optimizations in three subsections. In each subsection, we will have hands-on labs to demonstrate how to run and customize the NVDLA backend in ONNC for product development and research projects.
Official Tutorial Website:
Open Neural Network Compiler (ONNC) is an open source compilation framework connecting ONNX to proprietary of deep learning accelerators. In this tutorial, Skymizer would like to share how ONNC leverages the ONNX IR design and optimized neural network computation performance on NVDLA. This tutorial presents the first open source compiler that supports NVDLA-based designs. https://onnc.ai/
MICRO is one of the most top conference in innovative microarchitecture ideas and techniques for advanced computing and communication systems. Top microarchitecture, compilers, chips, and systems researcher related to this field all gather together for technical exchange on traditional microarchitecture topics and emerging research areas. For more details on MICRO52: https://www.microarch.org/micro52/
Skymizer is internationally recognized for expertise in compilation technology with a wide scope of software products and specialized tools for AI chip makers coving a wealth of techniques, platforms and turn-key solutions.