Skymizer will be presenting “ONNC Compiler Porting and Optimization for NVDLA-Based Neural Network Inference Engines” at  ACM/IEEE International Symposium on Computer Architecture (ISCA) on May 30.

The NVIDIA Deep Learning Accelerator provides free intellectual property licensing to anyone wanting to build a chip that uses deep neural networks for inference applications. With extensive documentation and tools, many business proposals and research projects choose NVDLA as their inference engine design. However, lack of extensible compiler support becomes the major bottleneck for supporting more AI models and optimizations. This tutorial presents the first open source compiler that supports NVDLA-based designs. The ONNC compiler has more support than the official NVDLA compiler and relieves programmers from manually specifying the low-level details of models that are not supported by the official NVDLA compiler. It also enables opportunities for hardware customization and proprietary optimization. We will cover the overview, porting, and optimizations in three subsections. In each subsection, we will have hands-on labs to demonstrate how to run and customize the NVDLA backend in ONNC for product development and research projects.

Official Tutorial Website:

20′ ISCA Tutorial Website

Program link:

Sign up for tutorial link:

About ONNC

Open Neural Network Compiler (ONNC) is an open source compilation framework connecting ONNX to proprietary of deep learning accelerators. In this tutorial, Skymizer would like to share how ONNC leverages the ONNX IR design and optimized neural network computation performance on NVDLA. This tutorial presents the first open source compiler that supports NVDLA-based designs.

About ISCA

The ACM/IEEE International Symposium on Computer Architecture (ISCA) is the premier forum for new ideas and experimental results in computer architecture. Top microarchitecture, compilers, chips, and systems researchers related to this field all gather together for technical exchange on traditional microarchitecture topics and emerging research areas. For more details on ISCA2020:

About Skymizer

Skymizer is internationally recognized for expertise in compilation technology with a wide scope of software products and specialized tools for AI chip makers covering a wealth of techniques, platforms, and turn-key solutions.