SPEC SHEET

AI Starter Kits

skymizer.com

By diving deeply into NVDLA RTL code, we successfully make ONNC supports complex operators and multiple hardware configurations of NVDLA. It supports more ONNX models; supports more hardware configurations; and produces high performance loadable files.

Full-fledged NVDLA compiler

AI Starter Kits is a comprehensive set of FPGA-based prototyping tools including optimized Open Neural Network Compiler (ONNC), drivers (KMD/UMD), Linux kernel, virtual platform, FPGA netlist and RTL code (NVDLA). Using AI Starter Kits, you will benefit from an optimal design experience with our extensive suite of advanced design tools, a well-tested open source solution, and a fast-time-to-market prototyping FPGA board, all in one platform. AI Starter Kits optimize your design process and ensures that your software runs and exploits the full power of the underlying AI chips. Skymizer aims at providing a unique solution tailored to your needs to help you build a strong hardware/software co-design team and efficiently save your time ahead of AI chip fabrication.

OverviewFull-fledged NVDLA compiler, superior quality of compilation results, and rich FPGA supports to enable your AI-on-Chip

SoftwareDevelopmentKit BoardSupportPackage

AI models

Workspace

NVDLALoadable

Compiler VirtualPlatform

checker reader

debugger

nm

diagnostics

NVDLALoadable

UserMLApplicationSoftware

UserModeDriver

KernelModeDriver

HostCPU NVDLA

© 2019 Skymizer Taiwan, Inc. All rights reserved.

ONNC supports most popular models in ONNX model zoo. Weight of official ONNX models is not designed for NVDLA hardware, and the result may not be always correct. To resolve this problem, we create ONNC calibration tool to adjust weights in models.

Best supports of ONNX models

TABLE I: Compiler support status for ONNX model zoo.

Compiler experts make not only compiler but a chain of tools. AI Starter Kits includes a series tools for customization of NVDLA runtime environment.

Comprehensive SDK and BSP

• Open Neural Network Compiler (ONNC) for nv_full, nv_small and nv_large• ONNX model checker• ONNX model reader• Cross Compiler GCC 7.3.1 for ARM Cortex-A (aarch64)• Cross Compiler GCC 8.3.0 for RISC-V 64 (riscv64)• GreenSocs virtual platforms for ARM (aarch64) and RISC-V (riscv64) with nv_full, nv_small and

nv_large• Lander BSP generator r1.2

Software Development Kits

• Support Linux kernels 4.13, 4.14~4.19, 5.0, 5.1• Bug-fixed user mode driver• Bug-fixed kernel mode driver for virtual platforms and supported FPGAs• Slides show example program• Streaming example program

Board Support Packages

AI Starter Kits provides various platforms for different types of developers.

Strong Ecosystem

• supports ARM Cortex-A processors (aarch64)• supports RISC-V processors (riscv64)• supports various NVDLA hardware configuration (nv_small, nv_full)

Virtual Platforms

• Xilinx ZCU102 for nv_small 64MACs• Xilinx ZCU104 for nv_small 64MACs• S2C KU115 for nv_medium 1024MACs • S2C VU440 for nv_large 2048MACs

FPGA Platforms

skymizer.com email: sales@skymizer.com tel: +886 2 8797 8337

modelRun to complete FP16 correctness INT8 Quantization Example

nv_full/nv_small(64)/nv_large nv_full nv_small/nv_large

AleXNet ✓ ✓ ✓GoogleNet ✓ ✓ ✓CaffeNet ✓ ✓ ✓R-CNN ILSVRD13 ✓ ✓ ✓DenseNet-121 ✓ ✓Inception v1 ✓ ✓ ✓Inception v2 ✓ ✓ResNet-50 ✓ ✓ShuffleNet ✓ ✓SqueezeNet ✓ ✓ ✓VGG-19 ✓ ✓ ✓ZFNet-512 ✓ ✓ ✓