Edge AI Suite Quick Start Guide - advdownload.advantech.com
Transcript of Edge AI Suite Quick Start Guide - advdownload.advantech.com
Edge AI Suite Quick Start Guide
Hello
We bring good news for anyone worried about how to implement AI services. In
recent years, the implementation of AI big data analysis has become an
increasingly important topic. However, interested vendors and customers face
obstructions related to SW/HW integration issues and difficult AI algorithms.
These obstacles can result in costly developmental delays. To help rectify this
situation, Advantech in collaboration with Intel and Microsoft, will release the
Edge AI Suite in 2019 to further its position as global leader in Solution-Ready
Packages (SRP).
To help solve the aforementioned issues around developing AI applications,
Advantech released the Intel Movidius VEGA-300 series mounted in ARK- and
DS- products and installed with the latest Microsoft Windows 10 IoT OS to further
integrate OpenVINO (Open Visual Inference & Neural Network Optimization)
toolkits. OpenVINO was released by Intel and is able to execute real-time
inference for collected data on Intel CPU, GPU, FPGA or ASIC (IPU or
VPU-Moviduis) acceleration chipsets to upgrade computing power. The Model
Optimizer module can translate other common AI models, such as Caffe, Tensor
flow, MXNet and ONNX, to a unified architecture for OpenVINO.
Getting Started
System Requirements
Software
1. Operating System: Windows 10 Enterprise 64-bit version 1809
2. Intel® Graphics Driver: Windows® 10 DCH Drivers
26.20.100.7755 or above (when GPU inference is adopted)
3. Advantech SUSI 4.0 or above required when no VEGA-300 series
exist
Hardware
1. 6th to 10th generation Intel® Core™ processors and Intel® Xeon®
processors
2. Intel Pentium® processor N4200/5, N3350/5, or N3450/5 with
Intel® HD Graphics
3. One of them must be required:
- Advantech VEGA-300 series, or
- Specific Advantech devices with SUSI 4.0 or above preloaded
Installation Steps
Step 1. Choose “Next” to start installation
Step 2. Choose the setup type you want
Typical -> Full Installation (default and suggested)
Custom -> Customized Installation
Step 3. Choose “Install” to begin installing
Step 4. Wait for the installation process
Step 5. Choose “Finish” to complete installation
The Basics
Edge AI Suite caters to users who are comfortable with the machine learning (ML)
experience. It can quickly evaluate computing performance for the CPU, GPU, or
VEGA-300 series VPU, and provides runtime results inferenced with ML.
Moreover, this suite summarizes the process from model transformation to
recognition.
Edge AI Suite is based on Intel OpenVINO with further development using C# and
Qt/C++ tools. The realized target gives users an easy and enjoyable experience
with the AI inference. The following chart shows the major parts after suite
installation.
├── Edge AI Suite
| ├── Demo_Utility_C#
| ├── Inference_Application_Qt
| ├── Inference_Models
| ├── Media_Samples
| ├── OpenVINO
| └── Version.txt
How to Quickly Start AI applications
Step 1. Go to the “Quick Start” page, as shown below
Step 2. Choose one application you want to activate and then confirm inference
info, as shown below
Step 3. Choose your video source which could be video clips or the camera, as
shown below
Step 4. Choose one of the acceleration chipsets to execute selected inference
application, as shown below
Step 5. Another window will pop up to show the AI inference, as shown below
How to Recognize AI Performance
Step 1. Go to the “System Monitoring” page. This page shows payload and
temperature for each chipset, as shown below
Step 2. Click the “Run” button to evaluate each chipset performance and wait for a
few seconds to get results, as shown below
How to Get More Inference Samples and Resources
Step 1. Go to the “Advanced Extensions” page. This page shows the impressive
information and a link button, named as “More”, as shown below
Step 2. Click the “More” button and then the default browser will display the
contents of Edge AI Hub. (It’s suggested to use Chrome browser to open it.)
Furthermore, for example, we can scroll down the page to see the
“Gaze-Estimation” item and then click it to start downloading.
After downloading is done, extract the file to recover all elements inside.
We just need to click a *.bat file therein to launch the inference sample easily.
More operations can refer to ADVANTECH Edge AI Hub website.
In addition, OpenVINO IE SDK and ready-to-use Model Optimizer package can
also be downloadable from Edge AI Hub.
Help and Resources
1. Advantech VEGA-300 Series
2. Intel® Distribution of OpenVINO™
3. SUSI APIs (Secure, Unified, and Smart Interface)