Intelligent Vision Technology for Industry Automation · Good sample Test image Directly...
Transcript of Intelligent Vision Technology for Industry Automation · Good sample Test image Directly...
ASTRI Proprietary
Intelligent Vision Technology for
Industry Automation
Anna, Liu Ying
Senior Manager, MTECH / OE / ASTRI
June / 2016
ASTRI Proprietary
Core Competence:
(1) Miniaturize optical engines (2) Image understanding algorithms
Defect
Inspection
3D Robotic
Vision
Display &
Sensing
Bi-Sensing
Augmented Reality HMD
Automotive Holographic HUD
HMI
Industry Robot Cognition: 3D Vision
Defect Inspection 3D AOI
3D Reconstruction
3D Body Measurement
The Technologies We Focus
ASTRI Proprietary
Defect Inspection Platform
Defects on case
(Scattering surface)
Defects on logo (Glare surface)
Defects on
geometrical edges
Defects on Camera
(Transparent surface)
Defects on LCD Panel
(Glare surface)
End Product Level Defect Inspection Component Level Defect Inspection Camera module
• Mixed characteristics surface
• Various of defects, various of locations
Optical Film
LCD Panel
Touch Panel
• Very small size
• Very limited focus depth
• Transparent surfaces
3
3D Defects Inspection & 3D
Precision Dimension
Measurement
Scratch on corner / side spot on surface
ASTRI Proprietary
3D Robotic Vision Platform
3D solder paste inspection (SPI)
Accuracy.: 2-5um@ 600um
• 3D AOI for SMT
Accuracy: 20um @ <2mm, 100um@ 2-10mm
• Semi. Package Detection
Bump: Accuracy 1-2um@ 300um
High Precision 3D AOI
3D Scanning, Reconstruction & Measurement Intelligent Robot: 3D Robot Cognition
Scanning Point Cloud 3D Mesh Dimension Phase shift 3D & Machine Learning Recognition
Assembly, Pick & Place, Random Bin Picking
ASTRI Proprietary
Core Competence
5
ASTRI Proprietary
Illumination Optics
Imaging Optics
Thermal/Mechanical
Electrical/Control
Customized Lighting To enhance the visibility of the
defects, removing noise influence .
Thermal /Mechanical Design To well organize the mechanical structure
and foot print of the vision system, and
enhance the reliability by thermal
optimization
Special Designed Imaging Lens To achieve the best image quality, well
defined field of view and variable working
distance.
Electrical / Control To power, control, trigger the vision
system by using PLC, FPGA, etc.
Optical-Mechanical-Electrical-Thermal Design Capability
Line scanning
lighting
Linear LED
lighting Light collector 16K line sensor
lens
12M array sensor
lens SXGA projection
engine
Display driver board & synchronization
control
3D AOI engine
Mech. design Thermal
simulation
ASTRI Proprietary
Template Approach Perceptive Vision
Probabilistic Approach
Perceptive Vision
7
Precision
Flexibility
Machine learning for Industry Application
Big Data Driving
Deep Learning
Image processing
Upgrade industry
Smart manufactory
Low cost high added-value
ASTRI Proprietary
High Profile Image Processing
8
Design algorithms to detect low contrast defect image, handle noise background
image and extract high precision features
High precision feature
extraction with sub pixel
accuracy, e.g. 0.1 pixels
Low contract defects with complex and noise
background
ASTRI defect inspection result with high
profile image processing: detect low contract
defect in noise data
Traditional image processing result: more
noise and false alert.
Input image with blurred edges Extract the edge position with high accuracy
Low contrast defects
ASTRI Proprietary
Rough surface with shapes
Golden samples model
Comparision
Raw photo taken
-
Good sample Test image
Directly comparison, false alert
Good sample
Test model
Test image
Machine(deep) learning modeling
[1] Benezeth Y, Jodoin P M, Emile B, et al. Comparative study of background subtraction algorithms[J]. Journal of Electronic Imaging, 2010, 19(3): 033003-033003-12.
Faster
Anti-noise
Hybrid surface
Traditional Method ASTRI’s Method
Orange peel defect
Perceptive Vision: Deep Learning Defect Inspection
ASTRI Proprietary
Main Window (UI
Display)
Main Controller
Capture
Receiver
Camera Controller
Trigger
PLC Controller
Simulator
Processing Control
Top Surface Logic
Top Surface Detector
Side Surface Logic
Side Surface Detector
Capture image path
Feasible (moduli zed) Flexible (pluggable) UI Level
Function Level
Implement Level
Implement Level
Evalution flow
High Standard Software Architecture
ASTRI Proprietary
Cases Study
11
ASTRI Proprietary
Features
Customized LCoS projection engine
Tilted projection optical design, satisfy the Scheimpflug principle
High resolution (>=720P)
Full digital pattern generation
Multi-frequency pattern modulation
Whole field, fast, accurate
3D Inspection for SPI & AOI (SMT Application)
• FOV: 46.5 x 25.6mm
• Resolution: 1280 x 720
• Work distance: 200mm
• Luminance: 32lm@5W
Engine 1
• FOV: 25 x 20mm
• Resolution: 1280 x 1024
• Work distance: 200mm
• Luminance: 25lm@5W
• FOV: 60 x 48mm
• Resolution: 1280 x 1024
• Work distance: 200mm
• Luminance: 20lm@5W
Engine 3
Engine 2
ASTRI Proprietary
3D AOI 3D SPI
Technology Multi frequency
phase shift Shadow free phase shift
Function Height, xy position
FOV size 40mm x 40mm 25mm x 20mm
Max. height 10mm 600um
camera 4M/5M high speed camera
x-y resolution 20um 10um
Z-resolution 1.2um (<2mm), 6.3um (<10mm) 0.37um
Z-Accuracy +/-20um(< 2mm)
+/-100um(<10mm) 2um
max. speed <0.47s/FOV 0.37s/FOV
3D SPI / AOI (SMT Application)
China 1st 3D SPI / AOI machines (2015) embedded ASTRI’s technology
5 companies licensed ASTRI’s 3D SPI/AOI technologies
ASTRI Proprietary
3D Scanning & Reconstruction
Dental, Face, Body 3D Reconstruction
Small object 3D Reconstruction
Applications:
Dental digitizing
3D copy machine (3D scanning+3D printing)
3D face / body Reconstruction
High speed, High precision, Full color
Product Specification
Technology Hybrid fringe projection
FOV 60~120mm 200~300mm 0.5m-1m
Camera
Resolution 1.3~2 M
Accuracy 20~30um 0.1~0.2mm 1mm
Output STL, PLY, XYZ,
ASTRI Proprietary
15
Glass (OGS, CG, Raw Glass) Inspection(1/2)
Type of inspection (檢測類型) OGS CG Raw Glass
Field of View (視場) 3~7 inch 3~7 inch 3~7 inch
Defect Size ( 瑕疵尺寸) >= 0.015mm >= 0.015mm >= 0.015mm
System resolution (系統分辨率) 0.005mm 0.005mm 0.005mm
Operation Speed( 檢測速度) <6s/panel < 4s/panel <3.5s/panel
Defects (缺陷種類) Scratch, Paint chip, Spot defects, Edge-crack, Mura, Etch defect
Core technologies
Adaptive lighting and image capture system
Advanced machine learning algorithm
High profile perceptive image processing module
High speed data processing module
ASTRI Proprietary
16
Glass (OGS, CG, Raw Glass) Inspection(2/2) Control and Setting Toolbar
Image Display Image Zoom
Log Output
Image Directory
Pilot-run ongoing
ASTRI Proprietary
17
Painted Metal Parts Inspection
Prototype
Defect Description Shape Size
Impurity Dust particles in the smooth painted surface Few tenths to some mms (>0.3mm2)
Burr Irregular bars rising on the planar surface Widths – Few tenths to some mms
Lengths – Some mms to cms
Paint stripping Unpainted spots on the uniform colored surface Few tenths to some mms (>0.5mm2)
Deformation General deformation of glazed surface with a circular shape Radius usually < 5mm
Wrinkle Wrinkles of the glazed surface with respect to the planar
surface Some mms to cms
ASTRI Proprietary
Roadmap for U.S. Robotics: Flexible
A Roadmap for U.S. Robotics, 2013 Robotics Virtual Organization (NSF: MIT, CMU, Stanford, UC Berkeley,…)
Robots for manufacturing
Shift from automotive to 3C products
Shift from fixed manufacturing to flexible manufacturing for one-off products /mass customization
18
Flexible Manufacturing:
Re-configure production line by “intelligent
industrial robot”
T=2013 +5Y +10Y +15Y
24
8 1
Hours
Fixed Manufacturing:
ASTRI Proprietary
Random Bin Picking for Industrial Robot
Robot Eye
(Perception)
Robot Brain
(Intelligence)
Robot Arm
Features & Applications :
• Wide applications in manufacturing lines of automotive, 3C and food products.
• Good solution for flexible manufacturing
• High flexibilities for different production lines
• To shorten production line change time
• To reduce production line change cost
3D scanning technology
2D/3D object recognition
Next-generation
intelligent robot
Core
technologies
ASTRI Proprietary
End of Presentation Thank you. Questions are welcome.
Corporate website: www.astri.org
20
Contact E-mail Phone No.
Tsai Chen Jung
(蔡振榮) [email protected] 852-34062814
Ryan Chung
(鍾沛璟) [email protected] 852-34062868
Liu Ying
(劉穎) [email protected] 852-34062544
ASTRI Proprietary
Disclaimer The information contained in this presentation is intended solely for your reference and may be subject to
change without further notice.
Such information's truthfulness, accuracy or completeness is not guaranteed and it may not contain all the
material information concerning Hong Kong Applied Science and Technology Research Institute Company
Limited and/or its affiliates (collectively, "ASTRI"). ASTRI makes no representation or warranty regarding,
and assumes no responsibility or liability for, the truthfulness, accuracy or completeness of any information
contained herein.
In addition, the information may contain projections and forward-looking statements that may reflect
ASTRI’s current views with respect to future events and financial performance. These views are based on
current assumptions which may change over time. ASTRI makes no assurance that such future events will
occur, that such projections will be achieved, or that ASTRI’s assumptions are correct.
Lastly, this presentation does not constitute an offer made by ASTRI whatsoever (including an offer relating
to ASTRI's technologies and/or services).
21