Hua zhang (alex) resume previous design cherry propsal

83
Hua Zhang (Alex) Columbia Apartments 10C/15 Whitaker Place Grafton Auckland 1010 Email: [email protected] Mobile: 021 023 53269 OBJECTIVE To seek an internship or potential work opportunity at ControlVision PROFESSION PROFILE I worked as a R&D engineer focus on Optics and Illumination System for five and a half years at ASM Pacific Technology, which is the world’s largest assembly and packaging equipment supplier for the semiconductor and LED industries (www.asmpacific.com , Stock Code: 0522.HK) Developed Image Optics, Laser Optics and Illumination Module for Machine Vision application. Hands-on experience in Optical Design, LED based lighting design, stray light analysis, UV, IR and Laser application. Knowledge of Optical Systems aberration balancing, tolerancing and image quality assessment techniques. Experience of Laser Beam coupling, delivering and shaping method. Familiar with Radiometry, Photometry, Colorimetry, light source and Secondary Optical Design of Illumination Systems. Understand Opto-Mechanical structure, Machine Vision configuration and illumination approach. Ability to Design Optical and Illumination systems for manufacturability. Proficiency with optical modeling software Zemax and illumination modeling software TracePro. Working knowledge of 3D modeling software Solid Edge. Ability to build 3D module and release schematic of Optical and Illumination Systems Hands-on experience with assembling, measurement, and testing. Test metrology knowledge includes using Lens Bench, Spectrometers, Integration Sphere, and Flux Meter. Ability to provide technical support and consultation to customers. Experience of analyzing application requirement and making product specification accordingly Fundamental program ability in Matlab. Proficiency with MS office. Good at data analysis with Excel Awareness of customer service skills which were studied in PADI divemaster course I am a flexible and adaptable team player who can work in a fast-pace and multi-task environment WORK EXPERIENCE Talley's Group Ltd Motueka, NZ 04/2015-05/2015 Worker 45° South Cromwell, NZ 01/2015-02/2015 Cherry picker and sorter Leaning rock cherries Alexandra, NZ 12/2014-01/2015 Cherry picker

Transcript of Hua zhang (alex) resume previous design cherry propsal

Page 1: Hua zhang (alex) resume previous design cherry propsal

Hua Zhang (Alex)

Columbia Apartments

10C/15 Whitaker Place

Grafton Auckland 1010

Email: [email protected]

Mobile: 021 023 53269

OBJECTIVE

To seek an internship or potential work opportunity at ControlVision

PROFESSION PROFILE

I worked as a R&D engineer focus on Optics and Illumination System for five and a half years at

ASM Pacific Technology, which is the world’s largest assembly and packaging equipment supplier

for the semiconductor and LED industries (www.asmpacific.com, Stock Code: 0522.HK)

Developed Image Optics, Laser Optics and Illumination Module for Machine Vision application.

Hands-on experience in Optical Design, LED based lighting design, stray light analysis, UV, IR

and Laser application.

Knowledge of Optical Systems aberration balancing, tolerancing and image quality assessment

techniques. Experience of Laser Beam coupling, delivering and shaping method. Familiar with

Radiometry, Photometry, Colorimetry, light source and Secondary Optical Design of Illumination

Systems. Understand Opto-Mechanical structure, Machine Vision configuration and illumination

approach. Ability to Design Optical and Illumination systems for manufacturability.

Proficiency with optical modeling software Zemax and illumination modeling software TracePro.

Working knowledge of 3D modeling software Solid Edge. Ability to build 3D module and release

schematic of Optical and Illumination Systems

Hands-on experience with assembling, measurement, and testing. Test metrology knowledge

includes using Lens Bench, Spectrometers, Integration Sphere, and Flux Meter.

Ability to provide technical support and consultation to customers. Experience of analyzing

application requirement and making product specification accordingly

Fundamental program ability in Matlab. Proficiency with MS office. Good at data analysis with

Excel

Awareness of customer service skills which were studied in PADI divemaster course

I am a flexible and adaptable team player who can work in a fast-pace and multi-task environment

WORK EXPERIENCE

Talley's Group Ltd Motueka, NZ 04/2015-05/2015

Worker

45° South Cromwell, NZ 01/2015-02/2015

Cherry picker and sorter

Leaning rock cherries Alexandra, NZ 12/2014-01/2015

Cherry picker

Page 2: Hua zhang (alex) resume previous design cherry propsal

Coral Grand Divers Koh Tao Koh Tao island, Thailand 08/2014-10/2014

SCUBA Divemaster trainee

Arranged diving boat schedule

Led underwater tour

Assisted SCUBA diving course and dive shop operation

Designed and manufactured aluminum holder for underwater camera

ASM Technology China Limited Chengdu, China 04/2014-08/2014

Senior Optical Engineer

Participated in research projects, including

Studied and improved Illumination System of AOI (Automatic Optical Inspection) machine used

to inspect IC chip

Conducted feasibility study of UV lithography projection lens. Sourced and communicated with

third-party designer

As a team leader, conducted team building, achievements including

Set up vision laboratory according to budget

Standardized optical design workflow and design checkpoint

Improved training material of Optics and Illumination

Conducted training course about Optics, Illumination and Vision System

Coached new optical engineers and delegated tasks

ASM Technology Hong Kong Limited Hong Kong, China 03/2012-03/2014

R&D Engineer

Worked closely with product team and sales team to develop vision module

Gave quick response to the field issues and new requirements which are fed back from customers

Summarized application requirements and made product specification accordingly

Worked with manufacturing team to ensure manufacturability and product delivery on schedule

Developed ASM standard image lens family

Drafted specification of CCTV Lens family and Telecentric Lens family

Designed focal length 50mm CCTV Lens and WD150 Mag0.42X Telecentric Lens

Provided technical support for customer to choose appropriate lens

Developed ASM standard lighting family

Designed Panel Light, Bar Light, Ring Light, Dome Light and ultra bright Spot Light with LED

and optical components such as Light Guide, Reflector, Filter, Polarizer, Beam Splitter, Lens

Array, Lenticular, Fresnel Lens, plastic and glass Lens

Provided technical support for customer to choose appropriate lighting

Participated in development of LED inspection machine

Designed high magnification inspection optics with microscopic objective

Designed ultra bright multi-angle ring light

Participated in development of Image Sensor Inspection and Camera Module Bonding machine

Designed programmable Ring Light for AOI (Automatic Optical Inspection) machine used to

inspect Foreign Material on Image Sensor

Conducted stray light analysis of AOI optics

Improved RGB coaxial light for Camera Module centering alignment

Designed projection lens group used to active align camera module

Improved lighting module of Lead frame inspection system

Page 3: Hua zhang (alex) resume previous design cherry propsal

Developed Illumination System of UV and IR application, including

UV curing module for spot, line and area use

Designed infrared illumination module to inspect micro crack of solar wafer

Participated in research projects, including

Studied the principal and the key designing factor of Mask Aligner Lithography machine

Trouble shooting illumination path of Mask Aligner Lithography machine

Improved in-house test station used to test the property of optical reflectance

ASM Technology China Limited Chengdu, China 02/2009-02/2012

Optical Engineer

Developed optical module of laser marking system (Patent Pending)

Designed coupling lens which is used to couple pump laser to Nd:YVO4 crystal in

DPSS(Diode-Pumped Solid-State) laser system

Designed Fiber Collimator and Beam Expander

Designed optics and lighting used to align IC package and conduct post mark inspection

Designed focal length 160mm F-theta lens

Drafted assembly procedure for each optical module and testing approach

Developed Laser scribing system (US 8610902 B2, US 8354612 B2 )

Designed Height Detection Optics used to measure the variation of wafer surface

Designed laser path and imaging path shared optics to conduct alignment of wafer

Designed extreme-compact ring light and nozzle embedded ring light

Designed asymmetry laser beam expander to get elliptical focus spot

Supported Optical Sensor research and development

Improved 1500mmX900mm LED panel light

Studied about fiber illumination system

Studied about material reflectance property

A State-owned enterprise 07/2008-10/2008

Assistant Engineer

Studied Infrared Search and Track (IRST) system

Edited and classified technical document

Conducted software maintenance

EDUCATION

University of Electronic Science and Technology of China Chengdu, Sichuan, China

Master of Science focus on Optics 09/2005-06/2008

Changchun Institute of Optics and Fine Mechanics Changchun, Jilin, China

Bachelor of Science focus on Optoelectronics 09/2001-06/2005

OTHER TRAINING AND SKILLS

5S workshop management

PADI Emergency First Response course

PADI Rescue diver and PADI Divemaster

Page 4: Hua zhang (alex) resume previous design cherry propsal

HOBBIES AND INTEREST

Hiking, the magnificent scenery worthy of great effort walk

SCUBA Diving, underwater world is exciting. It always attracts me to discover the wonderland.

Always want to try something new and exiting

REFEREES

Xuqiong Chen, Technical Manager, ASM Technology Hong Kong Limited, Hong Kong

Phone: (00852) 2619 2450

Mobile: (00852) 6153 0188

Email: [email protected]

NY Hou, Section Manager, ASM Technology China Limited, Chengdu

Phone: (0086) 28 62870 0210

Mobile: (0086) 139 8097 5159

Email: [email protected]

Page 5: Hua zhang (alex) resume previous design cherry propsal

Previous designs

Hua Zhang (Alex)Columbia Apartments10C/15 Whitaker PlaceGrafton Auckland 1010Email: [email protected]: 021 023 53269

Page 6: Hua zhang (alex) resume previous design cherry propsal

Outline2009-2011 DPSS laser Laser marker Laser scriber Optical sensor

2012-2013 LED inspection machine Standard lens family Standard lighting family Lead frame inspection machine Solar wafer micro crack inspection machine Mask align lithography machine UV curing module

2014 AOI (Automated Optical inspection) machine Lithography projection lens Camera Holder

Page 7: Hua zhang (alex) resume previous design cherry propsal

DPSS laser

Background Design a coupling lens to focus the laser from diode pump to

Nd:YVO4 crystal

The focusing depth and spot size are specified in order to get required power density which is calculated by LASCAD

Responsibility Design the coupling lens group

Conduct tolerance analysis

Pigtail of diode pump Nd:YVO4

Aspherical coupling lens group

Page 8: Hua zhang (alex) resume previous design cherry propsal

Laser marker (Patent Pending)

Background Develop an in-house laser marking system equipped on

test handler

Responsibility According to the application requirement, draft optical

system specification. Choose appropriate camera

Design laser beam delivery path including Design fiber collimator, in house F theta lens

Choose appropriate tuning mirror, galvanometer system and stocked F theta lens

Design alignment optics and lighting

Draft assembly procedure and testing approach

Page 9: Hua zhang (alex) resume previous design cherry propsal

System layout

laser marking system

Some adjustment approach

Laser marker (Patent Pending)

Page 10: Hua zhang (alex) resume previous design cherry propsal

Alignment optics

Height detection opticsPost-scribe inspection optics

Laser Scriber (US 8610902 B2, US 8354612 B2 )

Background Conduct precision scribing of wafers with ultraviolet lasers.

Dicing lane could be as narrow as 30um. The depths of the grooves formed controlled to the order of microns

Responsibility Draft the specification of optical module

Design height detection optics which can detect 2um variation

Design post-scribe inspection optics

Design alignment optics

Design lighting

Page 11: Hua zhang (alex) resume previous design cherry propsal

Laser Scriber (US 8610902 B2, US 8354612 B2 )

System layout

Page 12: Hua zhang (alex) resume previous design cherry propsal

High PrecisionRonchi Rulings

Large NAObjectivelens

Laser Scriber (US 8610902 B2, US 8354612 B2 )

Height detection optics Objective: Detect the variation of wafer surface, then feed back to

system to adjust the XYZ table in order to make the wafer always at the fine focus position. By this means, the variation of line width and groove depth can be minimized

Principle: Construct small DOF system, project line pair to the object surface. Determine the height by estimating the position of clear pattern image

Page 13: Hua zhang (alex) resume previous design cherry propsal

Optical sensor

Background Develop in-house Fiber Optical Sensor to replace Keyence

product

Responsibility Sourced the appropriate low cost plastic lens which can

fulfill the working distance and spot size requirement

Light sourcePhotosensor

Transmit fiber

Receive fiberFocus lens

wo

rkp

iece

Layout Fiber bundle Keyence product

Page 14: Hua zhang (alex) resume previous design cherry propsal

LED inspection machine Background

Develop a machine to inspect the LED die on wafer

Responsibility Draft optical module specification

Design high mag inspection optics

Design ultra bright ring light

Page 15: Hua zhang (alex) resume previous design cherry propsal

System layout

LED inspection machine

Page 16: Hua zhang (alex) resume previous design cherry propsal

Lens and lighting family Background

Develop telecentric lens series, TV lens series and lighting series.

Responsibility Draft the specification including camera type supported,

working distance, magnification, volume, etc.

Design part of the series

Draft selection guideline

Page 17: Hua zhang (alex) resume previous design cherry propsal

Lens and lighting family

Some designs

TC lens Mini TC lens FL 50mm TV lens

Panel light family Equipped on machine (red and white)

Page 18: Hua zhang (alex) resume previous design cherry propsal

Assemble lens Assemble lens

Test of the lens50mm TV lens

Lens and lighting family

Assemble FL50mm TV lens

Page 19: Hua zhang (alex) resume previous design cherry propsal

Lead frame inspection machine

Background Inspect the defect on lead frame by line scan camera and

rich angle lighting. The lighting module on first generation machine need to be improved

Responsibility Improve the lighting intensity

Improve the evenness

Conduct the analysis of mechanical part tolerance and assembly procedure.

Page 20: Hua zhang (alex) resume previous design cherry propsal

Lead frame inspection machine

System layout

•Replace the 3mm LED by SMT LED in order to increase the intensity

•Design lens array to narrow the angular distribution of SMT LED

3mm LED SMT LED

Page 21: Hua zhang (alex) resume previous design cherry propsal

Solar wafer inspection machine

Background Inspect the micro crack on solar wafer by line scan camera

and IR lighting.

Responsibility Conduct the experiment to study the property of VCSEL

(Vertical-Cavity Surface-Emitting Laser) array

Conduct the experiment to determine the required lighting angle and lighting intensity

Design the lighting module

Page 22: Hua zhang (alex) resume previous design cherry propsal

System layout

Solar wafer inspection machine

VCSEL array ofPrinceton Optronics

Split ray path from single source

Page 23: Hua zhang (alex) resume previous design cherry propsal

Mask align lithography machine

Background Expose the structure of LED chip by UV light

Responsibility Study the key parameter and its impact on the system

Conduct simulation and find way to decrease the impact introduced by the variation of UV light source

Study the impact of diffraction at different gap between mask and wafer

Page 24: Hua zhang (alex) resume previous design cherry propsal

Mask align lithography machine

System layout

Projection lens

Elliptical reflector

Mercury Vapor Light

Cold mirror

Collimating lens

Lens array

Filter

Mask

WaferGap 0-30um

Page 25: Hua zhang (alex) resume previous design cherry propsal

UV curing module

Background UV curing module is used to cure the UV glue. The machines

used to bond lens module and make LED panel equip such module

Responsibility Source suitable high power UV led

Design UV curing module, including spot curing type and line curing type

Propose cascade approach in order to achieve area curing

Page 26: Hua zhang (alex) resume previous design cherry propsal

UV curing module

System layout

spot curing type

Line scan type

Front view Side view

Page 27: Hua zhang (alex) resume previous design cherry propsal

AOI machine

Background AOI machine is used to inspect the defect of Semiconductor

chips, including Contamination, wire missing on IC chip

Foreign material on image sensor. The minimum size of foreign material could be as small as 2um

Responsibility Carry out experiment to determine the most optimized

lighting angle could highlight the feature on IC chip

Study the property of 2D reflective grating (Image sensor could be treated as grating)

Calculate the best combination of azimuth angle and zenith angle which could minimize the background noise

Design the lighting

Page 28: Hua zhang (alex) resume previous design cherry propsal

Optimized incident light angle should make as less diffraction order go through

optics as possible

Principal and system layout

AOI machine-Foreign material inspection

Page 29: Hua zhang (alex) resume previous design cherry propsal

Lithography projection lens

Background The structure of high power SMT led requires deeper

groove depth while keep small critical dimension. it is hard to achieve by mask align approach. By projection approach, the process window could be wider

Responsibility Study the principal of stepper lithography and key design

factor at optical view

Source the commercial product and compare the specification

Source the third party lens maker who can design and make the large projection lens

Page 30: Hua zhang (alex) resume previous design cherry propsal

Lithography projection lens

System layout

Page 31: Hua zhang (alex) resume previous design cherry propsal

Camera holder Background

Before I conducted my PADI Dive master training, I would like to buy a camera holder to hold my GoPro and Iphonewith waterproof case. With the holder, the video would be much more stable. The holder I found was too expensive (~200NZD). I designed one by myself and found a local workshop to make it. I made two set at unite price ~45NZD

Page 32: Hua zhang (alex) resume previous design cherry propsal

SE Part model SE Assembly model

Holder Holder with camera

Camera holder

Holder with camera

Page 33: Hua zhang (alex) resume previous design cherry propsal

Underwater @ Koh Tao Captured by GoPro/Iphone with holder

Camera holder

Page 34: Hua zhang (alex) resume previous design cherry propsal

THE END

THANK YOU

Page 35: Hua zhang (alex) resume previous design cherry propsal

Automatic Optical Inspection proposal

of cherries

Hua Zhang (Alex)Columbia Apartments10C/15 Whitaker PlaceGrafton Auckland 1010Email: [email protected]: 021 023 53269

Page 36: Hua zhang (alex) resume previous design cherry propsal

Outlines

Objective

Customer requirement

Feasibility study

Preliminary design

Detail design

Pending issue discussion

Appendix

Page 37: Hua zhang (alex) resume previous design cherry propsal

Objective

Propose an Automatic Optical Inspection proposal for cherries in order to save labor cost

Page 38: Hua zhang (alex) resume previous design cherry propsal

Customer Requirement

Inspect the size, color and surface defects of cherries Cherry size range from 22mm to 36mm

Cherry color range from light red to dark red

Surface defects include scars, pit, crack, half moon, stem missing, misshapen, decay, etc.

Inspection speed Faster than the sorting speed of average worker

Cherries ColorCherries size Cherries defect

Page 39: Hua zhang (alex) resume previous design cherry propsal

Feasibility study

Need to find a way to take pictures of the entire surface

In order to achieve color detection, white illumination and color camera should be used

Cloudy day light (Dome light) should be used since the surface of cherries is curved and smooth (If the lighting angle is not adequate, hot spot may be observed)

hot spot

Hot spot on cherries

Page 40: Hua zhang (alex) resume previous design cherry propsal

Feasibility study

Suppose the minimum pixel number required to distinguish a feature point is 4 pixels Suppose the minimum feature size which need to be

detected is 1mm circle, that means the minimum pixel resolution should be 500um/pixel on object side

Required pixel resolution highly depends on the image quality, algorithm ability and detected feature type, according to the actual situation the pixel resolution could be much higher

1m

m

4 pixel to distinguish a 1mm circle

Page 41: Hua zhang (alex) resume previous design cherry propsal

Feasibility study

UPH calculation Base on my experience, the amount of cherries in one

bucket range from 400ea-500ea, take 450ea to calculate

A good performance sorting team can sort 700 buckets in 8 hours

Total 450X700=315,000ea in 8 hours, corresponding to 39,375ea/Hour or 11ea/Second

Suppose the pitch of cherries on carrier is 50mm, the moving speed is (11-1)X50=500mm/s(base on my experience, the moving speed could be faster, discuss later)

Sorting line at45 degree south

50mm 50mm 50mm 50mmCherries pitch

50mm

Page 42: Hua zhang (alex) resume previous design cherry propsal

Feasibility study

Rough Vision System specification FOV>50mm

Pixel resolution>500um/pixel on object side

Frame rate>11frame/second

Moving speed>500mm/s

Exposure time to be determined

Lighting type should be cloudy day light

Page 43: Hua zhang (alex) resume previous design cherry propsal

Preliminary design

How to place camera

What kind of camera

What kind of image lens

What kind of lighting

Page 44: Hua zhang (alex) resume previous design cherry propsal

Preliminary design -How to place camera

Theoretically, 6 cameras can cover the entire surface

However, the horizontal camera will block the moving direction of cherries

Moving dire

ction

Top ViewSide viewFront view

Moving direction Moving direction

ISO view

Page 45: Hua zhang (alex) resume previous design cherry propsal

Preliminary design -How to place camera

Rotate every horizontal camera by 45 degrees on clockwise direction, the cameras give way to moving direction of cherries

However, the view of horizontal cameras may be blocked by the carrier/holding apparatus of cherries

Moving

dire

ction Moving directionMoving direction

Top ViewSide viewFront viewISO view

Page 46: Hua zhang (alex) resume previous design cherry propsal

Lift up the horizontal cameras, make 5 cameras to observe the upper hemisphere of the cherries and other 5 cameras to observe the rest

Top ViewSide view

camera Chief RayAnd FOV

Moving direction Moving direction

Preliminary design -How to place camera

Page 47: Hua zhang (alex) resume previous design cherry propsal

Lift up the horizontal cameras, make 5 cameras to observe the upper hemisphere of the cherries and other 5 cameras to observe the rest

In this structure, there are total 10 pictures to reconstruct the entire surface and shape of cherries

Moving

dire

ction

Moving directionMoving direction

Top ViewSide viewFront viewISO view

Preliminary design -How to place camera

Page 48: Hua zhang (alex) resume previous design cherry propsal

The actual image effect may looks like as below

Upper hemisphere Lower hemisphere

Preliminary design -How to place camera

Page 49: Hua zhang (alex) resume previous design cherry propsal

Preliminary design –What kind of camera

Line scan camera is not suitable for this application Though line scan can achieve very high speed, it requires much

more complicated configuration and brighter illumination

Because of the camera position, the line scan is not applicable

VGA or higher resolution USB camera should be OK USB camera is common, cheap and convenient to setup

Some calculation to determine the resolution of USB camera

VGA camera (640X480) with cell size 7.4um, corresponding sensor size is 4.8mmX3.6mm

Optics magnification is 3.6mm/50mm=0.072X

Pixel resolution on object side 7.4um/0.072X=102um/pixel

USB VGA camera or higher can meet the requirement

Area scan and Line scanPic from Edmund optics

Page 50: Hua zhang (alex) resume previous design cherry propsal

Preliminary design –What kind of image lens

Telecentric lens or CCTV lens Telecentric lens is expensive, bulky, with relative small FOV (Field

Of View), but its measurement accuracy is high

CCTV lens is cheap, compact and can achieve large FOV, but the magnification will vary according to the object working distancevariation

Depending on the requirement of measurement accuracy to choose appropriate lens

Suppose the measurement error is ~5%, I will use TV lens for detail design

Different measurement result of telecentric lens and non-telecentric lens (Pic from Edmund optics)

Page 51: Hua zhang (alex) resume previous design cherry propsal

Preliminary design–What kind of illumination

Since the surface of cherries is curved and smooth, a rich diffused angle lighting should be used in order to provide an even illumination

According to the detailed mechanical layout, the lighting may be need customer design

Hot spot, not even

Diffused lighting and dome lighting

(Pic from CCS INC)

Page 52: Hua zhang (alex) resume previous design cherry propsal

Detail design

Detailed Layout, camera and lens model

Moving speed

Lighting structure and intensity

Detailed vision system specification

Page 53: Hua zhang (alex) resume previous design cherry propsal

Detail design -Layout

In preliminary design, there are 10 cameras to observe the entire surface, the number of cameras is to much

By adding reflecting mirror, the quantity of cameras can be reduced

One camera can observe both top and side simultaneously

10 camera configuration One camera look both top and side

Mirror

Page 54: Hua zhang (alex) resume previous design cherry propsal

Detail design -Layout

Draw the ray path in CAD, then determine the appropriate size and position of mirrors

FOV topFOV SideMirror

Page 55: Hua zhang (alex) resume previous design cherry propsal

Detail design -Layout

Draw the ray path in CAD, then determine the appropriate size and position of mirrors

Lay out Mirror

Page 56: Hua zhang (alex) resume previous design cherry propsal

Detail design -Layout

In order to make the mirrors give way to moving direction of cherries , the FOV of optics should be 160mmX160mm

The mirrors will not block the moving direction Optics FOV 160mmX160mm

Page 57: Hua zhang (alex) resume previous design cherry propsal

Detail design –camera and lens

The lens and camera can be chosen from Edmund Optics

Once the FOV is fixed, the focal length of image lens is related to camera format and working distance

Working distance is constrained by machine layout restriction, I suppose the WD could achieve 400mm

EO USB 3.0 camera introduction EO fixed focal length lens introduction

Page 58: Hua zhang (alex) resume previous design cherry propsal

Detail design –camera and lens

WD FOVCameramodel Pixel

Pixelsize

Sensor size(Vertical)

Framerate Price Mag

Pixelresolution

Focal lengthrequired

Ray angleof side FOV

370.00 160.00 EO-0413 752 x 480 6.00 2.88 100.00 775.00 0.0180 333.33 6.54 12.21370.00 160.00 EO-1312 1280 x 1024 5.30 5.43 60.00 825.00 0.0339 156.17 12.14 12.21370.00 160.00 EO-2018 1600 x 1200 4.50 5.40 63.40 1050.00 0.0338 133.33 12.08 12.21370.00 160.00 EO-4010 2048 x 2048 5.50 11.26 75.00 2995.00 0.0704 78.15 24.33 12.21370.00 160.00 EO-5012 2560 x 1920 2.20 4.20 15.00 895.00 0.0263 83.81 9.46 12.21

The comparison table shows different configuration of lens and camera

Base on the lens availability at vendor side, pixel resolution and price, I choose FL 12mm lens and EO-1312 USB 3.0 color camera

Comparison table shows different configuration

Page 59: Hua zhang (alex) resume previous design cherry propsal

Camera spec

Detail design –camera and lens

http://www.edmundoptics.com/cameras/usb-cameras/eo-usb-3-0-cmos-

machine-vision-cameras/86755/

Page 60: Hua zhang (alex) resume previous design cherry propsal

Detail design –camera and lens

Lens spec

http://www.edmundoptics.com/imaging-lenses/fixed-focal-length-

lenses/compact-fixed-focal-length-lenses/58001/

Page 61: Hua zhang (alex) resume previous design cherry propsal

Discussion

There are some other vendors could provide the similar camera and lens (in case the purchased parts discontinue at a specific vendor)

Cameras also available at Moritx and Basler

Lens also available at Moritx and Tamron

Detail design –camera and lens

Moritex 12mm lens Tamron 12mm lens Basler 1.3MP camera

Page 62: Hua zhang (alex) resume previous design cherry propsal

Discussion

Lens setup

As a rule of thumb, larger aperture is preferred since it brings higher resolution and need lower illumination intensity at same exposure time. However DOF (Depth of View) is shorter at large aperture setup

The optical path is about 40mm longer when go through the mirror, in order to achieve ~40mm DOF, Set f/4

Since it is a purchase part, it is preferable to have a sample lens to measure its actual WD and image quality

Detail design –camera and lens

WD 38mmLongerwhen go through

the mirror

Page 63: Hua zhang (alex) resume previous design cherry propsal

Detail design –camera and lens

The lens can be customer designed F=12mm

F/# 4

Sensor size 6.78mmX5.43mm

Mag=-0.033X

Distortion<1%

MTF>0.3@93lp/mm image side (Nyquist resolution limit of pixel sizes of 5.4um)

Page 64: Hua zhang (alex) resume previous design cherry propsal

Detail design –camera and lens

The lens can be customer designed

Layout

Lens data

Identical lens, opposite placed

Page 65: Hua zhang (alex) resume previous design cherry propsal

Detail design –camera and lens

Optical performance data

Contrast~0.6@93lp/mm Distortion 0.6% Edge spread 5um, near 1pixel

Relative illumination Spot diagram

Page 66: Hua zhang (alex) resume previous design cherry propsal

Detail design –camera and lens

Tolerance analysis

Trial 100, 50% lens MTF@93lp>0.5

Page 67: Hua zhang (alex) resume previous design cherry propsal

Detail design –Moving speed

In order to achieve high UPH, the capture method should be on-the-fly rather than stop-and-grab, which means the object is moving when take pic

The moving speed, exposure time, illumination intensity and image quality are correlated with each other, the goal is to get a bright and sharp image

Different object has different optical scatter property (described by BSDF). Experiment should be conducted to determine the illumination intensity needed under certain exposure time

Page 68: Hua zhang (alex) resume previous design cherry propsal

Detail design –Moving speed

Moving speed (mm/s) Mag

Image side moving speed (mm/s)

Exposure time(us)

Blur size(um)

Cell size(um)

Image blur(pixel)

1500 0.033 49.5 125 6.2 5.3 1.171000 0.033 33 200 6.6 5.3 1.25750 0.033 24.75 250 6.2 5.3 1.17500 0.033 16.5 400 6.6 5.3 1.25250 0.033 8.25 750 6.2 5.3 1.17100 0.033 3.3 2000 6.6 5.3 1.25

Suppose acceptable image blur introduced by moving speed is ~1pixel

If illumination is strong enough, the exposure time could achieve 200us, corresponding moving speed can achieve 1000mm/s

Comparison table shows moving speed VS exposure time

Page 69: Hua zhang (alex) resume previous design cherry propsal

Detail design –Lighting

Modeling in Trace Pro demo version, rough diagrams to show what the lighting looks like

Lighting should be pulse driven in order to get higher intensity

Intensity requirement to be determined by experiment

ISO view Side view Top view

Reflector

Page 70: Hua zhang (alex) resume previous design cherry propsal

Detail design –Lighting

The reflecting mirror will block ray from some particular angle, how serious it is need further study

In order to achieve best illumination result, the lighting may be need customer design

ISO view Side view Top view

Reflector

Mirror block ray

Page 71: Hua zhang (alex) resume previous design cherry propsal

Detail design –Vision system specification

Vision System specification

FOV 160mm

Pixel resolution 156um/pixel@object side

Moving speed 1000mm/s

Frame rate 21frame/sec

UPH 75.6K

Exposure time 200us

Lighting intensity to be determined by experiment

Page 72: Hua zhang (alex) resume previous design cherry propsal

Pending issue

I have not figured out a appropriate holder for the cherry, it may be a transparent plastic plate with hole or spring

Transparent plastic plate Spring (need to calculate the maximum forcethat would not damage the cherries )

Page 73: Hua zhang (alex) resume previous design cherry propsal

Pending issue

I have not conducted the error analysis. The position of cherries may vary due to its different size and shape. The optics and mirrors should handle all situations

Nominal position Position Error

Page 74: Hua zhang (alex) resume previous design cherry propsal

Pending issue

I have not made a detailed procedure to assemble the vision module and test it

Lighting intensity should be determined by the experiment

In above design, there are a lot of assumptions such as allowed working distance, pixel resolution, the minimum feature size, etc. The actual value need teamwork to figure out. Keep systematic thinking in mind then balance system parameter to optimize the performance

Page 75: Hua zhang (alex) resume previous design cherry propsal

Further improvement Upgrade the camera to higher resolution and choose

appropriate lens

The system may inspect 4 cherries simultaneously, thus the speed can be increased by 4 times

Pending issue

ISO View Top View Side View

Page 76: Hua zhang (alex) resume previous design cherry propsal

Appendix -Understanding about compac system

Above proposal was my original thinking when I worked at cherry orchard

I also studied about Compac machines month ago

http://www.compacsort.com/en/invision/

Page 77: Hua zhang (alex) resume previous design cherry propsal

Appendix -Understanding about compac system

I found some video on Youtube which can demonstrate how the system works

Apple case study

Page 78: Hua zhang (alex) resume previous design cherry propsal

Appendix -Understanding about compac system

I was impressed by the carrying system which could provide rotation for inspection

US Patent 7410044 B2

Page 79: Hua zhang (alex) resume previous design cherry propsal

Appendix -Understanding about compac system

My understanding about InVision 9000 CIR There are 5 cameras. One is at vertical position and other

four are around 30degree and 60 degree separately.

The FOV would be much larger than the object. The Object starts rotating when it go through the FOV, meanwhile cameras capture image

Rotate

ISO View Front View

Page 80: Hua zhang (alex) resume previous design cherry propsal

Appendix -Understanding about compac system

Internal quality inspection I guess the structure of the product includes external or

internal NIR source and spectrometer

I guess the principal is to test some sample food and get reference spectrum curve, then compare the spectrum curve of inspected food with that

Different fruit may need different illumination method

Page 81: Hua zhang (alex) resume previous design cherry propsal

Something I have not understood

Rotation of fruit

In one video, the rotation direction opposite to the moving direction and in another video is just the reverse. I think the opposite direction is more reasonable since it can compensate the moving speed and get sharper image

Some fruits such as cherries have fragile stalk, whether the rotation would damage the fruit

The fruit has different size and shape, at same linear velocity how to determine the fruit rotate 360 degree

Appendix -Understanding about compac system

Moving direction

Rotating direction

Page 82: Hua zhang (alex) resume previous design cherry propsal

Something I have not understood

Number of pictures

In the videos, nearly 30 or more pictures were taken for a single fruit. Why need so many pictures? More accurate? what I guess is to construct 3D shape by 2D information

Appendix -Understanding about compac system

30+ image for a single fruit

Page 83: Hua zhang (alex) resume previous design cherry propsal

The END

Thanks