"Developing Real-time Video Applications with CoaXPress," A Presentation from Euresys
-
Upload
embedded-vision-alliance -
Category
Technology
-
view
76 -
download
0
Transcript of "Developing Real-time Video Applications with CoaXPress," A Presentation from Euresys
Copyright © 2017 Euresys 1
Jean-Michel Wintgens
May 2017
Developing Real-time Video
Applications with CoaXPress
Copyright © 2017 Euresys 3
• Manufacturer of frame-grabbers and image processing software libraries
• Since 1989
• Staff: 45 people
• Head office in Belgium
• Sales offices in California, Singapore, China and Japan
• Specialize in image capture and camera control for machine vision and
computer vision applications
• Selling 25 K frame grabbers and 10 K software licenses per year
• Member of the AIA, EMVA, JIIA and the Embedded Vision Alliance
• Active member of the CoaXPress technical committee
Introducing Euresys
Copyright © 2017 Euresys 5
• A video transport standard for Computer Vision
• Camera – Frame Grabber Interface
• High data rate
• Up to 6.25 Gbps (8b/10b encoded: 625 MByte/s) over a single
coaxial cable
• Link aggregation: 8-connection cameras at 50 Gbps (5 GByte/s) are
available off-the-shelf
• 12.5 Gbps per connection under development
• Acquire images from the fastest and highest-resolution cameras
What is CoaXPress?
Copyright © 2017 Euresys 6
• Flexible and reliable cable
• Use standard coaxial cables
• Ease of integration
• Simplify cabling and reduce costs with a single coaxial cable for
• Data transfer
• Camera control
• Power
• Take advantage of robust connectors
• With a push/pull latching system for reliability in industrial applications
CoaXPress Benefits
Copyright © 2017 Euresys 7
• Standard 75-Ohm Coaxial Cable
• Asymmetric High Speed Serial Communication
• Connection Aggregation
• Use multiple cables to increase performance
• 1, 2, 4, or more
CoaXPress
Image /Video
Control +Trigger
Power over CoaXPress
Copyright © 2017 Euresys 8
• Comparison with other interfaces
Bandwidth
Interface Bandwidth
GigE Vision/Ethernet 230 Mbyte/s
USB3 400 Mbyte/s
Camera Link 850 Mbyte/s
(1 x CXP-6)625 Mbyte/s
(8 x CXP-6)5000 Mbyte/s
Copyright © 2017 Euresys 9
• Comparison with other interfaces
Cable length
Interface Cable length
GigE Vision/Ethernet 100 m / 330 ft
USB3 3~5 m / 10~16 ft
Camera Link 6~10 m / 20~32 ft
(CXP-1)130 m / 430 ft
(CXP-6)40~80 m / 130~260 ft
(CXP-12)20~40 m / 65~130 ft
Copyright © 2017 Euresys 11
• Problem
• Trigger is asynchronous with any other traffic on the CoaXPress link
• Frame grabber sends the trigger packet (6 characters) to the camera
using 20.83 Mbps uplink
• Traffic is 8b/10b encoded
• Packet insertion at character boundary, one 10-bit character is 480 ns
• Potential jitter up to 7 x 480 ns = 3.4 µs
CXP Fixed-latency low-jitter camera triggering
Copyright © 2017 Euresys 12
CXP Fixed-latency low-jitter camera triggering
• Solution
• Measure the time between
trigger event and sending trigger
packet (time unit = 2 ns)
• Send the delay in the packet
• The camera waits (480 ns - )
before issuing the trigger
• Fixed latency: 7 symbols: 3.4 µs
• Jitter: < 4 ns
Copyright © 2017 Euresys 13
Camera Trigger
Up Connection
(No Additional Cable)
Up Connection
(Additional CXP-6 Cable)
Bit Rate 20.833 Mbps 6.125 Gbps
Latency 3.4 µs 20 ns
Jitter +/- 4 ns +/- 1.6 ns
Trigger Rate Up to 125 kHz
Up to 250 kHz*
Up to 2 MHz
* Single message trigger mode
Copyright © 2017 Euresys 15
• Coaxlink: general purpose CoaXPress frame grabbers
• Up to four CoaXPress CXP-6 connections
• PCIe 3.0 (Gen 3) or PCIe 2.0 (Gen 2) x4 bus
• Feature-rich set of up to 20 digital I/O lines
• Extensive camera control functions
• Memento event logging tool
Euresys CoaXPress Frame Grabbers
Copyright © 2017 Euresys 16
Euresys Coaxlink Series
CoaXPress Configuration and camera bandwidth
CXP-6 DIN-1
1 x 6.25 Gb/s
= 625 MB/s
CXP-6 DIN-2
2 x 6.25 Gb/s
= 1,250 MB/s
CXP-6 DIN-4
4 x 6.25 Gb/s
= 2,500 MB/s
PCIe
Bus
PCIe 2.0 (Gen 2) x4
1,700 MB/s (sustained
bandwidth)
Coaxlink Mono
Coaxlink Duo
Coaxlink Duo
PCIe/104
Coaxlink Quad
PCIe 3.0 (Gen 3) x4
3,350 MB/s (sustained
bandwidth)
- -
Coaxlink Quad G3
Coaxlink Quad G3 DF
Copyright © 2017 Euresys 17
• Two-connection ruggedized
CoaXPress frame grabber
• Ruggedized board for
industrial and transportation
embedded applications
• Small stackable PCIe/104
form factor
Coaxlink Duo PCIe/104-EMB
Copyright © 2017 Euresys 18
• Two-connection ruggedized CoaXPress frame grabber
• Extended temperature range: -40 to +85°C / -40 to +185°F
• Sustained shock: 40 g/11 ms (all axes – half-sine and saw tooth)
• Optional conformal coating
• Two CoaXPress CXP-6 connections: 1,250 MB/s camera bandwidth
• PCIe 2.0 (Gen 2) x4 bus: 1,700 MB/s delivery bandwidth
Coaxlink Duo PCIe/104-EMB
Copyright © 2017 Euresys 19
• Feature-rich set of IO
• High-speed differential inputs: Quadrature motion encoder
support up to 5 MHz
• Isolated current-sense inputs: 5 V, 12 V, 24 V signaling
voltages accepted, up to 50 kHz, individual galvanic isolation
up to 500 VAC RMS
• Isolated contact outputs
• High-speed 5V-compliant TTL inputs/LVTTL outputs
Coaxlink General Purpose IO
Copyright © 2017 Euresys 20
• C2C-Link is able to synchronize cameras connected
• To the same Coaxlink card
• To different cards in the same PC
• To different cards in different PCs
• Distributes camera trigger at up to 2.5 MHz
Coaxlink C2C-Link
Copyright © 2017 Euresys 21
• Memento event logging system
• Memento records an accurate log of events related to the camera,
the frame grabber and its driver as well as the host application
• It provides assistance during application development and
debugging, as well as during operation
Coaxlink Memento
Copyright © 2017 Euresys 22
• Memento event logging system
• It provides a precise timeline of
time-stamped events, with
context information
• It is non-intrusive and works
with all Coaxlink cards
in the PC
Coaxlink Memento
Copyright © 2017 Euresys 23
• AMD DirectGMA
• Direct transfer of image data from Coaxlink to GPU memory
• Compatible with the AMD FirePro W5x00 and above
and all AMD FirePro-S series products
• Sample program available
• NVIDIA GPUDirect for Video/Cuda
• Significant performance improvements
in data transfer times for applications
Coaxlink Image transfer to GPU
Copyright © 2017 Euresys 24
• Windows and Linux drivers
• x86 and x86_64 architectures
• AArch64 64-bit ARM architecture for Linux
• User-level API
• Dynamic libraries to use with ISO-compliant C/C++ compilers
• .NET assemblies to use with .NET framework 2.0 and above
Drivers
Copyright © 2017 Euresys 26
• For applications where
• Use of coaxial cable is prevalent
• Longer cable length is required
• Defense applications
• Security applications
• Medical applications
Applications
Copyright © 2017 Euresys 27
• For applications requiring
• High data rates
• High frame rates
• Long cable lengths, greater
cable reliability and flexibility
• Flat panel display inspection
• Solar glass inspection
• Glass inspection
Applications
Copyright © 2017 Euresys 28
• For applications requiring
• High resolution & frame rate
• Synchronized operation of
multiple cameras
• Complex lighting control
Strobed, IR, Multi-spectral…
• Consistent real-time timing
• Automated Optical Inspection
• Printing inspection
Applications
Copyright © 2017 Euresys 30
• Accurate synchronization between frame grabber and OS time
• Challenge
• Different start time
• Clock drift
• Low frequency drift variations
• Temperature
• CPU load
• Power supplies
Accurate Time Synchronization
OS Time
FG T
ime
Copyright © 2017 Euresys 31
• Solution
• Synchronization model
• Taking into account the drift
between clocks
• Robust against low frequency
drift variations
• Monitor the synchronization error
and react if it varies
• In practice
• Error < 2 µs (with clock precision 1 µs)
Accurate Time Synchronization
OS Time
FG T
ime
Copyright © 2017 Euresys 33
• A powerful standard for computer vision
• Simple and cost-effective
• 75 Ohm coaxial cable with industrial connectors
• Highly Integrated
• Data, control, real-time trigger, and power in the same cable
• Adopted by major camera manufacturers
• Highest rates
• 8 x CPX-6 50 Gbps 5 Giga Pixels/s
Summary
Copyright © 2017 Euresys 34
• A Powerful standard for computer vision
• Longest cables
• 130 m with CXP-1
• 40-80 m with CXP-6
• Reliable
• Resilient protocol
• A progressing standard
• Towards Higher Rates: CXP-12…
Summary
Copyright © 2017 Euresys 35
• Coaxlink: general purpose frame grabbers
• Up to four CoaXPress CXP-6 connections
• Choice of PCIe 3.0 (Gen 3) or PCIe 2.0 (Gen 2) x4 bus
• Feature-rich set of up to 20 digital I/O lines
• Extensive camera control functions
• Memento Event Logging Tool
Summary
Copyright © 2017 Euresys 38
CoaXPress – Comparison with other interfaces
Interface Bandwidth Frame rate
4MP camera
Cable
length
Trigger
jitter
GigE Vision 1.0 Gbps 25 fps 100 m
USB3 5.0 Gbps 90 fps 3 ~ 7 m
Camera Link Base: 2.0 Gbps
80-bit: 6.8 Gbps
-
180 fps
6 ~ 10 m ☺
CXP-6
1x: 6.2 Gbps
2x: 12.5 Gbps
4x: 25.0 Gbps
142 fps
-
563 fps
40 m ☺
Copyright © 2017 Euresys 39
CoaXPress Down Link – Data Rates
Bit Rate (Gbps) Data Rate (MBps)
CXP-1 1.25 125
CXP-2 2.5 250
CXP-3 3.125 312
CXP-5 5 500
CXP-6 6.25 625
Pixel Rate
(Megapixel/s)1 x CXP-6 2 x CXP-6 4 x CXP-6
8-bit pixel 625 1,250 2,500
10-bit pixel 500 1,000 2,000
24-bit pixel 208 417 833
Copyright © 2017 Euresys 40
• 20.833 Mbps Communication Channel
• Control the Camera
• Setup the camera
• Control the camera operation
• Real-Time Triggering
• Trigger the camera exposure
• Control the exposure time
• Reliable protocol
• Fixed latency/Low jitter
CoaXPress Up Link
Copyright © 2017 Euresys 41
• 24 V DC
• 17 W provided by the frame grabber on each connector
• 4 W cable loss budget
• 13 W at camera side
• Connection Aggregation
• 2 Connections: 34 W (26 W)
• 4 Connections: 68 W (52 W)
• Plug and Play
• Automatic detection of PoCXP support
• Over-current protection
Power over CoaXPress (PoCXP)
Copyright © 2017 Euresys 42
Cable length
Cable
Type
Manufacturer
Reference
CXP-1 CXP-3 CXP-6
Industry
Standard
Belden 1694A 130 m 100 m 40 m
Gepco VSD2001 140 m 110 m 44 m
Canare L-5CFB 118 m 88 m 34 m
Flexible Belden 1505F 80 m 60 m 23 m
Gepco VHD2000M 81 m 61 m 24 m
Canare L-3CFB 72 m 60 m 24 m
Thinnest Belden 1855A 55 m 55 m 25 m
Gepco VDM230 66 m 62 m 25 m
Canare L-2.5CFB 43 m 43 m 20 m
Copyright © 2017 Euresys 43
• BNC Connector
• DIN 1.0/2.3 Connector
• Robust push/pull latching connection
system for reliable industrial applications
• Since CoaXPress 1.1
• Multi-Connector Assemblies
75-Ohm Connectors
Copyright © 2017 Euresys 44
• 8b/10b Encoding
• Increase the reliability of the transmission
• Detect data transmission errors
• Forward error correction is considered for a future CXP version
Data Transmission Reliability
Copyright © 2017 Euresys 45
• Resilient Protocol
• Data Packets (image and control)
• 32-bit CRC checksum
• Redundancy: Replication of critical packet header data
• Image & Synchronization Information
• Trigger Packets
• Using special K-codes in the 8b/10b coding
• Redundancy: Character replication
• Message Handshake: Acknowledge and resend procedure
Data Transmission Reliability
Copyright © 2017 Euresys 46
• Connection Test Mode
• Standardized method to validate a system
• Mandatory for all CoaXPress Frame Grabbers and Cameras
Data Transmission Reliability