Technologie-und Innovationspark Jena SpectroNet...

SpectroNet Collaboration Forum Jena 2016

mobile smart

hyperspectral cameras

Technologie-und Innovationspark Jena

XIMEA GmbH , Jürgen Hillmann31.08.20161

SpectroNet Collaboration Forum Jena 2016

What are we talking about?

mobile small, lightweight,

low power consumption,

(battery driven)

smart universal and portable programmable

independent runnable

hyperspectral cameras

single cameras or complete systems

Technologie-und Innovationspark Jena

XIMEA GmbH , Jürgen Hillmann31.08.20162

HSI cameras: area scan sensors

XIMEA GmbH , Jürgen Hillmann3

HSI sensors

mobile smart hyperspectral cameras

31.08.2016

HSI sensor types from imec (used in XIMEA cameras)


line scan Snapshot Mosaic

‘per-pixel’ design4x4: ~ 470 – 630 nm5x5: ~ 600 – 975 nm

filter layouts

‘wedge’ design100 bands: ~ 600 – 975 nm150 bands: ~ 470 – 900 nm (new)


31.08.2016

HSI sensor types from imec (used in XIMEA cameras)


line scan Snapshot Mosaic

filter layouts

‘per-pixel’ design4x4: ~ 470 – 630 nm5x5: ~ 600 – 975 nm

‘wedge’ design100 bands: ~ 600 – 975 nm150 bands: ~ 470 – 900 nm (new)


31.08.2016

RAW image interpretation / snapshot mosaic


2 leaves on a stone

Snapshot mosaic 5X5-NIR, 675-975nm

900 909 892 882 683

809 821 797 784 693

759 772 746 732 708

943 949 935 927 975

861 873 852 840 955

Single 5X5 pattern, wavelength peaks [nm]

Spectrum (Raw-values)

675 nm 975 nm


31.08.2016

Mobile applications


For the operation of cameras a computer is needed to

• control the camera(s)

• grab images

• data compression if needed

• send and store data

• process and analyze the data

For hyperspectral imaging the computer has to be powerful !


31.08.2016

Mobile HSI UAV applications


One part of a UAV based hyperspectral solutions is the camera setup:

• (main) HSI camera looking to the ground

• (optional) additional HSI camera looking to the ground (e,g, another wavelength range)

• (optional) additional RGB / mono camera looking to the ground for reference images, optional: 3D reconstruction

• (optional) additional HSI camera or spectrometer to measure the ambient light conditions


31.08.2016

interpolation / sensor fusion


The spatial resolution in case of a snapshot mosaic sensor is aboutSM 5X5: <= 409 * 216 px SM 4X4: <= 512 * 272 px

The native resolution can be interpolated:

Interpolation can be used to merge images from different snapshot mosaic sensors.

spatial resolution interpolated resolution


31.08.2016

Mobile applications



31.08.2016

Mobile application (xEC system)


XIMEA is developing a very compact (HSI) imaging and recording unit for mobile applications, e.g. installable in payload compartment of drones with

• massively parallel computational resources onboard

• storage on fast SD (UHS-II SDHC/SDXC) or M.2 PCIe x 4 SSD (1000-1200 MB/s)

• IMU 9-axis

• interface to a (drone) control unit

• interface to a GPS / wireless connection

LINUX, C/C++ and CUDA compatibility guarantees portability and scalability.


31.08.2016

HW block diagram and interfaces (xEC system)



31.08.2016

Carrier/Expansion board

SD-A / M.2 SSD

HDMI

Ethernet

IMU

UART UAV

CPU / GPU unit

GPIO, SYNC

I2C, SPI

PWR

SD-B / M.2 SSD

USB3 (1 – 5) PCIe

cameras

spectrometer

WLAN

Mouse / keyboard

other


Size of the xEC board: approx. 50 * 87 mmSize of the camera head: 25 * 25 mm

Calculation power (TX1 system) ~ 1 TFLOPS


31.08.2016

Mobile application (xEC system)

xEC predecessorxiQ board level camera

Mobile applications


The system is designed to (e.g.)

• create the corrected hyperspectral imaging cube for the connected xiSpec camerasin realtime

• match spectral signatures against pre-learned signatures

• perform a data self clustering / principal component analyzis (PCA)

• check whether differences against expected results occurs

• perform a multi-pass flight (other directions, different flight altitude for detailed data)

• optional data reduction (store only not expected info, e.g. possible plant diseases fora detailed postprocessing)


31.08.2016


Thank you for your attention

www.ximea.com, [email protected]


31.08.2016

Technologie-und Innovationspark Jena SpectroNet...

Documents

Transcript of Technologie-und Innovationspark Jena SpectroNet...