THE HYPERSPECTRAL IMAGING APPROACH

33
THE HYPERSPECTRAL IMAGING APPROACH Giuseppe Bonifazi Workshop

description

ACTIONS C.1&C.2 - Process and product monitoring based on hyperspectral imaging HyperSpectral Imaging (HSI) is an innovative technology developed in recent years that combines the advantages of spectroscopy and imaging techniques. In the last years there was a strong increase in applications including off-line / on-line inspection at industrial scale in different sectors. Image source: www.perception-park.com RESAFE Project Workshop Faenza (Italy) December 14, 2015 2

Transcript of THE HYPERSPECTRAL IMAGING APPROACH

Page 1: THE HYPERSPECTRAL IMAGING APPROACH

THE HYPERSPECTRAL IMAGING APPROACH

•Giuseppe Bonifazi

•Workshop

Page 2: THE HYPERSPECTRAL IMAGING APPROACH

ACTIONS C.1&C.2 - Process and product monitoringbased on hyperspectral imaging

HyperSpectral Imaging (HSI) is an innovative technology developed in recent years that combines the advantages of spectroscopy and imaging techniques.

In the last years there was a strong increase in applications including off-line / on-line inspection at industrial scale in different sectors.

Image source: www.perception-park.com

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Page 3: THE HYPERSPECTRAL IMAGING APPROACH

All individual spatial and spectral images could be picked up from the hypercube and the spectrum of each pixel of the image in a specific position can be extracted

One spectral image of n pixels for all the investigated wavelengths (λ)

Spectral signature of a single pixel

ACTIONS C.1&C.2 - Process and product monitoringbased on hyperspectral imaging

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Page 4: THE HYPERSPECTRAL IMAGING APPROACH

Hyperspectral Imaging Characterization

SISUChema XL™ Chemical Imaging Workstation

• Operation mode:push-broom• Spectral range:

SWIR: 1000-2500nm• Spectral sampling and

(resolution)6.3nm• Active pixel:320 (spatial) x 240 (spectral)

pixels

ACTIONS C.1&C.2 – The selected HSI devices

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Page 5: THE HYPERSPECTRAL IMAGING APPROACH

ACTIONS C.1&C.2 – The selected HSI devices

Hyperspectral Imaging Characterization

Hyperspectral architecture Specim ImSpectorTM N17E

• Operation mode:push-broom• Spectral range:

NIR: 1000-1700nm• Spectral sampling and

(resolution)5nm• Active pixel:320 (spatial) x 240 (spectral)

pixels

Hyperspectral architecture Specim ImSpectorTM V10

• Operation mode:push-broom• Spectral range:

VIS-NIR: 400-1000 nm• Spectral sampling and

(resolution)5 nm• Active pixel:320 (spatial) x 240 (spectral)

pixels

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Page 6: THE HYPERSPECTRAL IMAGING APPROACH

ACTION C.1: HyperSpectral Imaging (HSI) Characterization

Actions C.1-C.2 - Sample Acquisition

Console

Monitor

Moving belt

PC

Spectral-imaginginstrumentation

Illuminant

Console

Monitor

Moving belt

PC

Spectral-imaginginstrumentation

Illuminant

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Page 7: THE HYPERSPECTRAL IMAGING APPROACH

Actions C.1-C.2: Hyperspectral data processing

Spectral data have been analysed using the PLS_Toolbox 7. 0 (Eigenvector Research Inc.) running inside Matlab™ environment (version 7.12.0).

•Spectra preprocessing

•PCA applied for data exploration

•PLS applied for spectra correlation with curing time and different measured chemical parameters

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Page 8: THE HYPERSPECTRAL IMAGING APPROACH

Actions C.1&C.2 – Results on raw materials from the different countries (Action B.1)

Step 1: Waste raw materials collected from Italy, Spain and Cyprus were utilized to train the HSI system to correctly classify them.

Step 2: Hyperspectral images of different organic waste were elaborated using the 3 different HSI devices.

Step 3: Spectra preprocessing and PCA classification model were applied for the classification of different organic matrices.

CY-UOW Sample IT-FOR Sample

1 cm

Applied pretreatment:- SNV- Mean Center

b)

a)

c)

a)

b)

c)

Raw Hyperspectal images of a) IT-BC; b) IT-FOR and c)

IT-UOW

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Page 9: THE HYPERSPECTRAL IMAGING APPROACH

0

0,1

0,2

0,3

0,4

0,5

0,6

0,7

0,8

0,9

1

1000 1050 1100 1150 1200 1250 1300 1350 1400 1450 1500 1550 1600 1650

Refle

ctan

ce

Wavelength[nm]

IT-UOW_001_N17 IT-UOW_002_N17 IT-UOW_003_N17 IT-UOW_004_N17

IT-FOR_001_N17 IT-FOR_002_N17 IT-FOR_003_N17 IT-FOR_004_N17

IT-BC_001_N17 IT-BC_002_N17 IT-BC_003_N17 IT-BC_004_N17

IT-BC_V2_001_N17 IT-BC_V2_002_N17 IT-BC_V2_003_N17 IT-BC_V2_004_N17

IT_FOR Sub-sample

IT_BC Sub-sample

IT_UOW Sub-sample

IT_BC_V2 Sub-sample

Raw materials: Italian samples Reflectance spectra (1000-1700 nm)

Actions C.1&C.2 – Results on raw materials from the different countries (Action B.1)

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Page 10: THE HYPERSPECTRAL IMAGING APPROACH

Pretreated Hyperspectal images of a) IT-BC; b) IT-FOR and c) IT-UOW

a) b) c)

a) IT-BC

b) IT-FOR

c) IT-UOW

a) b) c)

Raw Hyperspectal images of a) IT-BC; b) IT-FOR and c) IT-UOW

Applied pretreatment:- SNV- Mean Center

b)

a)

c)

Actions C.1&C.2 – Results on raw materials from the different countries (Action B.1)

Italian Raw Materials

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Page 11: THE HYPERSPECTRAL IMAGING APPROACH

Pretreatment applied: SNV + Mean Center

CY –FOR_V2

ES-FOR

IT-FOR

PCA score plots (PC1 vs. PC2) related to the different FOR samples coming from Italy, Spain and Cyprus acquired in the NIR (1000-1650 nm) wavelength field.

Actions C.1&C.2 – Results on raw materials from the different countries (Action B.1)

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Page 12: THE HYPERSPECTRAL IMAGING APPROACH

Italian samples at different curing times

Average reflectance spectra of the different Italian samples acquired in the NIR (1000-1650 nm) wavelength field

Actions C.1&C.2 – Results from lab-scale plantsin the different countries (Action B.2)

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Page 13: THE HYPERSPECTRAL IMAGING APPROACH

Italian samples at different curing times

PCA score plots (PC1 vs. PC2) related to the different Italian samples (IT-UFVB-5050-T0; IT-UFVB-5050-T20; IT-UFVB-5050-T40 and IT-UFVB-5050-T60) acquired in the NIR (1000-1650 nm) wavelength

field

Actions C.1&C.2 – Results from lab-scale plantsin the different countries (Action B.2)

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Page 14: THE HYPERSPECTRAL IMAGING APPROACH

t = 0 days

t = 20 days

t = 40 days

t = 60 days

Process Monitoring by HSIPLS for different curing times (Italian samples)

Actions C.1&C.2 – Results from lab-scale plantsin the different countries (Action B.2)

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Page 15: THE HYPERSPECTRAL IMAGING APPROACH

Product Monitoring by HSIPrediction of chemical parameters (Italian samples)

Actions C.1&C.2 – Results from lab-scale plantsin the different countries (Action B.2)

Humidity (%) Phosphatase (µmol INTF g-1 h-1)

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Page 16: THE HYPERSPECTRAL IMAGING APPROACH

Product Monitoring by HSIPrediction of chemical parameters (Italian samples)

Actions C.1&C.2 – Results from lab-scale plantsin the different countries (Action B.2)

Soluble Organic Nitrogen (ppm) Soluble Organic Carbon (%)

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Page 17: THE HYPERSPECTRAL IMAGING APPROACH

Product Monitoring by HSIPCA (Spanish samples)

Actions C.1&C.2 – Results from pilot-scale plantsin the different countries (Action B.3)

Sample

Background

Source SampleES-UFVB-6040 T90

Sample Hypercube PCA: background removal

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Page 18: THE HYPERSPECTRAL IMAGING APPROACH

Process Monitoring by HSIRaw and preprocessed spectra at t = 0 and t = 90 days (Spanish samples)

Actions C.1&C.2 – Results from pilot-scale plantsin the different countries (Action B.3)

Preprocessing applied: Smoothing (window 11)+ Second derivative (window 15)+ Mean center

Average raw spectra

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Page 19: THE HYPERSPECTRAL IMAGING APPROACH

Process Monitoring by HSIPCA and Loadings (Spanish samples)

Actions C.1&C.2 – Results from pilot-scale plantsin the different countries (Action B.3)

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Page 20: THE HYPERSPECTRAL IMAGING APPROACH

Actions C.1&C.2 – Results from pilot-scale plantsin the different countries (Action B.3)

Product Monitoring by HSIPrediction of chemical parameters: Soluble Organic Nitrogen (%)

Italian samples Spanish samples

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Page 21: THE HYPERSPECTRAL IMAGING APPROACH

Actions C.1&C.2 – Results from pilot-scale plantsin the different countries (Action B.3)

Product Monitoring by HSIPrediction of chemical parameters: Soluble Organic Carbon (%)

Italian samples Spanish samples

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Page 22: THE HYPERSPECTRAL IMAGING APPROACH

Actions C.1&C.2 – Results from pilot-scale plantsin the different countries (Action B.3)

Product Monitoring by HSIPrediction of chemical parameters: EC (mS/cm)

Italian samples Spanish samples

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Page 23: THE HYPERSPECTRAL IMAGING APPROACH

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

IT-BA-L1-T1-i IT-BA-L1-T2-i IT-BA-L1-T6-i IT-BA-L1-T1-f IT-BA-L1-T2-f IT-BA-L1-T6-f

Actions C.3 – Results from agriculture application in Italy (Action B.4)

Product Monitoring by HSIPCA (Italian samples)

- Barley

Page 24: THE HYPERSPECTRAL IMAGING APPROACH

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Actions C.3 – Results from agriculture application in Italy (Action B.4)

Process Monitoring by HSIRaw and preprocessed spectra

Preprocessing applied: Smoothing (window 15)+ First derivative (window 15)+ Mean center

Average raw spectra

Page 25: THE HYPERSPECTRAL IMAGING APPROACH

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Actions C.3 – Results from agriculture application in Italy (Action B.4)

PCA score plots (PC1 vs. PC2) related to Barley samples acquired in the NIR (1000-1650 nm) wavelength field.

Page 26: THE HYPERSPECTRAL IMAGING APPROACH

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Actions C.4 – Results from agriculture application in Spain (Action B.5)

ES-PO-L1-T1-i ES-PO-L1-T2-i ES-PO-L1-T6-i ES-PO-L1-T1-f ES-PO-L1-T2-f ES-PO-L1-T6-f

b)

a)

Product Monitoring by HSIPCA (Spanish samples)

- Potato

Page 27: THE HYPERSPECTRAL IMAGING APPROACH

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Actions C.4 – Results from agriculture application in Spain (Action B.5)

Process Monitoring by HSIRaw and preprocessed spectra

Preprocessing applied: Smoothing (window 15)+ Second derivative (window 15)+ Mean center

Average raw spectra

Page 28: THE HYPERSPECTRAL IMAGING APPROACH

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Actions C.4 – Results from agriculture application in Spain (Action B.5)

PCA score plots (PC1 vs. PC2) related to Potato samples acquired in the NIR (1000-1650 nm) wavelength field.

Page 29: THE HYPERSPECTRAL IMAGING APPROACH

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Actions C.5 – Results from agriculture application in Cyprus (Action B.6)

CY-ME-L1-T1-i CY-ME-L1-T2-i CY-ME-L1-T6-i CY-ME-L1-T1-f CY-ME-L1-T2-f CY-ME-L1-T6-f

a)

b)

- Melon

Product Monitoring by HSIPCA (Cypriot samples)

Page 30: THE HYPERSPECTRAL IMAGING APPROACH

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Actions C.5 – Results from agriculture application in Cyprus (Action B.6)

Preprocessing applied: Smoothing (window 11)+ Second derivative (window 19)+ Mean center

Average raw spectra

Process Monitoring by HSIRaw and preprocessed spectra

Page 31: THE HYPERSPECTRAL IMAGING APPROACH

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Actions C.5 – Results from agriculture application in Cyprus (Action B.6)

PCA score plots (PC1 vs. PC2) related to Potato samples acquired in the NIR (1000-1650 nm) wavelength field.

Page 32: THE HYPERSPECTRAL IMAGING APPROACH

Conclusions

Actions B.1&C.1-C.2The HSI approach allowed to outline the difference existing among the investigated raw material samples both in terms of composition (i.e. UOW, FOR and BC) and origin (i.e.: Italy, Spain and Cyprus), with the only exception of Italian and Spanish BC.

Actions B.2&C.1-C.2Good correlation between spectral behavior in the NIR wavelength range of the different collected samples from the lab-scale plants in the different countries and curing time and the main measured chemical parameters (humidity, soluble carbon, soluble nitrogen, and phosphatase) were obtained.

Actions B.3&C.1-C.2Good correlation between spectral behavior in the NIR wavelength range of the different collected samples from the pilot-scale plants in the different countries and the main measured chemical parameters (soluble carbon, soluble nitrogen and electrical conductivity) were obtained.

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Page 33: THE HYPERSPECTRAL IMAGING APPROACH

Conclusions

RESAFE ProjectWorkshopFaenza (Italy)December 14, 2015

Actions B.4&C.3The HSI approach allowed to outline the difference crops existing from different thesis in the agriculture application in Italy. Actions B.5&C.4The HSI approach allowed to outline the difference crops existing from different thesis in the agriculture application in Spain.

Actions B.6&C.5The HSI approach allowed to outline the difference crops existing from different thesis in the agriculture application in Cyprus.