MATHEMATICAL MORPHOLOGY in THE PICS PROJECT ...beucher/publi/PICS_CMM...Page 3 PICS (A406) MEDEA+...

11
Page 1 PICS (A406) MEDEA+ MATHEMATICAL MORPHOLOGY in THE PICS PROJECT Programmable Imaging with a CMOS Sensor (July 1 st 2003 - November 30 th 2006)

Transcript of MATHEMATICAL MORPHOLOGY in THE PICS PROJECT ...beucher/publi/PICS_CMM...Page 3 PICS (A406) MEDEA+...

Page 1: MATHEMATICAL MORPHOLOGY in THE PICS PROJECT ...beucher/publi/PICS_CMM...Page 3 PICS (A406) MEDEA+ Project consortium 1. Imager design and evaluation (Philips NL), DALSA, Grass Valley,

Page 1

PICS (A406) MEDEA+

MATHEMATICAL MORPHOLOGYin

THE PICS PROJECTProgrammable Imaging with a CMOS Sensor

(July 1st 2003 - November 30th 2006)

Page 2: MATHEMATICAL MORPHOLOGY in THE PICS PROJECT ...beucher/publi/PICS_CMM...Page 3 PICS (A406) MEDEA+ Project consortium 1. Imager design and evaluation (Philips NL), DALSA, Grass Valley,

Page 2

PICS (A406) MEDEA+

• Today’s smartcams market:• Very few available products on Smart Cameras ( PowerPC based Matrix

Vision, Intel Celeron based Matrox Iris P series, Geode based Sony, …)• Limited image/video processing capabilities• Mostly CCD (thus no ROIs control)• None Reconfigurable Smart camera at runtime & HW acceleration as in

PICS

• Forecast market sizes:• Security market: average growth 5% per year• Video surveillance: average growth 10% per year• Biometrics: average growth 30% per year• Automotive market: average growth 120% per year.

Page 3: MATHEMATICAL MORPHOLOGY in THE PICS PROJECT ...beucher/publi/PICS_CMM...Page 3 PICS (A406) MEDEA+ Project consortium 1. Imager design and evaluation (Philips NL), DALSA, Grass Valley,

Page 3

PICS (A406) MEDEA+

Project consortium

1. Imager design and evaluation(Philips NL), DALSA, Grass Valley, e2v, TIMA

2. Algorithm design and evaluationCMM, Thales, Faurecia, CEA, BEV

3. Platform designThales, Faurecia, e2v, CMM, CEA, Philips

Industrial partners:Grass Valley/Thomson (NL, leader), Philips (NL), DALSA (NL), e2v (F), ATMEL (F), NXP/Philips (F), THALES/TSS/TED/COM (F), Faurecia(F), BEV (F)Academic partners:CMM/ARMINES (F), TIMA (F), CEA/LIST (F)

Project cooperation

Page 4: MATHEMATICAL MORPHOLOGY in THE PICS PROJECT ...beucher/publi/PICS_CMM...Page 3 PICS (A406) MEDEA+ Project consortium 1. Imager design and evaluation (Philips NL), DALSA, Grass Valley,

Page 4

PICS (A406) MEDEA+

What is Mathematical Morphology?A methodology for image analysis based on Set TheoryA set of tools usable in many image analysis application domainsImage analysis software libraries and toolboxes

Neighbourhood operators

Geodesic operators

Iterative operators

fg

Φ ∩

Φ Φ Φ Φ

Page 5: MATHEMATICAL MORPHOLOGY in THE PICS PROJECT ...beucher/publi/PICS_CMM...Page 3 PICS (A406) MEDEA+ Project consortium 1. Imager design and evaluation (Philips NL), DALSA, Grass Valley,

Page 5

PICS (A406) MEDEA+

Image analysis applications for an intelligent sensor

• License plates detection and reading(car parks access control, automaticspeedometers)

• Driver and passengers Out Of Position (OOP) monitoring(prevention of accidents dues to airbags release)

Two applications were focused in the scope of the PICS project:

Page 6: MATHEMATICAL MORPHOLOGY in THE PICS PROJECT ...beucher/publi/PICS_CMM...Page 3 PICS (A406) MEDEA+ Project consortium 1. Imager design and evaluation (Philips NL), DALSA, Grass Valley,

Page 6

PICS (A406) MEDEA+

License plate detection and reading

Original enhanced image (histogram equalisation)

Morphological « Top-Hat » operators

Morphological filtering based on size and shape and ROI detection

Page 7: MATHEMATICAL MORPHOLOGY in THE PICS PROJECT ...beucher/publi/PICS_CMM...Page 3 PICS (A406) MEDEA+ Project consortium 1. Imager design and evaluation (Philips NL), DALSA, Grass Valley,

Page 7

PICS (A406) MEDEA+

OOP application implementation

• Definition of an initial ROI

• Implementation of thickmorphological gradients and filterings

• Use of the previous detection to define a dynamic ROI

Reduce false detection

Page 8: MATHEMATICAL MORPHOLOGY in THE PICS PROJECT ...beucher/publi/PICS_CMM...Page 3 PICS (A406) MEDEA+ Project consortium 1. Imager design and evaluation (Philips NL), DALSA, Grass Valley,

Page 8

PICS (A406) MEDEA+

OOP monitoring, an example

Page 9: MATHEMATICAL MORPHOLOGY in THE PICS PROJECT ...beucher/publi/PICS_CMM...Page 3 PICS (A406) MEDEA+ Project consortium 1. Imager design and evaluation (Philips NL), DALSA, Grass Valley,

Page 9

PICS (A406) MEDEA+

Image Processor Module structure

REGISTER BANKCONFIG AND STATUS

MU

ReconfigurableKernel

Size, Topology,Type

ALU

ReconfigurableKernel

Size, Topology,Type

Image in1

Image in2

Config & Status

Image out

Page 10: MATHEMATICAL MORPHOLOGY in THE PICS PROJECT ...beucher/publi/PICS_CMM...Page 3 PICS (A406) MEDEA+ Project consortium 1. Imager design and evaluation (Philips NL), DALSA, Grass Valley,

Page 10

PICS (A406) MEDEA+

Microblaze

BRAM

DDR

Videoin/out

MorphoProcessor

1

MorphoProcessor

N

OP

B B

US

AIM V2.0

Xilinx microblaze integration with a 10 stage pipeline (which represents20 Morphological processors)

PICS morphological processor implementation

Page 11: MATHEMATICAL MORPHOLOGY in THE PICS PROJECT ...beucher/publi/PICS_CMM...Page 3 PICS (A406) MEDEA+ Project consortium 1. Imager design and evaluation (Philips NL), DALSA, Grass Valley,

Pag. 11

PICS (A406) MEDEA+

PICS Award

The PICS project received the JEAN-PIERRE NOBLANC AWARD FOR EXCELLENCE in 2006 from the MEDEA+ ComitteeIt was the second award received by CMM (first one for the POCKET MULTIMEDIA project in 2005)