ETISEO Project

INRETS, Villeneuve d’Ascq, December 15th-16th 2005

ETISEO ProjectETISEO Project

Video corpus Video corpus

dedicated to dedicated to

the first evaluationthe first evaluation



To capture realistic video sequences with graduate difficulties:

•lighting variations, •occlusions …

covering predefined scenarios.



Video Providers Video Providers

Corpus Data descriptionCorpus Data description

Video contents demonstrationVideo contents demonstration


Video providersVideo providers

Different sites :

- corridor,

- sub-way,

- building entry,

- apron,

- car park.

Several data providers offering large diversity.

Different contexts :

- indoor / outdoor

- single / multi-camera

- big / small overlap area

- visible / IR

- actors / real scenes


Video providers : Video providers : SilogicSilogic

Apron Apron

Toulouse-Blagnac Toulouse-Blagnac AirportAirport

FranceFrance

Video

Sensors


Video providers : Video providers : SilogicSilogic

Apron Apron

Multi-viewMulti-view


Video providers : Video providers : INRETSINRETS

Building EntryBuilding Entry

Car ParkCar Park

Multi-viewMulti-view


Video providers : CEAVideo providers : CEA

Car streetCar street

CorridorCorridor


Video providers : CEAVideo providers : CEA

Geometry : IR/Colour calibration Estimation of an homographic matrix between the 2 images (sensors close and

aligned)


Video providers : RATPVideo providers : RATP

SubwaySubway

Real sceneReal scene


Corpus dataCorpus data

Video ProvidersVideo Providers


Video contents demonstrationVideo contents demonstration


Priority SequencesPriority Sequences

Evaluation risk:

That participants process only part of the dataset.

Resulting in dispersed metrics.

No real evaluation or comparison being possible


Priority SequencesPriority Sequences

Solution:

Create some mandatory sequences.

Participants should process at least these sequences.

Need some feedback to select these priority sequences. See the questionnaire.



Provider Site Sequence # Persons Vehicle Multiview

Silogic Apron 1 to 6

RATP Station 7 to 10

CEA Corridor 11 to 13 IR / visible

CEA Road 14 to 17 IR / visible

INRETS Building entry 18 to 20

For each topic, the set contains sequences with graduate difficulty.



Covered scenarios :

• vehicle parking• people getting in & out from a vehicle• people walking• people crossing• person entering a building• person entering a room• person meeting• abandoned baggage



Summary :

• indoor / outdoor sequences,• 8 scenarios,• graduate difficulty,• 20 sequences,• 37 video clips,• 5.2 Go of data.


Corpus diffusionCorpus diffusion

Video format :

- sequence of jpeg/bmp images for colour images- sequence of TIFF and jpeg images for IR.

Timestamp :

Image name contains the timestamp relative to the start of the sequence.

Calibration :

Provide as - a calibration matrix used to generate 3D - couples of 2D / 3D points.



Structure:

Camera folders

ETI-VS2-RD-32

ETI-VS2-RD-32-C1

C1-Format.xml

ETI-VS2-RD-32-C1-00h00m36s000-0000.jpeg

ETI-VS2-RD-32-C1-….jpeg


Contains the sequence

ETI-VS2-RD-32-C2

C2-Format.xml


ETI-VS2-RD-32-C2-….jpeg




Structure:

Each video resource will be store in a unique folder using the following convention:

ETI-VSindexdataset-Type-sequenceindex

Example:

ETI-VS2-RD-32

Type of Video Acronym used

Parking PK

Road RD

Apron AP

Metro MO

Building entrance BE

Building corridor BC



C1-format.xml :

<?xml version="1.0" encoding="UTF-8"?>

<sequence name=”ETI-VS1-BC-32”>

<properties>

<format>JPEG</format> could be JPEG,TIFF…

<width>720</width>

<height>576</height>

<depth>24</depth>

<frames>1560</frames> # of frames (start=0)

<inter-frame-ms>80000</inter-frame-ms> average time in ms between frames

<maxsize>65232</maxsize> maximum image size

<camera>C1</camera> camera id

<sensor>color</sensor> color, IR, greyscale

</properties>

</sequence>



Video ProvidersVideo Providers


Video content demonstrationVideo content demonstration


Video demonstrationVideo demonstration

Silogic / Apron:

Type : multi-view, played and real scenes.

Precision evaluation : scenes with real 3D ground truth.• person walking on the zone. C1, C2, C3, C4• vehicle moving on the zone. C1, C2, C3, C4

Real scenes : vehicles moving on the apron with large variation of conditions (outside environment).• GPU arrival « normal conditions ». C1 , C2• GPU arrival « reflections ». C1 , C2• GPU arrival « shadows » C1 , C2



INRETS / parking & building entry.

Type : multi-view, played scenes.

Scenes : vehicles parking, people entering/leaving cars, entering/leaving the building. Large variation of conditions (outside environment).

• ETI-VS1-BE-18: C1,C2,C3,C4 • ETI-VS1-BE-19: C4• ETI-VS1-BE-20: C1,C2,C3,C4



INRETS / parking & building entry.

Type : multi-view, played scenes.

Scenes : Sequence ETI-VS1-BE-20 will be provided with different compression levels:

• BMP, JPEG and MPEG.



CEA / parking & building entry.

Type : single-view but visible/IR couple. Played scenes.

Road : vehicles and people.• ETI-VS1-RD-14: C1 , C2• ETI-VS1-RD-15: C1 , C2• ETI-VS1-RD-16: C1 , C2• ETI-VS1-RD-17: C1 , C2

Corridor : People crossing, abandoned luggage.• ETI-VS1-BC-11 C1, C2• ETI-VS1-BC-12 C1, C2• ETI-VS1-BC-13 C1, C2



RATP / subway.

Type : single-view. Played scenes mixed with real environment.

Corridor : People crossing, abandoned luggage.• ETI-VS1-MO-07• ETI-VS1-MO-08• ETI-VS1-MO-09

Railway platform : People crossing, abandoned luggage.• ETI-VS1-MO-10

ETISEO Project

Documents

Transcript of ETISEO Project