UMR 5505 CNRS-INP-UPS-UT1

Pr Jean-Pierre JESSELjessel@irit.frhttp://www.irit.fr/

November 2007

VORTEX

IRIT

• Created in January 1990 from 3 laboratories• More than 220 faculty staff and researchers, 60 engineers,

30 administrative • About 120 PhDs students (>30 PhDs each year)• Teaching Computer Sciences: UPS, INP, UT1, UTM

– Master and Doctoral School " Computer Sciences & Telecom"

• Active presence in IT scientific communities• Important industrial partnership

• 7 Departments• Federative Projects• Technologic plates-forms

November 2007

VORTEX

Research topics developed at IRIT

•Information analysis and synthesis

–Image processing / analysis–Image synthesis and Virtual Reality–Video–Speech processing–Signal Processing & Telecom

•Data indexing, retrieval and storage

–Data retrieval / storage in large / distributed DB

• Dynamic optimisation for parallel retrieval

–Multimedia indexation

•Interaction, autonomy, dialogue, collaboration

–Themes organisation in a dialogue–non-verbal/textual communication–Degraded dialogue and communication–Collaborative working cooperation modelling –Auto-adaptive systems and empiric control

November 2007

VORTEX

Research topics developed at IRIT

•Reasoning and decision–common sense reasoning –Space and time modelling–Decision –Explanation, dialogue and evolution

•High performance computing–Numerical linear algebra–Grid computing–Optimisation and control–Asynchronous parallel algorithms

•Architecture, systems and networks

–Architecture –Real time systems –Networks–Embedded systems

•Safe software development–Type theory and proof assistance–Parallel and distributed systems engineering –Software component development

November 2007

VORTEX

Research topics developed at IRIT

• Federated projects

• Technological platforms – PRETI: research and experimentation in information processing

– RFIEC: information search and knowledge extraction

– TLSE: grid computing

– PREVI: virtual reality and interaction

– HCI Usage Lab

• Joint Labs– AUTODIAG (ACTIA-IRIT-LAAS)

– MIDI (EADS CRC-IRIT)

– AIRSYS (AIRBUS-IRIT-LAAS-ONERA)

November 2007

VORTEX

VORTEX : Visual Object : from Reality To EXpression

• VORTEX– The topic : Visual Objects

• Real, virtual, mixed; 2D / 3D• Concepts, models and tools

– Creation, capture, management, modification, enhancement / augmentation, display, interaction, share / distribution

– Fundamentals topics:• Image Synthesis, Virtual Reality, Computer Vision, Multimedia,

Augmented Reality

– 3 Pr, 13 Lecturers, 3 Engineers, 26 PhD students, Masters, fellows

• Intervention in 3 specialised Masters (UPS, INP)

– Head: Jean-Pierre Jessel

November 2007

VORTEX

3 research axes

Sensors, vision, …Meshes, Points, …RT rendering, Realistic rendering, …

Procedural modellingConstraints, optimisation

Character animationMotion capture / editionCollaborative distributed simulation

Large screen visualisation Sketch based modellingRegistration for ARMultimedia Compositing

Artificial Life Behavioural Simulation

Acquisition, creation and visualisation

Interactive networked virtual and augmented environments

Medical Imagery and Derivate applications

Collaborative virtual prototyping

Reproduction, co-evolution, auto-organisation, adaptationMemory, learning, …Simulation, animation

Virtual / Augmented Reality3D Interaction, Distributed multimedia

November 2007

VORTEX

Acquisition, creation and visualisation

• Modelling– Geometry: meshes, points

• Subdivision: points, meshes

– Sketch based modelling– Declarative: properties, constraints

• Rendering / visualisation– Realistic rendering

• Physics Simulations

– RT rendering• Software / Hardware• Parallelism

– Clustering– GPU

• Medical Imaging

November 2007

VORTEX

Acquisition, creation and visualisation

• Visual Objects of Interest – Perceiving visual objects (and phenomena) of interest

• Omni directional sensors (static scenes)

– Automatic detection • Multiples images (tracking / registration)

– Using Visual Objects of Interest• 3D reconstruction, registration• From visual objects to multimedia contents • From objects to flux• Composing VOI and using them (remotely)

November 2007

VORTEX

Artificial Life and Behavioural Simulation

• Behavioural Simulation– Character animation

• Motion capture / edition• From Behaviour to motion• Virtual storyboarding / storytelling

– Evolution, emergence, auto organisation, memory, anticipation, collaboration

• Artificial Life– Morphogenesis

– Multi criteria Optimisation• Simulation for economy

and development

November 2007

VORTEX

Interactive networked virtual and augmented environments

• Starting in 1992• First step

– Immersion

– 3D Interaction

– DVR, collaborative VE• Sharing DMU

November 2007

VORTEX

Interactive networked virtual and augmented environments

• Virtual Reality– Distributed Simulation

• Filtering • Interoperability

– Coupling heterogeneous simulations (HLA, CORBA, …)

– 3D Interaction• Posture, Tangible interface, AR

November 2007

VORTEX

Interactive networked virtual and augmented environments

• Augmented Reality– Rigid tracking with occlusion

• Application to background tracking• Visual contends composed

by real or virtual objects

– Non rigid tracking • RT tracking of 2D meshes

– Fusion / registration

November 2007

VORTEX

Interactive networked virtual and augmented environments

• Multimedia (distributed)– Contents (interactive) composed by objects

– From objects to flux: distributed streaming

– Heterogeneous run time environments (networks/terminals)

– Multimedia content adaptation

– Interactive video: pedagogic contents for computer architecture

– JTMed: telemedicine plate-form (contract CNES)

November 2007

VORTEX

PREVI : a plate-form for VR and interaction

• Visualisation devices– Large display

• Stereo retro projection • Video projectors cluster (tiled display) / PC cluster

– Auto stereo 42" screen

– Stereoscopic goggles (active/passive)

– Semi-immersive dome Elumens VS3

– VR helmet Virtual Research

November 2007

VORTEX

PREVI : a plate-form for VR and interaction

• Interaction devices– Data glove: Cyber Glove, 5DT

– Motion capture• Ascension Motion Star (wireless), Polhemus• Face tracker, Eye tracker*

– Force feed-back: PHANToM Premium 1.5A, Omni*

– Video tracking

November 2007

VORTEX

Collaborations

• National– Computer Graphics French Association (Board)– EuroGraphics France (Board)– GDR Computer Graphics (Head)– RTP Synthèse d’Images et Réalité Virtuelle

• Board, leader of research actions (rendering, animation, …)

– EVASION, ACROE, LASMEA, CEREGE

•International– STIC Asie "Réalité Virtuelle"– Aachen (D), Calgary (Can), Cambridge (GB), Stanford (USA)– Algeria, Mexico, Vietnam, Madagascar, Lebanon

• Local– IRIT– ENSMAC, GREMAQ, IM, LARA, LE, LEREPS, ONERA, TTI, UTAH, LARA, LA– MIDI, TéSa, FERIA

• Companies (including PhD): – AIRBUS, CNES, C-S, EADS CRC, GéoSignal, Groupe Cecile (Magéllium, Pole Star, Sodit), KYNOGON, OKTAL (SA, SE), RENAULT …–FittingBox and Onésia: start-ups hosted from June 2005 and January 2006

November 2007

VORTEX

Projects

• Past – DIVERCITY, IMAGE, LUMIERE

• After CAVALCADE, CASH• Virtual prototyping (collaborative), concurrent engineering • Heterogeneous simulations interoperability

– Lighting simulation for A380 commercial cabin

– Lumière - RNTL (2004-2006), initiator

– DYNASPAT• spatial simulation for economy (2005-07), leader

– SIGMA• JTMed

– SIAMA, FOVEA

November 2007

VORTEX

Projects

• Running – National projects

• C6E2 - RNTL (2006-2008)

• NatSim - ARA MDMSA (2005-2008), leader

– Regional MP projects• SITRA+Piéton (2006-08), leader

• SPATIALYSE (2006-08 , suite DYNASPAT)

• FILONAS (Firemen Intervention LOcation and NAvigation System)– System dedicated to emergency services.

– Start-ups• FittingBox and Onésia hosted from June 2005 and January 2006

– PREVI (VR and interaction Plate-form)• Projects support

• Open to other laboratories and companies

– MIDI (Joint Laboratory EADS-CRC – IRIT)• Collective visualisation

• Augmented Reality for mobile operator