EUROFIT project: 3D data harmonisation - Institute of Biomechanics of Valencia

16
EUROFIT project: Results on 3D data harmonisation Alfredo Ballester (IBV) FP7-ICT-2011-SME-DCL SME initiative on Digital Content and Languages G.A. No.: 296116

description

Results delivered by IBV within WP2 of Eurofit project Funded by the European Commission FP7-ICT-2011-SME-DCL Project: 296116 Area: SME Initiative on Digital Content and Languages - Bootstrapping a data econo

Transcript of EUROFIT project: 3D data harmonisation - Institute of Biomechanics of Valencia

Page 1: EUROFIT project: 3D data harmonisation - Institute of  Biomechanics of Valencia

EUROFIT project:Results on 3D data harmonisation

Alfredo Ballester (IBV)

FP7-ICT-2011-SME-DCL SME initiative on Digital Content and Languages

G.A. No.: 296116

Page 2: EUROFIT project: 3D data harmonisation - Institute of  Biomechanics of Valencia

PROJECT OVERVIEW

PROJECT RESULTS 3D harmonisation 1D to 3D enhancement Posture harmonisation

Page 3: EUROFIT project: 3D data harmonisation - Institute of  Biomechanics of Valencia

EUROFIT project: 3D scan harmonisation

EUROFIT OVERVIEW

EUROFIT is an joint initiative co-fundedby the European Commission aimed at:

Fostering the global trade of Digital Anthropometric Data

Opening the use of 3D anthropometry to product design

Supporting SMEs to enter international markets

“EUROFIT vision is to unleash the huge potential contained in the increasing number of databases of 3D body scans for the

European consumer goods’ industries”

What is EUROFIT?

Page 4: EUROFIT project: 3D data harmonisation - Institute of  Biomechanics of Valencia

EUROFIT project: 3D scan harmonisation

Spain (HS)11.000 subjects

Germany (HS)12.000 subjects

Greece (Telmat)7.000 subjects

Poland (HS)(ongoing)

US, CA, NL, IT (Cw/HS)Caesar - 4.800 subj.

USA (TC2)11.000 subjects

Brazil (TC2)(in preparation)

S. Korea (Cw) 10.000 subjects

China (HS/oth.)(ongoing)

France (HS)11.000 subjects

Sweden (HS)4.000 subjects

UK (TC2)11.000 subjects

Mexico (TC2)16.000 subjects

Romania (HS)(ongoing)

Thailand (TC2)13.000 subjects

Japan20.000 subjects

Malaysia (TC2)12.000 subjects

Taiwan10.000 subjects

3D raw scan databases>> 500.000 points per subject

1D measure databases< 100 manual measures

per subject

Ready for 1D data analysis and exploitation

> 20 countries>> 150.000 individual sets

~16 countries~ 120.000 individual sets

EXTRACTION

SHAPE LOST!

1D measures

• Huge Digital Anthropometric Data available now – both 1D and 3D

• Much more data will be generated in the following years

3D data exists but3D exploitation is

NOT AVAILABLE to industry

• Few tools for industrial application of 1D data to consumer goods’ industries

EUROFIT OVERVIEWWhy EUROFIT?

Page 5: EUROFIT project: 3D data harmonisation - Institute of  Biomechanics of Valencia

EUROFIT project: 3D scan harmonisation

# Harmonisation of 3D scan data that enables cross-data analyses

# 3D enhancing of existing 1D databases

# Making 3D data available, usable and affordable to industry

# Attracting third party contributors (beyond project)

EUROFITpool

Offline

3D sources

1D sources

Online interactiveEUROFIT portal

3D Shape Analysis & developer

tools

Sector-specific use

services

Data Owners IT SME developers and maintainers Industry end-users

EUROFIT OVERVIEWMain S&T challenges

Page 6: EUROFIT project: 3D data harmonisation - Institute of  Biomechanics of Valencia

EUROFIT project: 3D scan harmonisation

EUROFIT OVERVIEWData enhancement concept

Shape information

lost

Page 7: EUROFIT project: 3D data harmonisation - Institute of  Biomechanics of Valencia

EUROFIT project: 3D scan harmonisation

EUROFIT OVERVIEWConcept overview

Page 8: EUROFIT project: 3D data harmonisation - Institute of  Biomechanics of Valencia

EUROFIT project: 3D scan harmonisation

Homology

Point-to-point correspondence that

• enables interpolation of shapes

• enables statistical analyses

• enables fast body part selections

PROJECT RESULTS – 3D harmonisationBasis of the approach followed

Homologous mesh structure – Homodel

• Single mesh of 50K vertices and 99K faces

• Key anatomical landmarks associated to vertices

• Unisex semantic structure enabling body part focus

• Skeleton enabling posture corrections

Page 9: EUROFIT project: 3D data harmonisation - Institute of  Biomechanics of Valencia

EUROFIT project: 3D scan harmonisation

PROJECT RESULTS – 3D harmonisationProcess overview

Raw Scan Pre-processed Mesh

SCANPRE-PROCESSING

HOMODELCREATION

Homodel

• Hole filling• Single surface reconstruction• Removal of noise

• Same homologous mesh structure• Anatomical correspondence• Slit area correction

Page 10: EUROFIT project: 3D data harmonisation - Institute of  Biomechanics of Valencia

EUROFIT project: 3D scan harmonisation

PROJECT RESULTS – 3D harmonisationPre-processing of raw scans

• Holes in surface• Multiple layers• Noise in surface• Physical markers• ...

Hole-filling

Poison’s reconstruction plus surface fairing

Physical marker removal

Crop of markers followed by Poison’s reconstruction plus surface fairing

Identification of artificially completed area, especially those with low reliability (slit areas), to be used in automated post-processing

Single SurfaceReconstruction

Page 11: EUROFIT project: 3D data harmonisation - Institute of  Biomechanics of Valencia

EUROFIT project: 3D scan harmonisation

Fitting of a template mesh equipped with a skeleton to a 3D scan using a set of anatomical references.

Made in three automated steps:

• Template posing and scaling• Template fitting to scan surface• Post processing of slit areas

TEMPLATE-BASED HOMODEL CREATION

PROJECT RESULTS – 3D harmonisationHomodel creation from 3D scans

Video

Raw scantarget Template

Posed & Scaled

TemplateFitted

Homodel

Automated post processing of slit areas using:

• Template structure information

• Surface fairing in selected areas

Surface distance error per vertice <0.5mm in most of the surface Only >1mm in less than 5% of the surface

0 mm0.25 mm0.50 mm> 1 mmNo original surface

Page 12: EUROFIT project: 3D data harmonisation - Institute of  Biomechanics of Valencia

EUROFIT project: 3D scan harmonisation

TESTED FOR DIFFERENT 3D SCAN SOURCES, POSTURES, AND SURVEYS

PROJECT RESULTS – 3D harmonisationHomodel creation from 3D scans

Size SpainHuman Solutions

Laser

Size GermanyHuman Solutions

Laser

CAESAR USCyberware

Laser

Size PortugalTC2

Structured light

Page 13: EUROFIT project: 3D data harmonisation - Institute of  Biomechanics of Valencia

EUROFIT project: 3D scan harmonisation

PROJECT RESULTS – 1D to 3DHomodel creation from 1D measurement data

Homologous3D data

Representative3D+1D Database

(500-900 homodels + measurements)

1D data

Shape synthesis through 30-200

Principal Components

Regression model relating 3D shape

components to measurements

Step 0:Input of a list of measurements from any source (tape, caliper or digital)

Step 1:Approx. shape obtained from the model

Step 2:Iterative measurement & optimisation until all measurements are matched

Page 14: EUROFIT project: 3D data harmonisation - Institute of  Biomechanics of Valencia

EUROFIT project: 3D scan harmonisation

Video

PROJECT RESULTS – 1D to 3DHomodel creation from 1D measurement data

Up to 3cmerror

Nearly zero error

Page 15: EUROFIT project: 3D data harmonisation - Institute of  Biomechanics of Valencia

EUROFIT project: 3D scan harmonisation

PROJECT RESULTS – Shape AnalysisPosture correction and PCA

Automated fitting of a skeleton to Homodels

Automated posture alignment using inverse kinematics

Body height

Body mass

Limbs’ lenght

Effects in PCA results with full bodies

Reuduction of the main noise due to posture

Page 16: EUROFIT project: 3D data harmonisation - Institute of  Biomechanics of Valencia

EUROFIT project: 3D scan harmonisation

Thanks!

Alfredo Ballester Fernández

[email protected]

www.eurofit-project.eu