3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke...

35
Bundeswehr Geoinformation Office PUBLIC RELEASE Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April 2, 2009 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck

Transcript of 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke...

Page 1: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Bundeswehr Geoinformation Office

PUBLIC RELEASE

Civil Commercial Imagery Evaluation Workshop

Fairfax Oaks, VA

April 2, 2009

3D Worlds for the Bundeswehr

Jochen Dahlke Berthold Winck

Page 2: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

2PUBLIC RELEASE

Introduction

Process Chain

Sensor System and Algorithm

Example of a Prototype

topic

3D Worlds for the Bundeswehr

Page 3: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

3PUBLIC RELEASE

In accordance with the situation,the Bundeswehr Geoinformation Service is to incorporate the impact of relevant geospatial and environmental factors on the planning and conduct of operations into the decision-making process and to guarantee the supply of the German Armed Forces with Geoinformation.

Mission BGIS

Page 4: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

4PUBLIC RELEASE

data source internet?

Yes, something similar but not for military use

and often in regions outside of our interest.

Aren’t there solutions in the world wide web as Google, world wind or MS virtual world?

Page 5: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

5PUBLIC RELEASE

Example: Abbey of the Archangel, Prizren, KOS

Area of monks before 2002 …

remarkable

… and after the riot in March 2004

Page 6: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

6PUBLIC RELEASE

The browseable imagery of

the monastery on the

world wide web as of summer 2008.

remarkable

Page 7: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

7PUBLIC RELEASE

something new?

Is the request for a 3D-product something new?

Not really, the customers ask for a 3D-productsince hundreds of years!

Page 8: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

8PUBLIC RELEASE

Generate a high resolution 3D model of a defined (urban) area!

order

Page 9: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

9PUBLIC RELEASE

3D Worlds

Page 10: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

10PUBLIC RELEASE

Page 11: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

11PUBLIC RELEASE

Image Acquisition

frame camera

ContractorInstitute of Robotics und Mechatronics

Oberpfaffenhofen

Contractors:Berliner SpezialflugSpace Imaging Middle East, AMS

Project LeadDLR Dir. Sensorconcepts undApplications, Berlin-Adlershof

Aero-trian-

gulation&

Radio-metric

correction

Software-DevelopmentUniversity of Bonn,Steinbeiszentrum

3D-Reality-Maps

movie

visualization3D Worlds

without facades: „Christo-Effect“

facades from oblique imagery

ContractorRSS-GmbH, Potsdam

facades from terrestrial images

3D – Reconstruction (SGM)

autors: Dahlke, Winck

Bronce

Silver

Gold

DSM (Digital Surface Model)

TOM (True Ortho Photo Model)

pseudo oblique Imagery

pushbroom

Page 12: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

12PUBLIC RELEASE

training area Hammelburg/Germanytrainingtraining areaarea Hammelburg/GermanyHammelburg/Germany16 km16 km

24 km24 km

test areatest area

Page 13: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

13PUBLIC RELEASE

coveragecoverage

7 cm / 3*3KM7 cm / 3*3KM

15 cm / 16*24 KM15 cm / 16*24 KM

test areatest area

Page 14: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

14PUBLIC RELEASE

Airborne Sensor SystemAirborne Sensor SystemProcess ChainProcess Chain

Page 15: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

15PUBLIC RELEASE

Digital Digital SurfaceSurface Model (DSM)Model (DSM)Process ChainProcess Chain

Page 16: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

16PUBLIC RELEASE

VHR VHR TrueTrue OrthophotoOrthophoto MosaicMosaicProcess ChainProcess Chain

Page 17: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

17PUBLIC RELEASE

FacadesFacades

Process ChainProcess Chain

Silver

Gold

Bronce

Page 18: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

18PUBLIC RELEASE

VisualizationVisualizationProcess ChainProcess Chain

Page 19: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

19PUBLIC RELEASE

necessary redundance 12 necessarynecessary redundanceredundance 12 12

photogrammetry+

computervision

photogrammetry+

computervision

Page 20: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

20PUBLIC RELEASE

photogrammetry+

computervision

photogrammetry+

computervision

Page 21: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

21PUBLIC RELEASE

photogrammetry+

computervision

photogrammetry+

computervision

Page 22: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

22PUBLIC RELEASE

3D3D--reconstruction reconstruction isis fullyfully automatedautomated!!

photogrammetry+

computervision

photogrammetry+

computervision

extractionextractionthethe

fascadesfascades

generatinggenerating thetheTrueTrue--OrthophotoOrthophoto--MosaicMosaic

TOMTOM

generatinggenerating thetheDigital Digital SurfaceSurface ModelModel

DSMDSM

Page 23: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

23PUBLIC RELEASE

original image synthetic image

resultresult

digital camera 3D-World

Page 24: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

24PUBLIC RELEASE

resultresult

Page 25: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

25PUBLIC RELEASE

3D World Stubai-Glacier, source: RSS

synthetic image

resultresult

Page 26: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

26PUBLIC RELEASE

Maximal use of aerial data collection by producing pixel wise TOM, DSM, facades and

the 3D-visualization!

Maximal use of aerial data collection by producing pixel wise TOM, DSM, facades and

the 3D-visualization!

benefitbenefit

Page 27: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

27PUBLIC RELEASE

Page 28: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

28PUBLIC RELEASE

Project 3D Worlds (Prototypes)

– airborne sensor MS Vexcel UltracamX

Future Production of 3D Worlds (Products)

– airborne sensor DLR AMS Geo & AMS T

image acquisition

Page 29: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

29PUBLIC RELEASE

Development of high resolution cameras for the fast data capture of huge areas.

Page 30: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

30PUBLIC RELEASE

Sensor geometry of pushbroom cameras (MFC 3/5)

Page 31: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

31PUBLIC RELEASE

future sensor system concept

AMS Geo- 28 000 Pixel each line/pushbroom- ground sampling distance 10 cm/Pixel - platform: aerial survey aircraft- ~ 150 knts

AMS T- 10 000 Pixel each line/pushbroom- ground sampling distance 15-20 cm/Pixel - platform: TORNADO Navy Recce Pod- > 450 knts

Airborne Multispectral Stereoscanner (AMS)

AMS - Geo

pushbroom width ~ 1.8 km

pushbroom width ~ 4,2 km

AMS - T

Page 32: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

32PUBLIC RELEASE

Semi-Global Matching (SGM)

Accurate and run-time efficient method(Hirschmüller, CVPR 2005, 2006 und TPAMI 2008)‏Based on pixel-wise matchingMatching is supported by a global cost function thatpenalizes disparity changesThe global cost function is approximated by pathwiseoptimizations from all directions towards each pixelMatching cost is radiometrically robust, i.e. either Mutual Informationor Census (Hirschmüller und Scharstein, CVPR 2007 und TPAMI 2009) ‏Quality is comparable to that of global methodsComplexity is the same as for fast local methods, i.e. O(W*H*D), which results in short processing times, compared to global methodsImplemented for huge aerial push broom and frame camera imagesMore than 100 000 km2 of aerial images in 5-20 cm/Pixel resolution have alreadybeen processed on a small computer cluster

p, d

x

y

r

algorithm

Page 33: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

33PUBLIC RELEASE

evaluation

Absolute Accuracy

DSM x,y < 50 cm

TOM x,y < 50 cm

Future evaluation issues:

- phenomena's in the DSM and 3D visualization

- the benefit for the user

Evaluation issues

Page 34: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

34PUBLIC RELEASE

Page 35: 3D Worlds for the Bundeswehr - calval.cr.usgs.gov · 3D Worlds for the Bundeswehr Jochen Dahlke Berthold Winck. Civil Commercial Imagery Evaluation Workshop Fairfax Oaks, VA April

Civil Commercial Imagery Evaluation WorkshopFairfax Oaks, VA

April 2, 2009

35PUBLIC RELEASE Quelle: NASA-Apollo8-Dec24-Earth

Letzte Folie! Fragen?