John R. Kasich, Governor Jerry Wray, Director Unmanned...

19
10/6/2016 1 Ohio Department of Transportation John R. Kasich, Governor Jerry Wray, Director Unmanned Aerial Systems: A Look Into UAS at ODOT July 2016 Tim Burkholder, PS Mapping Manager Division of Engineering Office of CADD and Mapping Services Kyle Ince, EI Transportation Engineer Division of Engineering Office of CADD and Mapping Services 2 ODOT’s Current Position A Look Into UAS at ODOT Flight Operation Testing Accuracy Assessment ODOT Business Policy Processing Workflow Deliverables Several active COAs LAW-52 and Deer Creek State Park Section 333 Exemption Flying under Part 107

Transcript of John R. Kasich, Governor Jerry Wray, Director Unmanned...

Page 1: John R. Kasich, Governor Jerry Wray, Director Unmanned ...ohiosurveyor.org/.../2016/10/ODOT-UAS...Compressed.pdf · Connects directly into the CORS RTK network for survey grade accuracy

10/6/2016

1

Ohio Department of TransportationJohn R. Kasich, Governor Jerry Wray, Director

Unmanned Aerial Systems: A Look Into UAS at ODOT

July 2016

Tim Burkholder, PSMapping Manager

Division of EngineeringOffice of CADD and Mapping Services

Kyle Ince, EITransportation EngineerDivision of Engineering

Office of CADD and Mapping Services

2

ODOT’s Current Position

A Look Into UAS at ODOT

Flight Operation TestingAccuracy Assessment

ODOT Business Policy

Processing WorkflowDeliverables

Several active COAsLAW-52 and Deer Creek State Park

Section 333 Exemption

Flying under Part 107

Page 2: John R. Kasich, Governor Jerry Wray, Director Unmanned ...ohiosurveyor.org/.../2016/10/ODOT-UAS...Compressed.pdf · Connects directly into the CORS RTK network for survey grade accuracy

10/6/2016

2

3

ODOT’s Current Platform:SenseFly eBee RTK

A Look Into UAS at ODOT

Weight = 1.61 lb including camera

Wingspan = 38 in.

Material = EPP foam, carbonstructure & composite parts

Propulsion = Electric pusher propeller, 160 W brushless DC motor

Battery = 11.1 V, 2150 mAh

4

SenseFly eBee RTK

HardwareConnects directly into the CORS RTK network for survey grade accuracy and real time corrections. (L1/L2, GPS and GLONASS)

3 cm horizontal and 5 cm vertical accuracy without ground control pts.*

Canon WX (18.2 MP) auto-triggering camera

40 min. max flight timeDuring the duration of this presentation the eBee RTK can map a 4.5 square mile area (lowest resolution at the highest altitude)

More typical flight 50 acres (2.5 cm per pixel) in less than 10 minutes*

*Perpendicular flight lines

A Look Into UAS at ODOT

Page 3: John R. Kasich, Governor Jerry Wray, Director Unmanned ...ohiosurveyor.org/.../2016/10/ODOT-UAS...Compressed.pdf · Connects directly into the CORS RTK network for survey grade accuracy

10/6/2016

3

5

SenseFly eBee RTK

SoftwareeMotion

Flight Planning and Control Software

Postflight Terra 3D Pix4DProfessional Photogrammetry Software

A Look Into UAS at ODOT

6

Planning Allows user to use 3D mission planning to plan the perfect flight.

Simulation Puts the perfect flight plan to the test in 3D with the UAS safely on the ground.

Monitoring and ControlUsing the same interface the operator can control and monitor the UAS in flight

eMotion

Flight Planning and Control Software

A Look Into UAS at ODOT

Page 4: John R. Kasich, Governor Jerry Wray, Director Unmanned ...ohiosurveyor.org/.../2016/10/ODOT-UAS...Compressed.pdf · Connects directly into the CORS RTK network for survey grade accuracy

10/6/2016

4

7

Postflight Terra 3D

Check in the FieldProvides a quick quality report in the field to insure proper coverage and accuracy

Generate Orthos, 3D models & Point Clouds

Creates deliverables directly into the remote sensing workflow. (.las and georeferenced tiff images)

A Look Into UAS at ODOT

8

Remote Sensing Deliverables

A Look Into UAS at ODOT

Orthomosiac Raster

3D Point Cloud in .las format

DSM in a geoTIFF

3D Textured Mesh

Contours

Imagery in .tif format

Page 5: John R. Kasich, Governor Jerry Wray, Director Unmanned ...ohiosurveyor.org/.../2016/10/ODOT-UAS...Compressed.pdf · Connects directly into the CORS RTK network for survey grade accuracy

10/6/2016

5

9

ODOT Best Practices and Workflow

Planning Simulation Site Preparation

Flight Operations

Processing and

Deliverables

A Look Into UAS at ODOT

10

Planning

Site ReconnaissanceObstacles

Trees

Utilities

Airports

Safe Zones

Primary and Alternate Landing Sites

Access Control

A Look Into UAS at ODOT

Page 6: John R. Kasich, Governor Jerry Wray, Director Unmanned ...ohiosurveyor.org/.../2016/10/ODOT-UAS...Compressed.pdf · Connects directly into the CORS RTK network for survey grade accuracy

10/6/2016

6

11

Simulation

A Look Into UAS at ODOT

12

Site Preparation

A Look Into UAS at ODOT

Ground Truth

Day of Flight ConditionsObstacles

Weather

Site Access

Internet Connection

Line of Sight

Page 7: John R. Kasich, Governor Jerry Wray, Director Unmanned ...ohiosurveyor.org/.../2016/10/ODOT-UAS...Compressed.pdf · Connects directly into the CORS RTK network for survey grade accuracy

10/6/2016

7

13

Flight Operations

Pre-flight checksAirframe Condition

Wings, Propeller, Pitot Tube, Ground Proximity Sensor, Batteries, Camera, etc.

Crew Briefing on Operations

Flight Plan UploadCheck parameters, set landing point, etc.

Document Operations and variables

A Look Into UAS at ODOT

14

Flight

A Look Into UAS at ODOT

Page 8: John R. Kasich, Governor Jerry Wray, Director Unmanned ...ohiosurveyor.org/.../2016/10/ODOT-UAS...Compressed.pdf · Connects directly into the CORS RTK network for survey grade accuracy

10/6/2016

8

15

Post Flight

PAPERWORK!!!!!Flight, Resolution

Altitude, Battery Voltage

Flight Time, Wind

Data checkOverlap

Sidelap

Photo Quality

A Look Into UAS at ODOT

16

Data Downloading and Processing

DownloadingFlight Data Logs

Command module (computer)

UAS on-board log

Images

Meta Data InfusingGeo-tagging Images

Writing header information

A Look Into UAS at ODOT

Page 9: John R. Kasich, Governor Jerry Wray, Director Unmanned ...ohiosurveyor.org/.../2016/10/ODOT-UAS...Compressed.pdf · Connects directly into the CORS RTK network for survey grade accuracy

10/6/2016

9

17

Structure from MotionStructure from Motion is a photogrammetric technique used to estimate 3D structures with 2D photos.

A Look Into UAS at ODOT

18

Structure from Motion

Similar to how stereo vision works3D LiDAR and Imagery

A Look Into UAS at ODOT

Camera Captures Overlapping Images

while in Motion

Software Identifies and Matches Thousands of

Keypoints

Photogrammetry Extracts Geometry to

Calculate Pixel Positioning

Page 10: John R. Kasich, Governor Jerry Wray, Director Unmanned ...ohiosurveyor.org/.../2016/10/ODOT-UAS...Compressed.pdf · Connects directly into the CORS RTK network for survey grade accuracy

10/6/2016

10

19

Final Processing

Software PackagesPostFlight Terra 3D, Pix4D, Agisoft, and Context Capture

InputsControl (Ground Truth)

Geotagged Images

A Look Into UAS at ODOT

20

Ground Control

A Look Into UAS at ODOT

Page 11: John R. Kasich, Governor Jerry Wray, Director Unmanned ...ohiosurveyor.org/.../2016/10/ODOT-UAS...Compressed.pdf · Connects directly into the CORS RTK network for survey grade accuracy

10/6/2016

11

21

Deliverable Creation

Point cloudExported in multiple formats

Example .las

OrthophotoExported in google tiles and geotiff

Textured MeshMeshed surface with the orthophoto referenced

A Look Into UAS at ODOT

22

Deliverable Creation Continued

A Look Into UAS at ODOT

Page 12: John R. Kasich, Governor Jerry Wray, Director Unmanned ...ohiosurveyor.org/.../2016/10/ODOT-UAS...Compressed.pdf · Connects directly into the CORS RTK network for survey grade accuracy

10/6/2016

12

23

Orthophoto

A Look Into UAS at ODOT

24

Deer Creek TestOutlined area was tested against our manned aircraft & topographic surveying using a total station.

A Look Into UAS at ODOT

Page 13: John R. Kasich, Governor Jerry Wray, Director Unmanned ...ohiosurveyor.org/.../2016/10/ODOT-UAS...Compressed.pdf · Connects directly into the CORS RTK network for survey grade accuracy

10/6/2016

13

25

Deer Creek TestFlight @ 353.5 AGL 60% Lateral & 75% Longitudinal Overlap

A Look Into UAS at ODOT

Flight @ 235.4 AGL 60% Lateral & 75% Longitudinal Overlap

26

Deer Creek Test

A Look Into UAS at ODOT

Flight @ 353.5 AGL 60% Lateral & 75% Longitudinal Overlap

Combined Flights @ 353.5 and 235.4

Page 14: John R. Kasich, Governor Jerry Wray, Director Unmanned ...ohiosurveyor.org/.../2016/10/ODOT-UAS...Compressed.pdf · Connects directly into the CORS RTK network for survey grade accuracy

10/6/2016

14

27

Pros vs. Cons

ProsAffordability

Compared to conventional data collection

Accessibility (except over live traffic)

Safety Removes human interaction from dangerous situations

Field to finish capabilities

A Look Into UAS at ODOT

28

Pros vs. Cons

ConsAccuracy

Determining viability

Inability to traverse live traffic

Specialized training

Liability Issues

Black-Box type Software

Enormous amounts of data

A Look Into UAS at ODOT

Page 15: John R. Kasich, Governor Jerry Wray, Director Unmanned ...ohiosurveyor.org/.../2016/10/ODOT-UAS...Compressed.pdf · Connects directly into the CORS RTK network for survey grade accuracy

10/6/2016

15

29

Limitations with Photography

Inability to triangulate key points across waterPhotogrammetric problem

Structure from Motion without the motionObjects can’t move within photos

Example vegetation

A Look Into UAS at ODOT

30

Camera Variables

When choosing a camera:Megapixels are not the most important part

Fixed Focal Length***

Stable photographyFast exposure times with less image blur

Metric lens

A Look Into UAS at ODOT

Page 16: John R. Kasich, Governor Jerry Wray, Director Unmanned ...ohiosurveyor.org/.../2016/10/ODOT-UAS...Compressed.pdf · Connects directly into the CORS RTK network for survey grade accuracy

10/6/2016

16

31

Platforms

A Look Into UAS at ODOT

32

Sensors

A Look Into UAS at ODOT

Page 17: John R. Kasich, Governor Jerry Wray, Director Unmanned ...ohiosurveyor.org/.../2016/10/ODOT-UAS...Compressed.pdf · Connects directly into the CORS RTK network for survey grade accuracy

10/6/2016

17

33

eBee Plus

A Look Into UAS at ODOT

34

ODOT Moving Forward

Reviewing FAA guidelines to evaluate ODOT safety and policy needs that will need to be required above FAA regulations (i.e. may require additional observers, liability insurance, develop additional privacy policies, public notifications, etc.)

Once all specifications and policies are in place, will develop prequalification process for contractors and consultants

Will evaluate program expansion to DOT District Survey OfficesAs well as expansion to other business areas within ODOT

A Look Into UAS at ODOT

Page 18: John R. Kasich, Governor Jerry Wray, Director Unmanned ...ohiosurveyor.org/.../2016/10/ODOT-UAS...Compressed.pdf · Connects directly into the CORS RTK network for survey grade accuracy

10/6/2016

18

35

Hurdles with the Start of a UAS Program

Waviers and Regulations

Rogue OperatorsOver 583 UAS sightings reported by pilots in the last 6 months

Latest Report by the FAA Aug-2015 Jan-2016

Halted firefighting operations in California wildfires

Preparing the Proper Workflow and Safety Plan

Deciding and Evaluating a PlatformSensors and Airframe

A Look Into UAS at ODOT

36

Ohio Contacts/ Information for UAS

Indiana/Ohio UAS Center and Test Complex:

http://www.dot.state.oh.us/Divisions/uas/Pages/default.aspx

Ohio Department of Transportation:

http://www.dot.state.oh.us/Divisions/Engineering/CaddMapping/Survey/Pages/UnmannedAerialVehicles.aspx

A Look Into UAS at ODOT

Page 19: John R. Kasich, Governor Jerry Wray, Director Unmanned ...ohiosurveyor.org/.../2016/10/ODOT-UAS...Compressed.pdf · Connects directly into the CORS RTK network for survey grade accuracy

10/6/2016

19

37

Questions?

Tim Burkholder, P.S.Mapping Manager

[email protected]

Kyle Ince, EITransportation [email protected]

A Look Into UAS at ODOT