Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND...

26
AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem van Aalst - TNO Giljam Derksen Peter-Paul Schackmann contact: [email protected] © TNO 2015 Petra Paffen - RWS Frank Bouman Wim van Ooijen

Transcript of Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND...

Page 1: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem van Aalst - TNO Giljam Derksen Peter-Paul Schackmann contact: [email protected] © TNO 2015

Petra Paffen - RWS Frank Bouman Wim van Ooijen

Page 2: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

Willem van Aalst, TNO System engineer & project manager (infra inspection)

Automated raveling inspection and maintenance planning on porous asphalt in the Netherlands

Project(s) performed under authority of:

The Dutch Highway Agency, Ministry of Infrastructure and the Environment

INTRODUCTION

2 | AUTOMATED RAVELING INSPECTION AND MAINTENACE PLANNING ON POROUS ASPHALT 23 April 2015

Page 3: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

CHALLENGES

Porous Asphalt (ZOAB): Dutch highways: > 85% ZOAB ZOAB 0/16: > 70%

Raveling: Loss of aggregates Dominant failure mechanism (>90%)

Alternative for visual inspections: Objective, Safe, Cost Road width (# lanes) Point laser(s) not sufficient (Stone(a)way)

23 April 2015 3 | AUTOMATED RAVELING INSPECTION AND MAINTENACE PLANNING ON POROUS ASPHALT

Source: www.bergersmeeting.com/nieuws.htm

Page 4: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

GENERAL CONCEPT

3D data generation

Raveling

Asset management

23 April 2015 4 | AUTOMATED RAVELING INSPECTION AND MAINTENACE PLANNING ON POROUS ASPHALT

? Laser triangulation

3D data

Maintenance planning

Raveling

Page 5: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

TIMELINE

2009 - 2010: Feasibility 2010 - 2011: Proof of concept

2012 - 2013: First generation 2013-2014: New vehicle 2014-2015: Update (colour)

23 April 2015 5 | AUTOMATED RAVELING INSPECTION AND MAINTENACE PLANNING ON POROUS ASPHALT

TRL – 1

TRL – 2

TRL – 3

TRL – 4

TRL – 5

TRL – 6

TRL – 7

TRL – 8

TRL – 9

Page 6: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

FEASIBILITY PHASE Questions:

Raveling from 3D surface? Possible at high speed? Test location: A65:

15 sections (1m2) Visual inspections 3D surfaces

23 April 2015 6 | AUTOMATED RAVELING INSPECTION AND MAINTENACE PLANNING ON POROUS ASPHALT Visual score

No raveling

Severe raveling

No Light Medium Severe

Page 7: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

FEASIBILITY PHASE

Simulation of measurement systems State of the art systems:

Laser triangulation (1 or 2 spots) Laser triangulation (2 lines) Amplitude phase modulation lasers

Selected: line laser triangulation

LCMS sensors (INO/Pavemetrics)

23 April 2015 7 | AUTOMATED RAVELING INSPECTION AND MAINTENACE PLANNING ON POROUS ASPHALT

LCMS system Source: www.pavemetrics.com

Page 8: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

PROOF OF CONCEPT

2009 - 2011

23 April 2015 8 | AUTOMATED RAVELING INSPECTION AND MAINTENACE PLANNING ON POROUS ASPHALT

RWS ARAN 2 equipped with the LCMS system

Test objects used to validate system specifications

Sections N = 676 (each 100 m)

Page 9: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

PROOF OF CONCEPT

Visual versus Model: Good correlation with visual inspections!

93% (+/- 1 year)

23 April 2015 9 | AUTOMATED RAVELING INSPECTION AND MAINTENACE PLANNING ON POROUS ASPHALT

Page 10: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

FIRST GENERATION

Main components

LCMS sensors & controller (3D data)

Laser Safety Controller (tilt, speed, …)

RTK – GPS (positioning)

DMI (triggering)

Front- & side camera’s (reference)

FPGA framegrabber (HW timing)

Acquisition pc (Windows)

Control pc (Unix)

23 April 2015 10 | AUTOMATED RAVELING INSPECTION AND MAINTENACE PLANNING ON POROUS ASPHALT

Page 11: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

SPECIFICATIONS

High speed ‘in-traffic’ measurements ~120 km/h Lane wide: 4 meters

3D range data 2D intensity data Resolution:

1.0 mm (transversal) 4.7 mm (longitudinal)

Accuracy (height):

~ 0.5 mm (σ)

23 April 2015 11 | AUTOMATED RAVELING INSPECTION AND MAINTENACE PLANNING ON POROUS ASPHALT

1x1 mm 1x5 mm

2 x 2 m section

Page 12: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

EXAMPLE DATA

23 April 2015 12 | AUTOMATED RAVELING INSPECTION AND MAINTENACE PLANNING ON POROUS ASPHALT

Range Intensity

3D print

Page 13: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

DATA PROCESSING Steps 1. Road-marking detection

2. Flattening (road & vehicle motion)

3. Texture analysis (pavement type)

4. Removal of: • Mechanical damage (rim marks) • Joints

5. Wheel path (maximum damage)

6. Raveling (per m2 in wheel path) • % stone loss • % clustered stone loss

23 April 2015 13 | AUTOMATED RAVELING INSPECTION AND MAINTENACE PLANNING ON POROUS ASPHALT

100m section

Page 14: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

PAVEMENT TYPE CLASSIFICATION

Dependencies on pavement type Raveling Maintenance interval

Two approaches: Spectrum based (FFT) Texture based (various descriptors)

23 April 2015 14 | AUTOMATED RAVELING INSPECTION AND MAINTENACE PLANNING ON POROUS ASPHALT

Porous Asphalt 0/16 mm 4/8 mm

Page 15: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

PAVEMENT TYPE CLASSIFICATION

Examples:

23 April 2015 15 | AUTOMATED RAVELING INSPECTION AND MAINTENACE PLANNING ON POROUS ASPHALT

Spectrum analysis Texture analysis

Mean

Page 16: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

PAVEMENT TYPE CLASSIFICATION

Classification 11 texture measures Quadratic classifier

Evaluation set

N = 27.128 (100m)

Results Overall: > 98.8% correct Porous Asphalt: > 99,7 % correct

23 April 2015 16 | AUTOMATED RAVELING INSPECTION AND MAINTENACE PLANNING ON POROUS ASPHALT

Page 17: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

RAVELING Flatten & clean data

‘Coin’ algorithm

Radius (r) Depth (d)

‘3D Stone(a)way’

23 April 2015 17 | AUTOMATED RAVELING INSPECTION AND MAINTENACE PLANNING ON POROUS ASPHALT

Raw 3D data

Raveling

Flattened & cleaned

d

r

Page 18: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

RAVELING Repeatability:

Very good! Reproducibility:

Very good!

23 April 2015 18 | AUTOMATED RAVELING INSPECTION AND MAINTENACE PLANNING ON POROUS ASPHALT

Mea

sure

d S

tone

loss

[%]

Real Stone loss [%] Position [m]

Sto

ne lo

ss [%

]

Page 19: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

MAINTENANCE INTERVAL ‘Old’ style:

Visual inspections Maintenance interval (year) ‘new’ style:

Ravelling data Maintenance interval

23 April 2015 19 | AUTOMATED RAVELING INSPECTION AND MAINTENACE PLANNING ON POROUS ASPHALT

MODEL

Raveling

Maintenance interval

Page 20: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

MAINTENANCE INTERVAL Input:

Ravelling per m2 (both wheel paths) Linear classifier

28 inputs 1 output (per 100m) Trained on visual inspections

23 April 2015 20 | AUTOMATED RAVELING INSPECTION AND MAINTENACE PLANNING ON POROUS ASPHALT

?

Raveling

Maintenance interval

Page 21: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

MAINTENANCE INTERVAL Results:

2012 : ~ 99 % correct (+/- 1 year to visual inspection) Two districts: Venlo & St. Joost

Visual inspections

23 April 2015 21 | AUTOMATED RAVELING INSPECTION AND MAINTENACE PLANNING ON POROUS ASPHALT

Model Visual

Interval [years]

Page 22: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

2012 2013 2014

RESULTS Results:

2014

23 April 2015 22 | AUTOMATED RAVELING INSPECTION AND MAINTENACE PLANNING ON POROUS ASPHALT

typeLCMSMJPV15 0 1 2 3 4 5 6ZOAB(+) 0 143 34 31 9 7 2 4

1 23 67 30 20 10 6 42 26 71 162 72 64 22 73 17 59 152 247 217 125 404 7 14 50 134 529 297 815 4 2 28 71 375 1238 3256 10 15 24 40 420 2675 34214

ZOAB(+) Total 230 262 477 593 1622 4365 34675

Page 23: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

SUMMARY

Accurate measurement of raveling op PA (ZOAB) High speed and ‘in-traffic’ Good repeatability and reproducibility

System operational since 2012

Replacing most visual inspections Modelling of maintenance interval

Based on raveling

Accurate pavement type classification

23 April 2015 23 | AUTOMATED RAVELING INSPECTION AND MAINTENACE PLANNING ON POROUS ASPHALT

Page 24: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

ONGOING & FUTURE RESEARCH

Cracking on PA (ZOAB) Raveling on fine PA and SMA

Commercialisation (EU-)collaboration (Standardisation)

23 April 2015 24 | AUTOMATED RAVELING INSPECTION AND MAINTENACE PLANNING ON POROUS ASPHALT

Page 25: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

CHALLENGES FUTURE

Variety in pavements versus Monitoring & Prediction Fine porous asphalt versus Measurements

23 April 2015 25 | AUTOMATED RAVELING INSPECTION AND MAINTENACE PLANNING ON POROUS ASPHALT

Page 26: Automated Ravelling Inspection and Maintenance Planning on ... · AUTOMATED RAVELING INSPECTION AND MAINTENANCE PLANNING ON POROUS ASPHALT IN THE NETHERLANDS FIRM15 - Brussels Willem

THANK YOU FOR YOUR ATTENTION Willem van Aalst © TNO 2015 Contact: [email protected]