Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016...
Transcript of Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016...
![Page 1: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/1.jpg)
Road Markings for Machine VisionNCHRP Project 20-102(6)
Update to AASHTO SCOTE
June 2016
![Page 2: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/2.jpg)
NCHRP Project 20-102
• Impacts of Connected Vehicles and Automated Vehicles on State and Local Transportation Agencies– 20-102(01) Policy and Planning Actions to Internalize Societal Impacts
of CV and AV Systems into Market Decisions – 20-102(02) Impacts of Regulations and Policies on CV and AV
Technology Introduction in Transit Operations– 20-102(03) Challenges to CV and AV Application in Truck Freight
Operations– 20-102(05) Strategic Communications Plan for NCHRP Project 20-102– 20-102(06) Road Markings for Machine Vision– 20-102(07) Implications of Automation for Motor Vehicle Codes– 20-102(08) Dedicating Lanes for Priority or Exclusive Use by CVs and
AVs– 20-102(09) Providing Support to the Introduction of CV/AV Impacts
into Regional Transportation Planning and Modeling Tools
![Page 3: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/3.jpg)
Cameras to Detect Markings
![Page 4: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/4.jpg)
Adaptive Headlights
• Potential
Benefit
• Demonstrated
Benefit
![Page 5: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/5.jpg)
Lane Departure Warning
• Potential
Benefit
• Demonstrated
Benefit
![Page 6: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/6.jpg)
Highway Safety Statistics
• Roadway departure crashes account for over half of all fatal crashes (51%)
![Page 7: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/7.jpg)
Potential LDW Safety
• Decrease fatalities by 7,529 fatal per year in the US– Journal of Accident Analysis & Prevention, Vol 43, 2011
• Reduce roadway departure crashes 26.1%– NHTSA
• Reduce serious injuries 20.7%– NHTSA
![Page 8: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/8.jpg)
LDW Experiences
• Not effective as other vehicle safety technologies (IIHS 2014)
• “we don’t see any evidence that these systems are helping drivers avoid being in crashes” (IIHS 2014)
• 2/3 of Honda owners turn off their LDW feature (IIHS 2016)
– Annoying warnings
![Page 9: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/9.jpg)
Early TTI Studies
• Simulated Conditions
– Sun glare
– Wet conditions
• Flat v. structured markings
![Page 10: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/10.jpg)
Machine Vision
video
![Page 11: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/11.jpg)
Challenging Conditions
• Uniform road marking maintenance thresholds• Preventive pavement maintenance treatments• Horizontal curves• Roadway lighting• Nighttime conditions• Wet conditions• Snow conditions• Debris• Poor marking removal
![Page 12: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/12.jpg)
Historic Coordination
HighwayInfrastructure
Industry
Vehicle Industry
Standards Standards
![Page 13: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/13.jpg)
Needed Coordination
Standards
HighwayInfrastructure
Industry(FHWA, AASHTO)
Vehicle Industry(NHTSA,
SAE)
![Page 14: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/14.jpg)
NCHRP 20-102(6)
• Road Markings for Machine Vision
• Objectives
– develop information on the performance characteristics of pavement markings that affect the ability of machine vision systems to recognize them
– provide data and recommendations that the AASHTO/SAE Working Group can use to quickly develop guidelines and criteria
![Page 15: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/15.jpg)
Work Plan
• Kick-Off Meeting
• Review Policies & Machine Vision Technologies
• Identify Testing Conditions
• Conduct Closed-Course Testing
• Analyze Results
• Prepare Reports
![Page 16: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/16.jpg)
Current Testing Requirements
• ISO 17361:2007 – No requirements on types of road markings – Lane markings must be in good condition and in accordance
with the nationally defined visible lane markings std– No requirements on the environmental conditions – Visibility range must be greater than 1 km
• NHTSA– High contrast and uniform pavement– Lane marking specifications adhering to MUTCD– Avoiding tests in inclement weather including rain, fog, snow,
hail, smoke, or ash
![Page 17: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/17.jpg)
Field Data
![Page 18: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/18.jpg)
![Page 19: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/19.jpg)
![Page 20: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/20.jpg)
Texas A&M RELLIS Campus
![Page 21: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/21.jpg)
Markings (Level 1)
![Page 22: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/22.jpg)
Markings (Level 2)
![Page 23: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/23.jpg)
Markings (Level 3)
![Page 24: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/24.jpg)
Markings (Level 4)
![Page 25: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/25.jpg)
Markings (Level 5)
![Page 26: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/26.jpg)
Test Markings
• Possible Markings
– Continuous white
– Continuous yellow
– Skip white
– Skip yellow
– Contrast markings
– Raised retroreflective pavement markers
– Raised non-retroreflective pavement markers
![Page 27: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/27.jpg)
Test Conditions
• Daytime
– Weather (dry, wet)
• Nighttime
– Conditions (dry, wet)
– Continuous roadway lighting (on or off)
– Vehicle lighting (tungsten-halogen, LED, other)
![Page 28: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/28.jpg)
Next Steps
• Identify and obtain vehicle industry data
• Synthesize all data sources
• Develop up to 5 marking levels
– Color and retroreflectivity
• Provide 3M and Ennis-Flint specifications
• Install markings at RELLIS
• Conduct testing
![Page 29: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/29.jpg)
![Page 30: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/30.jpg)
Sensor-Enhanced Markings
• Pilot testing of enhanced detection technologies
![Page 31: Road Markings for Machine Vision NCHRP Project 20 …sp.scote.transportation.org/Documents/2016 SCOTE Meeting/Tuesday... · NCHRP Project 20-102 • Impacts of Connected Vehicles](https://reader034.fdocuments.in/reader034/viewer/2022051800/5acf99db7f8b9ac1478cfd4c/html5/thumbnails/31.jpg)
Making It Happen