Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on...
Transcript of Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on...
![Page 1: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/1.jpg)
PE 2019
Assessing the Impact of Data Quality on Pavement
Management SystemsBy
Ahmad Alhasan and Omar Smadi
Center for Transportation Research and Education/ Iowa State University
![Page 2: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/2.jpg)
PE 2019
Observe, analyze, model, predict, and decide.
Leonardo Fibonacci 1170 - 1250
![Page 3: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/3.jpg)
PE 2019
From data collection to decision making.
![Page 4: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/4.jpg)
PE 2019
It all starts with monitoring and evaluation inventory.
https://newscenter.nmsu.edu/articles/view/8486
![Page 5: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/5.jpg)
PE 2019
It all starts with monitoring and evaluation inventory.
http://www.pavemetrics.com/applications/road-inspection/lcms2-en/#!
![Page 6: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/6.jpg)
PE 2019
From data collection to decision making.
![Page 7: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/7.jpg)
PE 2019
Data can be arranged in a GIS database.
http://data.iowadot.gov/datasets/48bfff7ffbfa4555bed8c374e44c9300_3?geometry=-102.09%2C40.522%2C-84.666%2C43.381
![Page 8: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/8.jpg)
PE 2019
From data collection to decision making.
![Page 9: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/9.jpg)
PE 2019
Performance starts beautiful and becomes ugly.
![Page 10: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/10.jpg)
PE 2019
Shopping for models.
https://www.workingmother.com/back-to-school-childrens-fashion-2016
![Page 11: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/11.jpg)
PE 2019
A model can be a law or a theory.
https://en.wikipedia.org/wiki/Scientific_law
![Page 12: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/12.jpg)
PE 2019
What is a model?
• Mathematically we can define (model) any condition data
observation for any asset as a function 𝑓 𝐗, 𝑡 with error term
𝜖𝑖:
𝑦𝑖 = 𝑓 𝐗, 𝑡 + 𝜖𝑖
• Where 𝑦𝑖 is the condition record described as a function of
multiple independent variables contained in 𝐗 at a given time t.
• Many approaches can be used to find the function describing
the change in condition over time.
![Page 13: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/13.jpg)
PE 2019
Variability or Uncertainty?!
![Page 14: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/14.jpg)
PE 2019
Variability or Uncertainty?!
https://en.wikipedia.org/wiki/Gamma_distribution
![Page 15: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/15.jpg)
PE 2019
Check the assumptions.
![Page 16: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/16.jpg)
PE 2019
Check the assumptions.
![Page 17: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/17.jpg)
PE 2019
Choose proper regression model.
Ƹ𝜇 = 𝑒𝛽0+𝛽1𝐴𝑔𝑒
![Page 18: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/18.jpg)
PE 2019
Look deeper.
•𝑓𝐼𝑅𝐼 =𝐼𝑅𝐼 Τෝ𝜇 𝑇 −1𝑒− Τ𝐼𝑅𝐼 𝜑
Γ Τෝ𝜇 𝜑 𝜑 Τෝ𝜇 𝜑
• 𝐸 𝐼𝑅𝐼 = ො𝜇
• 𝑉𝑎𝑟 𝐼𝑅𝐼 = ො𝜇𝜑
![Page 19: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/19.jpg)
PE 2019
Variability and Uncertainty Decomposition.
𝑦𝑖 = 𝑓 𝐗, 𝑡 + 𝜖𝑖Is my model
good?!
http://berkeleysciencereview.com/importance-uncertainty/
![Page 20: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/20.jpg)
PE 2019
Filtering can make data noisy.
![Page 21: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/21.jpg)
PE 2019
Filtering can make data noisy.
![Page 22: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/22.jpg)
PE 2019
Would cleaner data help?
![Page 23: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/23.jpg)
PE 2019
Would cleaner data help?
• Repeated measurements were removed and the errors were reduced by half.
• 𝜎∗2 = 0.52 𝜎2
![Page 24: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/24.jpg)
PE 2019
From data collection to decision making.
![Page 25: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/25.jpg)
PE 2019
If you know your past you might know your future!
![Page 26: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/26.jpg)
PE 2019
If you know your past you might know your future!
![Page 27: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/27.jpg)
PE 2019
Better data can reduce the uncertainty.
![Page 28: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/28.jpg)
PE 2019
From data collection to decision making.
![Page 29: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/29.jpg)
PE 2019
Data is great but harder to report and use in decision making.
https://www.tilburguniversity.edu/education/professional-learning/sensible-business-decisions-under-uncertainty
![Page 30: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/30.jpg)
PE 2019
Better data can reduce the uncertainty.
• Both models expect Fair condition.
• 𝑃1 𝐶 ≠ 𝐹𝑎𝑖𝑟 = 0.3
• 𝑃1 𝐶 ≠ 𝐹𝑎𝑖𝑟 = 0.15
![Page 31: Assessing the Impact of Data Quality on Pavement ...PE 2019 Assessing the Impact of Data Quality on Pavement Management Systems By Ahmad Alhasan and Omar Smadi Center for Transportation](https://reader035.fdocuments.in/reader035/viewer/2022071218/6053111890338345683f360e/html5/thumbnails/31.jpg)
PE 2019
If you are uncertain ask questions
https://projectscreenwriter.com/2017/01/25/loglines-and-a-lot-of-head-scratching/