Performance Standards, Measures, and Benchmarks MCSAP Planning Meeting - May 2019

MCSAP Planning MeetingMay 2, 2019

Jacob York and Dianne Gunther

Performance Standards, Measures, and Benchmarks

Performance Standards, Measures, and Benchmarks MCSAP Planning Meeting - May 2019

• Background and Overview• Project Update:

– Long Term: Problem-Oriented Performance Measurement– Short Term: Performance Data Tool

Agenda

2

Performance Standards, Measures, and Benchmarks MCSAP Planning Meeting - May 2019 3

Background/Overview

Performance Standards, Measures, and Benchmarks MCSAP Planning Meeting - May 2019

• MCSAP’s goal is to reduce CMV-involved crashes, fatalities, and injuries through consistent, uniform, and effective CMV safety programs

• Success depends on Federal-State partnership to establish programs to improve motor carrier, CMV, and driver safety

We are partners in the mission to improve CMV safety.

Background: Measuring MCSAP

4

Performance Standards, Measures, and Benchmarks MCSAP Planning Meeting - May 2019

• PSMB Test Group: A working group of Federal and State partners • Represents of a variety of MCSAP programs based on size, crash risk,

location, and MCSAP activities (including Border and New Entrant)• Provide feedback and help iterate and improve the PSMBs• We have learned a lot about each member’s data and the unique

considerations for each State

PSMB Overview: Test Group

5

Performance Standards, Measures, and Benchmarks MCSAP Planning Meeting - May 2019

• Access to data (beyond FMCSA data)• Access to equipment & technology• Jurisdiction/regulation constraints• Organizational factors• Inspection and Traffic Enforcement program – strategy & resources• Investigation program – strategy & resources• Carrier industry details• Synergy with size & weight enforcement

Information Sharing: What We’ve Learned

6

Performance Standards, Measures, and Benchmarks MCSAP Planning Meeting - May 2019 7

Long Term: Problem-OrientedPerformance Measurement

Performance Standards, Measures, and Benchmarks MCSAP Planning Meeting - May 2019

• Evaluate (required to improve and learn). Analyze and understand past performance.

• Learn. Share ideas and best practices with each other.

• Improve. Do more with less resources.

Why measure performance?

8

Source: Robert D. Behn, “Why Measure Performance? Different Purposes Require Different Measures,” Public

Administration Review 63 (5) (Sept./Oct. 2003): 586-606, table 1.

Evaluate

ImproveLearn

Performance Standards, Measures, and Benchmarks MCSAP Planning Meeting - May 2019

problem- vs. process-based approach

9

Analogy: Is he a good carpenter?

Performance Standards, Measures, and Benchmarks MCSAP Planning Meeting - May 2019

Process-oriented• Inspections• Traffic Enforcement• Investigations

Outcome-oriented• Crashes

So what would this actually look like?

10

Problem-oriented• Driver safety• Vehicle safety• Carrier safety

..etc.

Speeding Violation Rates in TE

Level 1

Level 2

Level 3

Performance Standards, Measures, and Benchmarks MCSAP Planning Meeting - May 2019 14

Short Term:Performance Data Tool

Performance Standards, Measures, and Benchmarks MCSAP Planning Meeting - May 2019

• Purpose: Information gathering– Help States/Feds create CMV safety plans and monitor goals– Aid in setting goals and planning/projecting for future activities– Understand national CMV safety ecosystem – Ask further questions– Not value judgments

• Context– Complement to FMCSA A&I, which already reports on many MCSAP performance

metrics

Performance Data Tool

15

Performance Standards, Measures, and Benchmarks MCSAP Planning Meeting - May 2019

National Program Elements – Goals vs. Actuals – FY 2018

16

Data source: Goals are from CVSPs. Actuals are from MCMIS as of 2/22/2019. Activity counts may include non-MCSAP-funded activities. No FMCSA data on Intrastate Safety Audits.

Performance Standards, Measures, and Benchmarks MCSAP Planning Meeting - May 2019

• FMCSA provides guidance, not requirements• Only 8 States met both standards in FY18

– Caveat: MCMIS data does not designate if the inspector was MCSAP-funded

• Opportunity for more research

Inspection Program Balance

17

< 33% Level 3

≥ 33% Level 3

< 25% Level 1 8 22

≥ 25% Level 1 13 8 Current MCSAP guidance

Performance Standards, Measures, and Benchmarks MCSAP Planning Meeting - May 2019

Funding Utilization

18

FY 2015 – FY 2017

Performance Standards, Measures, and Benchmarks MCSAP Planning Meeting - May 2019

• Currently in prototype phase• Once complete, tool will be shared with State and Federal users

– E.g. support Division offices in monitoring– No publicly viewable map that compares different States

What’s Next for the Performance Data Tool?

19

Performance Standards, Measures, and Benchmarks MCSAP Planning Meeting - May 2019

Thank you to the Test Group members!

20

Name State Position RoleTom Liberatore HQ FMCSA State Programs Division Chief Chair

Jacob York HQ FMCSA State Programs Office Co-Chair

Derek D. Barrs FL Chief, Florida Highway Patrol State SME

L. Gino D’Addario NJ Sergeant, New Jersey State Police State SME

John Holder MI Lieutenant, Michigan State Police State SME

Freddy Johnson NC Major, NC Dept. of Public Safety State SME

Greg Ferrara NC Program Manager, ITRE, NC State University SME

David Lorenzen IA Chief, IA DOT Motor Vehicle Enforcement State SME

Steven J. Rundell TX Captain, Texas Highway Patrol Division State SME

Jeff Steeger MT MCSAP Manager, State of Montana State SME

Kevin Zeller WA Program Manager, Washington State Patrol State SME

Federal SMEs: Kevin Breedlove, Donald Ross, Paul Haugland, Clay Green, John Wallace, Michael ChristopherAnalytical Support: Michael Chang, Dianne Gunther, Nadeem Istfan, Aaron Hoffman

Performance Standards, Measures, and Benchmarks MCSAP Planning Meeting - May 2019 21

Thank you! Q&A