What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc,...

31
What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa

Transcript of What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc,...

Page 1: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

What we Measure Matters

Sharon Johnston, MD, LLM, CCFPUniversity of Ottawa

William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPCUniversity of Ottawa

Page 2: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Performance Measurement in PHC

Page 3: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Performance Measurement in PHC

Page 4: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

UK: Quality and Outcomes Framework

Page 5: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Performance Measurement in PHC

Dear Dr. JohnstonThank you for your interest in the Primary Care Physician Practice (PCP) Report.  The PCP Report provides primary care physicians with data on practice demographics, health service use (e.g., emergency room visits, hospital admissions, and specialist referrals), and chronic disease prevention and management. These confidential reports come directly to the physician and include data comparisons of the physician with other relevant practices, his/her LHIN, and the province. This information can enable you to better plan and monitor the impact of your improvement work and the services you provide.Health Quality Ontario (HQO) has now developed a secure, web-based portal where you can register to receive your confidential PCP Report, as well as download your most up-to-date Report and access support tools. Reports with updated data (up to March 2013) will be available on the portal in August 2014.

Page 6: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Transforming CBPHC Delivery Through Comprehensive Performance Measurement and Reporting

• Overall goal: demonstrate the feasibility and usefulness of comparative and comprehensive CBPHC performance measurement and reporting to inform innovation of the Canadian PHC system.

Page 7: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Performance Measurement

• How do we get a more complete picture of primary health care in Canada?

• Uses:– Practice QI– Pay for Performance– System level reporting and accountability– Research to improve understanding of

best practices

Page 8: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Project Team Principal Investigators/Leads Nominated PI: Sabrina Wong (University of BC)

Co-PI: Bill Hogg (University of Ottawa)

Co-I: Fred Burge (Dalhousie University)

Co-InvestigatorsJulia Abelson (McMaster University)

Antoine Boivin (U of Sherbrooke)

John Campbell (University of Exeter, UK)

Khaled El Emam (University of Ottawa)

Rick Glazier (Institute for Evaluative Sciences)

Jeannie Haggerty (McGill)

Sharon Johnston (Bruyère Research Institute)

Alan Katz (University of Manitoba)

Jean-Fred Levesque (Bureau of Health Info, Australia)

Kim McGrail (UBC Centre for Health Services & Policy Research)

Walter Wodchis (University of Toronto)

Decision-MakersJohn Abbott (Health Council Canada)

Heather Davidson (BC Ministry of Health)

Victoria Lee (Fraser Health Authority)

Michelle Rey & Wissam Haj-Ali (Health Quality Ontario)

Paul Roumeliotis (Eastern Ontario Health Unit)

Collaborators Annette Browne (University of BC)

Marilyn Ford Gilboe (University of Western Ontario)

Bev Holmes (Michael Smith Foundation for Health Research)

Anthony Mar (Cliniconex)

Steve Morgan (UBC Centre for Health Services & Policy Research)

Monica Taljaard (Ottawa Hospital Research Institute)

Colleen Varcoe (University of BC)

Page 9: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Funders, Stakeholders and Partners

EQUIP Healthcare

Page 10: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

1

2

3

The Study Regions

3 Sites in 3 Provinces

1. Fraser East (in Fraser Health)

2. Eastern Ontario Health Unit

3. Capital Health

*All regions were selected from Peer Group A, groups identified by Statistics Canada as having similar social and economic make up

Page 11: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Study 1: Regional PHC System Performance

• Compare comprehensive measures of CBPHC performance and healthcare equity between regions, including comparative performance for complex vulnerable patients

• Practice-based performance measurement

Page 12: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Data Sources

–Linked Patient, Provider and Organizational Surveys–Health Administrative Data

Page 13: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Sampling

• In each of 3 health regions:– 40 practices– 2 clinicians providing general medical

care– 20 patients per organization

Page 14: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Study 2: Policy Context Case Study

• Objective:– To examine contextual facilitators and

barriers that may explain regional variation in CBPHC performance

Page 15: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Research Questions

• What are the characteristics of: 1. The populations served by the CBPHC practices

in each of the 3 study regions and

2. The CBPHC practices themselves?

• In the past five years, what CBPHC innovations have been implemented in each of the 3 study regions and how have they impacted practices’ performance?

Page 16: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Research Questions

•What features of a performance measurement and reporting system in CBPHC are important to key stakeholders?

Page 17: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Methods

•Document and literature review•Interviews with decision makers, clinician leaders, community groups•Patient focus groups•Clinician focus groups

Page 18: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Study 3:Deliberative Dialogues on PHC performance Reporting

• Research Questions:• What dimensions of CBPHC are of greatest priority for

measurement and public reporting to promote accountability and public engagement in health system decision-making?

• How is public information on CBPHC performance used by individuals; acting as patients and/or acting as citizens?

• What is the best way to report performance results to different stakeholders: governance level (clinic, region, province), format, mode?

Page 19: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Study 3:Deliberative Dialogues on PHC performance Reporting

Deliberative Dialogues is a methodology for directly involving the public and other stakeholders in value-based discussions about the health system

Page 20: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.
Page 21: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Deliberative Dialogues

• Full day Deliberative Dialogue (DD) sessions in BC, ON, NS

• Each region: one DD with complex patients and one with low health system user patients – 10-15 patients per group– All participants sent a pre-meeting brief

about PHC performance measurement, core dimensions of PHC and examples of PHC performance reporting approaches

Page 22: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Deliberative Dialogues

• Small group and large group discussions on:– Priority dimensions and indicators to

measure and report?– How should/would people use publicly

reported PHC performance data? • Discuss different formats for

reporting on PHC performance.

Page 23: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Performance reporting

• Regional PHC performance reports will be prepared for different audiences for each TRANSFORM study region

• Content (indicators and relevant context) and format informed by deliberative dialogues

• Follow up interviews with policy-makers to understand the impact and use of regional publicly reported data

Page 24: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Pilot study: Automating the Patient Survey

• A primary goal of TRANSFORM is to advance the science of performance measurement– Better understanding of important

measures– Better methods for measuring and

reporting performance

Page 25: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Automated Patient Survey

• Traditional patient survey in waiting room – Captures views of attenders– Long– Less flexibility to adjust centrally and

redistribute when paper-based– Tablet-based more expensive and still

requires survey administrator– Harder to link to ER– Follow-up timing options are limited

Page 26: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Automated Patient Survey

• Automated interactive voice response surveys linked to EMR eg. after hospital discharge

• Existing primary care practice-based platform for automated patient phone and email reminders for appointments, practice notifications, etc.

This is an opportunity to harness emerging technology to create a more flexible and sustainable patient survey method which can be scaled up or limited to a single practice.

Page 27: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Automated Patient Survey

• Is an automated practice-based patient survey feasible?

• Is an automated practice-based patient survey acceptable to patients?

• Is an automated practice-based patient survey acceptable to providers?

Page 28: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Automated Patient Survey

• Pilot study within TRANSFORM patient survey data collection

• Patients who fill out the waiting room survey will be asked to consent to a follow up automated survey of 3-6 questions within 72 hours – Telephone, email, text message preference

• Analyse degree of reachabilty by this method and respondent profile

Page 29: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Automated Patient Survey

• Based on your experience, how easy is it for you to get health advice from your clinic over the phone?

• Not at all easy • Not very easy • A bit easy • Moderately easy • Very easy

Page 30: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Automated Patient Survey

• Long term potential would be linked to EMR and deployed by preset parameters

• Automated survey questions could be linked to phone call reminders about flu shot clinics, appointment reminders, preventive care reminders, change of clinic hours notices, etc.

• Survey question burden per patient minimised as spread over large practice roster

Page 31: What we Measure Matters Sharon Johnston, MD, LLM, CCFP University of Ottawa William Hogg, Hons. BSc, MSc, MClSc, MD, CCFP, FCFPC University of Ottawa.

Thank you


Collaboration in Action – EFPPEC at Queen’s Dr. Cori Schroder MD MEd CCFP FCFP Dr. Joshua Shadd MD CCFP EFPPEC Videoconference March 14, 2007.

Collaboration in Action – EFPPEC at Queen’s Dr. Cori Schroder MD MEd CCFP FCFP Dr. Joshua Shadd MD CCFP EFPPEC Videoconference March 14, 2007.

APRIL 4, 2013 ELIZABETH SHOULDICE, MD CCFP(EM) CCFP(EM) Academic Half Day Obstetrical and Gynecological Emergencies: Women’s Health on the Fly.

APRIL 4, 2013 ELIZABETH SHOULDICE, MD CCFP(EM) CCFP(EM) Academic Half Day Obstetrical and Gynecological Emergencies: Women’s Health on the Fly.

CASE PRESENTATION ``Heroes`` Isabel Alonzo-Proulx, CCFP(EM)

CASE PRESENTATION ``Heroes`` Isabel Alonzo-Proulx, CCFP(EM)

ANDREW JAMES CAVE, MB, MClSc, CCFP, FRCGP€¦  · Web viewReal World COPD Manual 2009 (primary care co-author) supported by Astra-Zeneca. ... (MED 526). University of Alberta, 1996

ANDREW JAMES CAVE, MB, MClSc, CCFP, FRCGP€¦  · Web viewReal World COPD Manual 2009 (primary care co-author) supported by Astra-Zeneca. ... (MED 526). University of Alberta, 1996

Submersion Injuries Richard Dionne MD CCFP-EM Avik Nath MD CCFP EM March 21, 2013.

Submersion Injuries Richard Dionne MD CCFP-EM Avik Nath MD CCFP EM March 21, 2013.

CCFP Roundtable 25th Annual Conference Presenters and ...ccfprtconference.weebly.com/.../7998708/presentersandspeakers-20… · CCFP Roundtable 25th Annual Conference Presenters and

CCFP Roundtable 25th Annual Conference Presenters and ...ccfprtconference.weebly.com/.../7998708/presentersandspeakers-20… · CCFP Roundtable 25th Annual Conference Presenters and

23rd Annual CCFP Roundtable Conference © erccfprtconference.weebly.com/uploads/7/9/9/8/7998708/... · 2019-11-10 · 23rd Annual CCFP Roundtable Conference CACFP Trending Presenters

23rd Annual CCFP Roundtable Conference © erccfprtconference.weebly.com/uploads/7/9/9/8/7998708/... · 2019-11-10 · 23rd Annual CCFP Roundtable Conference CACFP Trending Presenters

Canada Ottawa Parliament-Ottawa Heroes of the past-Ottawa.

Canada Ottawa Parliament-Ottawa Heroes of the past-Ottawa.

Lab Rounds Juliette Sacks CCFP-EM August 10, 2006.

Lab Rounds Juliette Sacks CCFP-EM August 10, 2006.

Russell Goldman MD, MPH, CCFP Ramona Mahtani MD, CCFP

Russell Goldman MD, MPH, CCFP Ramona Mahtani MD, CCFP

Leonard Bloom, MDCM, CCFP, FCFP, Department of Family Medicine, University of Ottawa

Leonard Bloom, MDCM, CCFP, FCFP, Department of Family Medicine, University of Ottawa

Dr. John Gannage MD CCFP

Dr. John Gannage MD CCFP

Collaborative Convective Forecast Product (CCFP)

Collaborative Convective Forecast Product (CCFP)

AWARDS OF RECOGNITION AND · PDF fileAWARDS OF RECOGNITION AND ACHIEVEMENT: ... Dr. Sarah Rice, CCFP, Ottawa, ON Low Risk Obstetrics- Return to Practice Training ... Juan Carlos Ochoa

AWARDS OF RECOGNITION AND · PDF fileAWARDS OF RECOGNITION AND ACHIEVEMENT: ... Dr. Sarah Rice, CCFP, Ottawa, ON Low Risk Obstetrics- Return to Practice Training ... Juan Carlos Ochoa

Back to Basics, 2014 Population Health: Periodic Health Exam, Dr. Trevor Arnason, MD, CCFP, PGY-3 PHPM University of Ottawa Department of Epidemiology.

Back to Basics, 2014 Population Health: Periodic Health Exam, Dr. Trevor Arnason, MD, CCFP, PGY-3 PHPM University of Ottawa Department of Epidemiology.

Kay-Anne Haykal OD. MD. CCFP Undergraduate Director, DFM

Kay-Anne Haykal OD. MD. CCFP Undergraduate Director, DFM

Dr. Franklin W. Walkine MB.BS., CCFP Family Physician.

Dr. Franklin W. Walkine MB.BS., CCFP Family Physician.

INTEGRATING COMMUNICATION SUPPORTS INTO PRIMARY CARE PRACTICE: INTERPRETERS, CULTURAL-BROKERS, AND GOOGLE TRANSLATE. Kevin Pottie, MD, CCFP, FCFP, Ottawa,

INTEGRATING COMMUNICATION SUPPORTS INTO PRIMARY CARE PRACTICE: INTERPRETERS, CULTURAL-BROKERS, AND GOOGLE TRANSLATE. Kevin Pottie, MD, CCFP, FCFP, Ottawa,

Submersion Injuries Richard Dionne MD CCFP-EM Assistant Professor Emergency Medicine - Ottawa Hospital-University of Ottawa Associate Medical Director.

Submersion Injuries Richard Dionne MD CCFP-EM Assistant Professor Emergency Medicine - Ottawa Hospital-University of Ottawa Associate Medical Director.

P Janssen, PhD, 1,2,4,5 , MC Klein, MD,CCFP 2,5

P Janssen, PhD, 1,2,4,5 , MC Klein, MD,CCFP 2,5