Are Dashboards the Magic Bullet?

Tara Nutley

MEASURE Evaluation | Palladium

Amanda Makulec

Advancing Partners & Communities |

JSI Research & Training Institute Inc.

Colleen McLaughlin

BroadReach Healthcare

MERLTech October 3, 2016

Are Dashboards the Magic Bullet

for Quicker, More Inclusive

Data-informed Decision Making?

Tara Nutley

MEASURE Evaluation – Palladium

Amanda Makulec

Advancing Partners & Communities – JSI

Colleen McLaughlin


Who we are…

mailto:[email protected]

How are data visualization tools

being used to improve the use of

data in HIV programs?

What impact do they have on

decision making?

What are key elements of success?

Contacted 45 people

from 17 PEPFAR

implementing partners

16 data viz

case examples

5 cited

specific data

use examples

Namibia

South Africa

Zambia

Tanzania

Four

case

examples

Collaborate with the end user to ID question(s)

Use proxy indicators when data are not available

Train on how to interpret the visualizations

Standardize data sources

Ensure data quality

Consider sustainability during development

Collaborate

with end

user

Proxy

Indicators

Analysis

Training

Standardize

data

sources

Ensure data

quality

Consider sustainability

S i x C o m m o n B e s t P r a c t i c e s

MEASURE Evaluation is funded by the U.S. Agency for

International Development (USAID) under terms of

Cooperative Agreement AID-OAA-L-14-00004 and

implemented by the Carolina Population Center, University

of North Carolina at Chapel Hill in partnership with ICF

International, John Snow, Inc., Management Sciences for

Health, Palladium Group, and Tulane University. The views

expressed in this presentation do not necessarily reflect the

views of USAID or the United States government.

www.measureevaluation.org

http://www.measureevaluation.org/







Colleen McLaughlin


©BROADREACH 2016 10

BroadReach Vantage: Using Data and

Analytics to Drive Decision Making

Colleen McLaughlin, Director Client Delivery

[email protected]

www.brhc.com

www.broadreachcorporation.com

October 3, 2016


http://www.brhc.com/

http://www.broadreachcorporation.com/


Case #1: Ministry of Health Executive Running a

District Health Program

Key Questions for Role:

• What is our overall performance for each of the health

priority areas?

• Upon which clinics and hospitals should we be focusing

our efforts to improve District health performance?

• How do I manage all the DOH reporting requirements?

• What are the key socioeconomic issues for my District’s

catchment population?

• Are there issues that may arise in the next 3-12 months that

will impact our performance and work?

• What is our strategy and operations plan for next year?

Where should we invest our resources and how much? Dr. Patel

Health Systems

Strengthening Manager

Uthungulu District

KwaZulu Natal

Department of Health

Before BroadReach Analytics:

• Unable to lead and manage department effectively, hold staff

accountable for performance due to lack of actionable

information

• Ineffective resource allocation and outcomes;

• Inefficient paper based reporting system which did not allow

easy assimilation and aggregation of data across

departments, teams, and health facilities


The performance module provides Dr. Patel with an

overview of district performance across key indicators

User navigates to the

Performance Module

under the modules tab.


He is able to quickly identify areas where

performance is below target

This view gives an

overview of the district’s

performance with regards

to various indicators

The percentage of adults

with viral loads done at 12

months (70.1%), is below

the 90% target.


Dr. Patel can then drill down to a cascade view to

determine where within the three 90’s he should focus

This view is an indication of

where the user needs to focus

in terms of the three 90s, being

testing, initiation and retention.

Viral Loads Done represent the

largest gap to target.


Dr. Patel can then identify the specific facilities

having the greatest negative impact on performance

A 12.8% increase in

performance if the

top 10 facilities with

the largest negative

impact reach target.

This view gives insight

into the impact of an

intervention on the HIV

program.


He can assess where to prioritize resources and

interventions to driven the greatest value

This view gives insight

into the impact of an

intervention on the HIV

program.

Only a 4.9%

increase in

performance if the

next 20 facilities with

the largest negative

impact reach target.


Finally Dr. Patel can predict the result of no

intervention being implemented

The trend for retention in care

is predicted to decrease to 65-

70% if no intervention is

implemented.

This view provides a

forecasted view of the

district’s performance.


Data visualization provides insights to drive decision

making and ultimately improve health outcomes

• Determine priority interventions.

• Determine where such interventions needed

to be focused, and therefore drive potential

improvements of:

• % of adults with VLD at 12 months by

12.8%,

• % of adults on ART at 12 months to

70-75%

As a result, Dr. Patel was

able to:

The visualization of data leads to insights that allow for actions and the

prioritization of resources, which ultimately improves the health and

wellbeing of underserved populations.

• Identify poor performing indicators.

• Identify poor performing facilities

• Understand the trend for the district’s

performance in the absence of an

intervention.

With the Vantage platform,

Dr. Patel was able to:


Practical Results: Dramatic Improvements in Viral Load

Completion Rate Seen in Ugu District, KZN South Africa

“Utilizing BroadReach Vantage, we have effectively prioritized resources,

identifying the facilities with the greatest negative impact on overall district

performance. Optimization of resources together with focused interventions

have resulted in significant improvements in viral load completion rates

for ART patients at a clinical level, from 32% to 92% in one year.”

— Kgomotso Nyandwi, BroadReach Nurse

Ensure data

quality

Analysis

Training

Collaborate

with end

user

C a s e E x a m p l e B e s t P r a c t i c e s

BroadReach Vantage

Additions from our experience:

• Keep it simple

• Dashboards are the first piece of the puzzle

Amanda Makulec



The Story of a

Community

Scorecard

Dashboard Zimbabwe

It all started with a

simple data placemat.

Note: Names of district and

clinics have been

anonymized for privacy

The partners were

interested in having the

data in a simple, routine

visual format.

So our APC team coached

the local M&E Officer to

build a simple pivot table

dashboard.

We recorded simple, step-

by-step custom videos

accessed in Zimbabwe

through a shared Dropbox.

Note: Names of health centers on

the slicer are covered for data

privacy. Slicer is designed as a filter

for users to select the Health

Centre of interest and view trends

in the selected indicators.

The final product was simple, but

very effective at showing quick

snapshots of trends to identify

success stories and challenges.

So what?

Challenges identified

Actions taken

Expanding use

Advocacy Issue Raised

from Score Card Actions Taken by the DHE

Shortage of STI drugs

Shortage of Infant ART

drugs

The DHE immediately phoned the respective nurse in Charge of the Clinics to send requests for

the drugs. The District Pharmacist was also tasked immediately to teach the respective nurse in

charge on how they should order the drugs on time.

The community / artisanal

miners were claiming

shortage of STIs drugs

The DHE responded by highlighting that the drugs were not in short supply but rather the problem

was defaulting patients which ended in them wanting second line STI drugs that were not available

at local clinic. The DHE agreed with CECHLA team to jointly carry out drugs/treatment literacy

interventions in areas served by this clinic.

One of the clinics was not

receiving RBF monies

Due to note receiving the funds, the clinic struggled to procure drugs in a timely manner. The

issues was presented to DHEs and RBF agents. The engagement resulted in Clinic receiving its first

RBF disbursement.

User fees very

unaffordable

Shortage of STI drugs

DHE promised to improve supply of drugs and also to reduce user fees in cases where the patients

are prescribed drugs when the clinic is out of supply.

Negative attitudes of

Health staff towards sex

workers

The nurse in charge at the local clinic and the HCC met and there is now positive/ improved

relationship between sex workers and health staff at the clinic.

“When people look at the trends, they

start to ask questions.” – CECHLA M&E Officer

Collaborate

with end

user

Analysis

Training

Consider

sustainability

C a s e E x a m p l e B e s t P r a c t i c e s

Zimbabwe Community Scorecard Dashboard


• Pick the right tool for the job

• Capacity building is critical

Collaborate

with end

user

Proxy

Indicators

Analysis

Training

Standardize

data sources

Ensure data

quality

Consider sustainability

C a s e E x a m p l e

B e s t P r a c t i c e s

What We Share


• Keep it simple

• Dashboards are the first piece of

the puzzle

• Pick the right tool for the job

• Capacity building is critical

Sharing ideas

& insights

Tara Nutley

MEASURE Evaluation – Palladium

[email protected]

Amanda Makulec


[email protected]

Colleen McLaughlin


[email protected]

Follow @MEASURE_Eval @APC_Project @BroadReachinfo





Are Dashboards the Magic Bullet?

Data & Analytics

Transcript of Are Dashboards the Magic Bullet?