Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional...
Transcript of Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional...
![Page 1: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/1.jpg)
PROSALUD
The Fully Functional Service Delivery Point in Nicaragua
and other Highlights
![Page 2: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/2.jpg)
Overview of PROSALUD
![Page 3: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/3.jpg)
Basic Project Data
• Financing: US$10.2 million (USAID)• Duration: 1999 – 2003 (50 months)• Location: North Central Nicaragua• Target Population: Approx. 1 million• Partners: MOH, CARE, HOPE, POA• Sub-contractor: JHU CCP for the IEC component• Staff: 15-20 Nicaraguan professionals
![Page 4: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/4.jpg)
MUNICIPIOS ATENDIDOS POR MUNICIPIOS ATENDIDOS POR PROSALUDPROSALUD
![Page 5: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/5.jpg)
Some Project Characteristics
Focused on the municipal level
Aimed at strengthening the bases for decentralization
Strong community and IEC components
Fully Functional Service Delivery Point as main institutional focus
![Page 6: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/6.jpg)
Characteristics of the Target Population
• Mothers:– 66% functionally illiterate– 19% single– 17 years average age of first pregnancy
• Households– 56% no piped water in home or on premises– 32% no sanitary disposal of human waste
• Municipalities– 6 of 12 are extreme poverty– The remainder are high poverty
From 2001 Household Survey
![Page 7: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/7.jpg)
Expected Results
1. Improved maternal and infant nutrition.2. Improved child survival practices and services.3. Improved reproductive health practices and services.
![Page 8: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/8.jpg)
PROSALUD AND THE FFSDP
![Page 9: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/9.jpg)
Challenges faced
1. Operationally defining FFSDP2. Measuring advances in FFSDP3. Using results of measurement of advances for decision-
making4. Adjusting the operational framework as we learned5. Causally linking advances in FFSDP with improved
results6. Institutionalizing the FFSDP
![Page 10: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/10.jpg)
or What is a FFSDP?
• We didn’t know what it meant operationally.• Boston didn’t know or wouldn’t confess.• So we:
– adapted it to mean fully functional MOH health units.– developed specific criteria for each of the 10 criteria– and developed standards for each specific criterion
1. Operationally defining FFSDP
![Page 11: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/11.jpg)
Operationalizing the FFSDP
General Criteria (10)
Specific Criteria (40)
Expected Results (40)
Standards (208)
Verification Guide
![Page 12: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/12.jpg)
ExampleAd
equa
te M
anag
emen
t Motivated personnel working as a team
Organization of health services
Planning
Information system with timely and quality data
Monitoring and evaluation system functioning
Financial analysis
CRITERION 6 SPECIFIC CRITERIA
![Page 13: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/13.jpg)
2. Measuring advances
• We developed standards for each specific criterion that aimed to be:– Objective
• Replicable• Verifiable
– Sensitive to change• Verification Guide
– Specific instructions for application– Applied on quarterly or trimester basis– Has a total of 100 points for each specific criterion
![Page 14: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/14.jpg)
ExamplePL
ANN
ING
(HEA
LTH
C
ENTE
RS)
Has an Annual Operational Plan 20
Director has a monthly activity plan
Program service goals by year and month exist
Shows evidence of having carried out some of the programmed activities
Has a Disaster Plan
15
20
30
15
STANDARDSSPECIFIC CRITERION
![Page 15: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/15.jpg)
Process Results
21
60
8183
0
20
40
60
80
100
Jan-01 Nov-01 Dec-02 Goal 03
Criteria 1-9 Average Results for 55 health units
![Page 16: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/16.jpg)
3. What do we do with the information?
• The application of the Verification Guide solved one problem: We could report to USAID advances on FFSDP but…
• It was a lot of information to analyze:– 55 health units x 208 standards = 11,440 data points
• How do we analyze the results?– We tried various schemes settling finally on the
“Methodology of Exclusion”
![Page 17: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/17.jpg)
The Methodology of Exclusion (1)
1. Use 6 indicators to identify problem municipalities.1. BCG coverage in < 1 y at least 80%2. DPT coverage in < 1 y at least 80%3. IMCI coverage at least 70%4. Prenatal care coverage at least 70%5. Prenatal visits > 2.5 per pregnancy6. FP coverage >40% WFA
2. For the municipalities with most failures to meet indicator goals (Criterion 10), identify in which specific criteria they are falling short of specific criterion goals (Criteria 1-9).
![Page 18: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/18.jpg)
The Methodology of Exclusion (2)
4. Identify in which of these specific criteria there has been little or no progress since the last monitoring.
5. Develop an intervention plan for these municipalities oriented at those specific criteria.
![Page 19: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/19.jpg)
Analysis of Results
Verification Guide
DIAGNOSIS/
MONITORING
ANALYSIS
INTERVENCIONEVALUATION OF INTERVENTION
Methodology of
Exclusion
FFSDP Toolbox
![Page 20: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/20.jpg)
Infrastructure
Equipment
Supplies
Personnel Training
Management
CommunitySupport
CommunityOutreach
Quality
FFSDPFFSDP
Impact
Resources Processes
10
1
4
3
2
5
6
7
98
4. Our initial operational framework
![Page 21: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/21.jpg)
Why adjust our Conceptual Framework?
• Health unit personnel complained that they received “low” scores on things that were out of their control:– Infrastructure– Equipment– Assignment of adequate personnel– Supplies
• Quality is more of an outcome than an input.• Confusion between “impact” and “results” or
“outcomes”.
![Page 22: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/22.jpg)
• INFRA-ESTRUCTURA
• EQUIPAMIENTO
• SUMINISTROS
• PERSONAL
• COMMUNITY
SUPPORT (ACTIVISM)
MANAGEMENT
SERVICE QUALITY
COMMUNITY SUPPORT
TRAINING
SERVICE PRODUCTION COVERAGETECHNICAL QUALITY OF SERVICES PROVIDEDCLIENT SATISFACTION:
ExternalInternal
INTEGRATEDNESS OF ATTENTION (ABSENCE OF LOST OPPORTUNITIES)HEALTH PRACTICES IN THE COMMUNITY
HEALTH STATUS OF THE
POPULATION
Vital Statistics
Household Surveys
Resources Processes Results/Outcomes Impact
INPUTS PROCESS OUTPUTS OUTCOMES
A systems approach to FFSDP
![Page 23: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/23.jpg)
How do we try to causally link FFSDP to improved outcomes?
• Compare PROSALUD municipalities to non-PROSALUD in terms of outcomes– Household survey
• DHS vs. PROSALUD• 1 control municipality in the final survey
– MINSA data• PROSALUD vs. non-PROSALUD municipalities
– Regression analysis
![Page 24: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/24.jpg)
PROSALUD M & E Processes
SemiannuallyExit interviewsResultsClinent Satisfaction
QuaterlySemiannually
IMCI and IWC Monitoring and Supervision Guides
ResultsQuality of Integrated MCH Health Care
TrimesterFFSDPVerification Guide
ProcessesResources
Monitor advance towards FFSDP
QuarterlyMOH StatisticsResultsMonitor Results
Baseline (2001)Midline (2002)End Line (2003)
Household surveysImpactResults
Evaluate Impact and Results
PeriodicityInstrumentLevelPurpose
![Page 25: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/25.jpg)
PROSALUD Household Survey Comparison with DHS
Indicator Change DHS
Change PROSALUD
BCG in children < 1 year + 0.2 +1.3
DPT in children < 1 year +3.7 +19.8
Children 12-23 months with complete vaccination for age
-9.5 +3.9
% use of moden contraceptives in women in union
+8.6 +5.0
% coverage with professional prenatal care +4.0 +18.7
![Page 26: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/26.jpg)
Comparison between PROSALUD & non-PROSALUD municipalities
# of FP services provided
# of prenatal visits
# of visits by children < 1 y
WithProsalud
WithoutProsalud
WithProsalud
WithoutProsalud
WithProsalud
WithoutProsalud
Matagalpa + 4.95 +3.18 +0.12 - 5.17 -0.31 -7.60
Jinotega +16.28 + 6.17 - 1.60 - 3.86 +7.57 -9.57
Boaco +12.10 +22.30 +1.28 -10.97 +8.16 +0.31
![Page 27: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/27.jpg)
Regression Analysis
• Looked for correlation between higher scores in criteria 1-9 (independent variables) and a more robust criteria 10.– More robust in that some additional outcome indicators
were added.
![Page 28: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/28.jpg)
Results of Regression Analysis
![Page 29: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/29.jpg)
Institutionalizing FFSDP – How?
• Successful marketing to PVO partners.• Need to let MOH know about expansion.• New MOH authorities wanted to evaluate health services but
didn’t have a means.• They asked us to work with others in evaluating existing
instruments and adapting them to MINSA.
![Page 30: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/30.jpg)
Institutionalizing-How?
• Assignment of counterparts• Involvement of other stakeholders• Persistent collaboration of PROSALUD staff, talented
counterparts and 8 months or work.• MINSA FFSDP Verification Guide being validated now in 18
municipalities.
![Page 31: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/31.jpg)
Institutionalizing-What?
• Presently– The Verification Guide
• Pending, but implicit in the above:– Toolbox for interventions
• Hopefully– The underlying concept– The tool for analysis
![Page 32: Barry Smith Presentation: The Fully Functional …...Barry Smith Presentation: The Fully Functional Service Delivery Point in Nicaragua and other Highlights Author MSH, Barry Smith](https://reader034.fdocuments.in/reader034/viewer/2022042709/5f430d17a734275dbc2d02ed/html5/thumbnails/32.jpg)