Stronger health systems. Greater health impact.
Proximal, Distal and Everything In Between:
Measuring Organizational CapacityPresenter: Stephanie Calves, Dr. Reshma TrasiDate: March 7, 2014
2Management Sciences for Health
Agenda
• Guiding principles and frameworks • Standardized organizational capacity assessment• Benchmarking • 5 steps for measuring organizational capacity
3Management Sciences for Health
Is Capacity Building = the 500lb elephant with the blind men?
4Management Sciences for Health
Click to edit Master title style
First, some guiding principles…
5Management Sciences for Health
Principles for Measuring Capacity Development: The 7 Cs
Centrality
Complexity
Contextuality
Compre-hensiveness
Collaboration
Causality
Continuum
6Management Sciences for Health
Click to edit Master title style
Multiple frameworks exist!
7Management Sciences for Health
PEPFAR Framework
8Management Sciences for Health
World Bank Framework
9Management Sciences for Health
The Capabilities Framework
10Management Sciences for Health
The Human and Institutional Capacity Development Framework
11Management Sciences for Health
Capacity Development Cycle: Cyclical Process for Building Strong and Sustainable Organizations
ENGAGE
ASSESS
FORMULATEIMPLEMENT
EVALUATE
ENGAGE
ASSESS
FORMULATEIMPLEMENT
EVALUATE
ENGAGE
ASSESS
FORMIILATEIMPLEMENT
EVALUATE
Organizational CapacityWeak Strong
Org
aniz
atio
nal
Mat
uri
ty
Partner Lead, with External mentorshipExternally Lead and Supported
Sustainable Organization
12Management Sciences for Health
The Seed-to-Tree Growth Model
13Management Sciences for Health
…So, does this mean we need a standardized instrument
to measure capacity change over time?
…we’re glad you asked!
14Management Sciences for Health
Agenda
• Guiding principles and frameworks • Standardized organizational capacity assessment• Benchmarking• 5 steps for measuring organizational capacity
15Management Sciences for Health
MSH’s Standard Organizational Capacity Domains1. Governance and Leadership2. Resource Mobilization3. Financial Management and Operations4. Human Resource Management5. Grants and sub-grants Management6. Project/Program Management7. M&E, Communications, and Knowledge Management
Government 8. Coordination and Collaboration9. Service deliveryCSOs 10. Advocacy, Networking, and Alliance Building11. Service Delivery and Quality Assurance
16Management Sciences for Health
Standard application and delivery
Facilitation Pre-assessment: Alignment Meeting and
Stakeholder Engagement Pre-assessment: Orientation of Internal and
External Facilitators Assessment and Consensus Building Reporting Development of a capacity development plan Coaching and mentoring Repeat organizational capacity assessment
17Management Sciences for Health
Agenda
• Guiding principles and frameworks • Standardized organizational capacity assessment• Benchmarking• 5 steps for measuring organizational capacity
18Management Sciences for Health
What are Capacity Benchmarks?
Benchmark Definition: A standard or point of reference against which things may be compared or assessed.
Outcomes and/or outputs which reflect capacity, leadership, management, and accountability for functions within the organization.
Benchmarks should be linked to the M&E Plan.
Capacity Development Plan activities should aim to achieve the benchmarks. Not necessarily a 1-1 relationship
19Management Sciences for Health
Benchmarking Logic Model - Example
OWNERSHIP BENCHMARKS
TRANSITION OUTCOME
BENCHMARK
INDICATOR
INDICATOR
INDICATOR
BENCHMARK
INDICATOR
INDICATOR
INDICATOR
INDICATORSTransition
Outcome
ACTIVITIES
ACTIVITIES
20Management Sciences for Health
Benchmarking Logic Model
OwnershipBenchmarks
CHMT manages an effective QI
program through direct
oversight of clinical sites
All QI trainings in district are led by
CHMT Trainers
% of CHMTs with qualified QI trainers
% of QI trainings led by CHMT Trainers
% of QI officers completing QI recertification after 2 years
CHMTs conduct DQAs on QI Data
in Districts
% of CHMTs QI staff trained in DQAs
% of Districts where CHMT conducted DQA during the year
% of districts with 3 consecutive years of annual DQAs conducted by CHMT
Indicators
1. TOT on QI for CHMT Trainers
2. Mentor and evaluate trainers
1. Develop DQA process2. Train CHMT point
persons on process3. Mentorship during
DQA implementation
Transition
Outcome
Activities
21Management Sciences for Health
Agenda
• Guiding principles and frameworks • Standardizing organizational capacity
assessment: experience from 5 countries• Benchmarking: experience from Afghanistan• 5 steps for measuring organizational capacity
22Management Sciences for Health
5 Steps to developing an M&E plan
1. What change do you want to measure? Logic Model Input, process, output, outcome measures
Skills, behaviors, competencies Application of skills, behaviors, competencies Organizational performance Service delivery improvements
Benchmarks/milestones Centrality of the organization’s desired outcomes
2. How do you want to measure change? Standard instrument, applied uniformly Mixed methods
23Management Sciences for Health
5 Steps to developing an M&E plan
3. How often? For how long? Sustainable performance
4. How will the data be analyzed and used? Automation for immediate sharing and use
5. Review. Refine. Revise. Standardize.
24Management Sciences for Health
Examples of Automation: Instant Results and Analysis
Governance
Planning & Resource Mobilisation
Financial Planning & Management
Grants Management
Human Resource Management
Communication
Project Management
Monitoring & Evaluation
4
3
4
4
3
3
3
3
25Management Sciences for Health
Agenda
Guiding principles and frameworks Standardizing organizational capacity assessment:
experience from 5 countriesBenchmarking: experience from Afghanistan5 steps for measuring organizational capacity
26Management Sciences for Health
Stronger health systems. Greater health impact.
The Closing Session will begin at4pm in the Grand Ballroom.
Closing remarks will be followed bya 30-minute social gathering
(refreshments will be served). Comemeet new people and discuss the
highlights of the day!
Please fill out an evaluation by going
to this session’s page on your mobile app OR by filling out a paper evaluation in the back of the
room.
Thank you!
Top Related