Monitoring and Evaluationfor ACSM

Charlotte Colvin, PhDTB/HIV Technical Officer

PATH23 February 2010

M&E for ACSM

• What is the “status” of M&E for ACSM?– Opportunities!

• What are some of the key challenges and how can we address them?

• What are the next steps?

Principles of M&E for ACSMIs ACSM linked to overall NTP goal and objectives?

ACSM to increase KAP about TB?

• More political commitment for DOTS implementation

• Increased knowledge about the symptoms of TB

• Increased awareness about availability of free diagnosis and treatment

• Improved health seeking behavior

ACSM to increase case detection and treatment success?

• Increase in symptomatic individuals seeking care

• Increase in number of smear positive cases detected

• Improved case detection rate?

• Increase in number of people with TB who complete full course of treatment

• Improved treatment success rate?

Challenges of M&E for ACSM• Lack of capacity and dedicated staff• Need for standardized, practical indicators to

measure inputs, activities/tasks, outputs, outcomes, and impact

–??• Impact is particularly challenging:

– Implies that we can measure the contribution of an activity to improved NTP performance

– Multiple activities implemented to reach NTP case detection and treatment goals

– ACSM impact limited to specific events on the diagnostic and treatment pathway (Cough to Cure)

– When done correctly, impact can be VERY expensive and requires SIGNIFCANT human resources.

How can we overcome these challenges?

• Invest in basic M&E training for staff– Donor resources, on-line training, training

events• Creative partnerships

– Think outside the box!• Global work to improve indicator definitions (??)• Clearly link NTP goals, objectives, gaps, ACSM

activities, expected outputs, etc. with comprehensive frameworks

M&E Guide for ACSM (1)

• Rationale:– Need for comprehensive document to support

M&E needs of ACSM stakeholders

• Process:– Formation of M&E advisory group for ACSM

– Three drafts/reviews until now

– Fourth draft will include broader review

– Goal of completing final draft by December 15

M&E Guide for ACSM (2)

• Organization:– ACSM and M&E: the “basics” of both

– M&E Frameworks for ACSM: Links to ACSM planning cycle

– Indicators

– M&E Plans

– Challenges

– Practical applications

– Common M&E Strategies for ACSM: Mix of methods

– Appendices

M&E Guide for ACSM (3)

• Challenges:– Indicator section

– Technical detail: too much or too little?• Appendices?

– Realistic ACSM planning scenarios• Framework vs. reality

– Responsiveness to needs of partners• Ex, How useful for supporting Global Fund applications?

M&E Guide for ACSM (4)

• Feedback/Input Needed:– How much technical detail is needed? Are

there too many examples?

– Indicator quandary

– ACSM/M&E planning case study

– Field testing, tools, future training, roll out strategy

Comments/Questions/Discussion