External Evaluation HIV/AIDS Workplace Policies and Programmes GTZ / ILO Partnership 2003 - 2007...

11
Z egers T Q M @ A cumanage.com External Evaluation HIV/AIDS Workplace Policies and Programmes GTZ / ILO Partnership 2003 - 2007 Strategic Perspective and Impact

Transcript of External Evaluation HIV/AIDS Workplace Policies and Programmes GTZ / ILO Partnership 2003 - 2007...

Page 1: External Evaluation HIV/AIDS Workplace Policies and Programmes GTZ / ILO Partnership 2003 - 2007 Strategic Perspective and Impact.

Zegers TQM @ Acumanage.com

External Evaluation

HIV/AIDS Workplace Policies and Programmes

GTZ / ILO Partnership 2003 - 2007

Strategic Perspective and Impact

Page 2: External Evaluation HIV/AIDS Workplace Policies and Programmes GTZ / ILO Partnership 2003 - 2007 Strategic Perspective and Impact.

ILO/GTZ-20070910 2Zegers TQM @ Acumanage.com

Beneficiary opinion

Performance: Combined overall efficiency and effectiveness

81.1%

86.5%

90.7%

0.0% 0.0% 0.0%

9.3%

48.8%

41.9%

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

- Extremely low Low Below average Above average High Extremelyhigh

- Force Mean Q index

Survey population = 53

Government8

15%

Trade Unions10

19%

Employers7

13%Civil Society

917%

Experts8

15%

UN Agencies11

21%

Page 3: External Evaluation HIV/AIDS Workplace Policies and Programmes GTZ / ILO Partnership 2003 - 2007 Strategic Perspective and Impact.

ILO/GTZ-20070910 3Zegers TQM @ Acumanage.com

Methodology

Desk Review

Discussions with Project staff

Collection and Review of Accounting Data

Design of Survey to Assess Performance

Data collection: multiple processes

Country visits: Moldova & Ukraine

Data analysis

Validation

Report

Page 4: External Evaluation HIV/AIDS Workplace Policies and Programmes GTZ / ILO Partnership 2003 - 2007 Strategic Perspective and Impact.

ILO/GTZ-20070910 4Zegers TQM @ Acumanage.com

Evaluation objectives

Validity of design

Assessment of Performance

Typical LFAField Project

Strategic Impact

ProjectDocumen

t

• Governance & Legislation

• Public/Private Partnerships

• Institutionalisation at Workplace

• Access to international funding

Page 5: External Evaluation HIV/AIDS Workplace Policies and Programmes GTZ / ILO Partnership 2003 - 2007 Strategic Perspective and Impact.

ILO/GTZ-20070910 5Zegers TQM @ Acumanage.com

Project budget - Total: USD 2'513'000

Staff resources

Substantive Activities

Programme Support

Monitoring & Evaluation

0.00

100'000.00

200'000.00

300'000.00

400'000.00

500'000.00

600'000.00

700'000.00

800'000.00

2003 2004 2005 2006 2007 Q1&2

Staff resources Substantive Activities Programme Support Monitoring & Evaluation

Process

Project expenditure by budget line - Total to 8 May 2007 USD 2'366'000.86

Staff costs

Travel

Seminars

Programme Support

Administrative Support

External Collaborators National Experts

Miscellaneous

Equipment & Furniture

0.00

100'000.00

200'000.00

300'000.00

400'000.00

500'000.00

600'000.00

700'000.00

800'000.00

2003 2004 2005 2006 2007 Q1 only '

Staff costs Seminars Travel Programme Support Administrative Support External Collaborators National Experts Miscellaneous Equipment & Furniture

Page 6: External Evaluation HIV/AIDS Workplace Policies and Programmes GTZ / ILO Partnership 2003 - 2007 Strategic Perspective and Impact.

ILO/GTZ-20070910 6Zegers TQM @ Acumanage.com

Budget & expenditure performance - Projection: USD 2'509'894.72 *

226'671.00

174'153.00

-133'019.36

-264'184.36

-514.99

3'105.28

Budget756'500.00

Budget756'500.00

Budget356'363.64 Budget

356'363.64 Budget, 287'272.73

Expenditure529'829.00

Expenditure582'347.00

Expenditure489'383.00

Expenditure620'548.00

Expenditure, 287'787.72

-400'000.00

-200'000.00

0.00

200'000.00

400'000.00

600'000.00

800'000.00

1'000'000.00

2003 2004 2005 2006 2007 Q1&2* Surplus/Deficit

* Projection based on 2007 Q1 expenditure

Process

Response to strategy

Page 7: External Evaluation HIV/AIDS Workplace Policies and Programmes GTZ / ILO Partnership 2003 - 2007 Strategic Perspective and Impact.

ILO/GTZ-20070910 7Zegers TQM @ Acumanage.com

Impact and achievements

Advocacy 2003: 3 international events

– 300 high-level officials 2004: 7 international events

– 300 high-level stakeholders

2005: 3 international events – 400 high-level stakeholders

2006: 5 international events – 300 high-level stakeholders

2007: 1 international event – 300 high-level stakeholders

Training 2003: 100 tripartite leaders 2004: 250 tripartite leaders

2005: 7 sub-regional and

national events – 400 tripartite leaders

2006: 12 sub-regional and national events – 300 tripartite leaders

2006: 7 national events – 90 tripartite leaders

Research and Knowledge-sharing Contribution to translations, print and reprint of ILO Code into 11

languages and Application Manual into 4 new languages. 5 publications on impact of HIV/AIDS in the Workplace Major impact of publications: China, Russia, Indonesia, Brazil,

Mozambique, Tanzania and Swaziland. [Ukraine & Moldova]

Page 8: External Evaluation HIV/AIDS Workplace Policies and Programmes GTZ / ILO Partnership 2003 - 2007 Strategic Perspective and Impact.

ILO/GTZ-20070910 8Zegers TQM @ Acumanage.com

Strategic conclusions

Not all countries respond equally to strategy advocacy

Advocacy requires substantial risk funding

LFA approach does not necessarily work for advocacy projects

LFA approach offers advantages that are underused in research and country projects

Page 9: External Evaluation HIV/AIDS Workplace Policies and Programmes GTZ / ILO Partnership 2003 - 2007 Strategic Perspective and Impact.

ILO/GTZ-20070910 9Zegers TQM @ Acumanage.com

Conclusions on Project Implementation

The Project is well-established within ILO Models were developed according to Project

Strategy Awareness was increased amongst decision-

makers HIV/AIDS can occupy a significant position at WP Genuine tripartite collaboration can be achieved

in the WP Project Staff were well selected and are motivated Future sustainability remains a challenge Current size of staff is insufficient Strategy development and support to country

projects require different approaches

Page 10: External Evaluation HIV/AIDS Workplace Policies and Programmes GTZ / ILO Partnership 2003 - 2007 Strategic Perspective and Impact.

ILO/GTZ-20070910 10Zegers TQM @ Acumanage.com

Recommendations to achieve impact

Maintain and achieve labour legislation reform Ensure continuous training of trainers Sustain and expand leaders’ awareness Correct wrong assumptions about the role of ILO Increase KS through increased use of new

technology and media Create sustainable structures outside the ILO Organise high-level conferences at country level to

develop structures & systems & involve stakeholders

Identify and promote replicable best practice Systematise project management within

ILO-HIV/AIDS

Page 11: External Evaluation HIV/AIDS Workplace Policies and Programmes GTZ / ILO Partnership 2003 - 2007 Strategic Perspective and Impact.

ILO/GTZ-20070910 11Zegers TQM @ Acumanage.com

Best practice to capture

Interpipe Corporation – Ukraine Education Sector – Ukraine Children and HIV/AIDS in Ukraine (Olena

Franchuk Foundation) Union Fenosa Group – Moldova (a tripartite

success) Moldova’s International centre for promoting

women in business ILO/GTZ Impact on Labour Legislation

(a comparative experience Moldova & Uraine) Conditions for HIV/AIDS WP strategy development