Evaluation Report Vooma Weekend (1-3 Oct)
Transcript of Evaluation Report Vooma Weekend (1-3 Oct)
Evaluation Report
Vooma Weekend (1-3 Oct)
8 October 2021
Dr David Harrison, Demand Acceleration Lead
Dr Lesley Bamford, Vaccination Programme Coordinator
Mr Gaurang Tanna, Service Delivery Workstream Coordinator
For enabling and undertaking this analysis:
• Milani Wolmarans and the EVDS teams
• Julia Michalow and the Genesis-Analytics team
22
Guide to this report
Rationale• Summary of the rationale for the Vooma Vaccination Weekend
Key takeaways and next steps
Overview of Vooma Vaccination Weekend strategy
Analysis of 3 day vaccination uptake• Fri-Sun 1-3 Oct
Note of appreciation
Analysis of two day weekend-only vaccination uptake• Sat-Sun 2-3 Oct• To assess potential vaccination uptake when more sites open on
Saturdays and Sundays
Target: Achieve 70% coverage of people aged 18 and older by the end of 2021
Effort required
Vaccination coverage (% of
adult population having received at least one dose)
0
70%
Vaccination uptake effort curve
34%WE ARE HERE08.10.2021 People
willing and able or open to persuasion
People willing if personal costs or constraints reduced
People unwilling or resistant
5
OBJECTIVE 1: Prevent as much severe Covid-19 disease and death as we can as quickly as possible
0 10 20 30 40 50 60 70 80
Northern Cape
Mpumalanga
North West
Gauteng
SA AVERAGE
Free State
KwaZulu-Natal
Eastern Cape
Western Cape
Limpopo
Percent
First dose coverage in people 60+ (as at 5 Oct 2021)
0 10 20 30 40 50 60 70
Mpumalanga
North West
Gauteng
KwaZulu-Natal
Northern Cape
SA AVERAGE
Western Cape
Free State
Limpopo
Eastern Cape
Percent
First dose coverage in people 50-59 yrs(as at 5 Oct 2021)
6
OBJECTIVE 2: Maximize population coverage (First dose & full vaccination coverage)
0 5 10 15 20 25 30 35 40 45
Mpumalanga
Gauteng
KwaZulu-Natal
Northern Cape
North West
SA AVERAGE
Free State
Eastern Cape
Limpopo
Western Cape
Percent
Vaccination coverage by province (as at 8 Oct 2021)
1st dose Fully vaccinated
88
0
20
40
60
80
100
120
Per
cen
t
First dose coverage by self-reported health insurance status of people 60+ yrs (5 Oct 2021)
Insured Uninsured
0
10
20
30
40
50
60
70
80
90
100
Perc
ent
First dose coverage by self-reported health insurance status of people 50-59 yrs (5 Oct 2021)
Insured Uninsured
The rate of vaccination is lower among people without medical aid (‘uninsured’)
9
Geographical Prioritisation
Prioritisation based on 2 key metrics:
Indicator Definition Time period Target for prioritisation
Number unvaccinated Number of individuals who have not received a single dose of the COVID-19 vaccine
Up to 12 September Determined by province, district and sub-disttrict
First dose vaccination coverage
Numerator: Number of individuals who have received at least one dose of the COVID-19 vaccine (J&J or 1st Dose Pfizer)
Denominator: Number of individuals in the population
Up to 12 September First dose vaccination coverage < 19% is below the national average
Go where the LARGEST unvaccinated persons are…..
….. but DO NOT leave those behind with LOWEST coverages (for equity reasons)
10
Based on these metrics, our highest priority districts are ….
Province District
ECNelson Mandela Bay Metro
O R Tambo
FS T Mofutsanyana(district with lowest coverage in province)
GP
Ekurhuleni MM
Johannesburg MM
Sedibeng DM
Tshwane MM
KZN
Amajuba DM
eThekwini MM
iLembe DM
Umzinyathi DM
Uthukela DM
Zululand DM
Province District
LP Vhembe
MPUEhlanzeni DM
G Sibande DM
Nkangala DM
NCJ T Gaetsewe DM
Pixley ka Seme DM
NWBojanala Platinum DM
Ruth Segomotsi Mompati DM
WC Cape Town
1111
Demand Acceleration: Key strategies
Public Leadership
•Vaccination Campaign Weekend
•Collective statement of commitment
•Celebrity & leader vaccinations
Clear and unambiguous
communication
•Policy clarity
•Tighten communications pipeline
•Behavioural nudges
•Signage at sites
Media & marketing campaign platforms
•Radio
•TV
•Social media
•Retail space & corporate platforms
Social Mobilisation
•Outbound use of National Contact Centre
•Networks (civil society, business, labour, govt)
•District-wide mobilisation
•Social media analytics & rebuttal
Incentives
•Private sector offered incentives
• Investigate national incentive scheme
12
Overview of Vooma Vaccination Weekend strategy
01-03 Oct 2021
Aim:To mobilise nation-wide leadership to help accelerate demand for vaccination
13
# 15 million more by Christmas“We can save 20,000 lives if we vaccinate 70% of adults by the end of the year”
Vaccination Vooma Weekend (1 - 3 October 2021)
National call to action:President called on every Premier and Mayor to convene a COVID-19 compliant event on 1-3 October to demonstrate collective leadership
and support for the vaccination programme.
Clear and unequivocal leadership• Bring together leadership from
across the political spectrum, civil society, traditional leaders, labour and business.
Vaccination sites openProvinces and private sector to open vaccination sites:Target 500,000 vaccinations
BUILD UP• Announce and call to action• Focused communications & media
engagement• Enlist leadership across all sectors of
society to get behind the events and declare support
NATIONAL ACTIVATION• Provinces to ensure enough
vaccination sites across SA open and sufficiently staffed
EVENTS IN EVERY DISTRICT• Invite select number of leaders (COVID compliant)• Mobilise sports and other icons• Mobilise local media mobilise• Recognise health workers and health managers• Recognise young people and other volunteers who
have contribute significantly
Events in every district• Led by President, Premiers and Mayors• Joined by sports personalities, musicians
and other celebrities of arts & culture
1 2 3
14
President’s Call to Action
Similar letters sent to leaders of civil society, traditional leaders, unions and business
1
2
3
4
5
6
7
8 9
10
11
12
13
14
15
16 17
18
19
20
2122
2324
25
26
27
28
29
30
31
3233
34
35
36
37
3839
40
41
42
43
44
45
46
47
48
49
50
51
52
1. West Coast
2. Cape Winelands
3. Overberg
4. Eden
5. Central Karoo
6. Namakwa
7. Pixley ka Seme
8. Siyanda
9. Frances Baard
10. Cacadu
11. Amathole
12. Chris Hani
13. Joe Gqabi
14. OR Tambo
15. Xhariep
16. Lejweleputswa
17. Thabo Mofutsanyana
18. Fezile Dabi
19. Ugu
20. uMgungundlovu
21. uThukela
22. uMzinyathi
23. Amajuba
24. Zululand
25. uMkhanyakude
26. uThungulu
27. iLembe
28. Gert Sibande
29. Nkangala
30. Ehlanzeni
31. Mopani
32. Vhembe
33. Capricorn
34. Waterberg
35. Bojanala Platinum
36. Ngaka Modiri Molema
37. Dr Ruth Segomotsi Mompati
38. Dr Kenneth Kaunda
39. Sedibeng
40. Sisonke
41. Alfred Nzo
42. ohn Taolo Gaetsewe
43. Sekhukhune
44. West Rand
45. Buffalo City
46. City of Cape Town
47. Ekurhuleni
48. eThekwini
49. City of Johannesburg
50. Mangaung
51. Nelson Mandela Bay
52. City of Tshwane
District Municipalities Metropolitan Municipalities
Vooma Vaccination events 1st & 2nd October 2021
Reported: 88 events in 43 districts
16
Recognition to best performing provinces
Best performing provinces
1.Eastern Cape
2.Limpopo
3.Western Cape
Ranking Criteria:• Risk reduction – First dose coverage
50+ and women: men ratio• Coverage - First dose coverage 18+ • Equity - Ratio uninsured: insured
(Rankings as at 15 September 2021)
Province (cumulative to 15 Sep)Eastern Cape
Free State Gauteng
KwaZulu-Natal Limpopo
Mpumalanga
North West
Northern Cape
Western Cape
First dose vaccination coverage, 20+ 33.00% 30.00% 25.00% 25.00% 32.00% 20.00% 23.00% 27.00% 36.00%
First dose vaccination coverage, 20+ insured 49.55% 50.71% 45.69% 54% 60% 32.16% 46.78% 41.89% 68%
First dose vaccination coverage, 20+ uninsured 32.5% 28.8% 21.4% 23.1% 31.1% 20.9% 21.1% 26.5% 30.0%
Ratio of insured:uninsured, first dose vaccination coverage, 20+ 1.53 1.76 2.14 2.33 1.92 1.54 2.21 1.58 2.27
First dose vaccination coverage, 50+ 60% 55.5% 47.7% 54.4% 64.2% 43.4% 43.3% 45.4% 58.6%
First dose vaccination coverage, 50+ males 63% 55.2% 45.8% 54.6% 68.7% 43.2% 43.4% 47.3% 58.5%
First dose vaccination coverage, 50+ females 58.9% 55.7% 49.5% 54.3% 61.8% 43.5% 43.3% 43.9% 58.6%
Ratio of women:men, first dose vaccination coverage, 50+ 0.93 1.01 1.08 1.00 0.90 1.01 1.00 0.93 1.00
Indicator (cumulative to 15 September) EC FS GP KZN LP MP NW NC WC
First dose vaccination coverage, 18+ 2 1 3
First dose vaccination coverage, 18+ insured 1 2 3
First dose vaccination coverage, 18+ uninsured 3 3 2
Ratio of insured:uninsured, first dose vaccination coverage, 18+ 3 2 1
First dose vaccination coverage, 50+ 2 3 1
First dose vaccination coverage, 50+ males 2 1 3
First dose vaccination coverage, 50+ females 2 3 1
Ratio of women:men first dose vaccination coverage, 50+ 3 1 2
Scores
Objective 2 : Maximise coverage 5 0 0 0 1 2 0 1 3
Objective 1: Minimise mortality and morbidity 5 0 0 0 4 0 0 2 1
TOTAL 10 0 0 0 5 2 0 3 4
18
Recognition of high-performing districts
ROLE INDICATORS
MANAGEMENT,
LEADERSHIP AND
INNOVATION
Effective planning and programme execution
Effective management of supply and demand
Innovation and responsiveness to supply and demand challenges
Ability to harness the full capacity of the district in support of vaccinations
FOCUS ON HIGH RISK/
VULNERABLE GROUPS
Effective strategies to prioritise people aged 50+
Effective outreach strategies to reach under-serviced communities
DEMAND
ACCELERATION
Highly effective communication plans leading to increased uptake Highest proportion
of community engagements / responses Strategies to make it easier for people to get
vaccinated
Involvement of non-government partners
SERVICE DELIVERY Highest proportion of vaccinations administered, expressed as a proportion of the total
population:
Sub-categories:
18 - 34 years; 35 - 49 years; 50 years + Age Group
STOCK MANAGEMENT Most effective vaccination storage and local distribution
Pre-emptive strategies to prevent stock-outs
PUBLIC-PRIVATE
COLLABORATION
Effective use of private sector facilities for vaccination of people without medical
insurance
Province nominated Districts
Eastern Cape Amathole
Free State -
Gauteng Tshwane
KwaZulu-Natal Mgungundlovu
Limpopo Mopani
Mpumalanga -
Northern Cape -
North West Dr KennethKaunda
Western Cape Overberg
19
Recognition of high-performing sub-district teams
DISTRICT NOMINATION
In this category, we recognised the efforts of our 213 sub-districts that have supported the vaccination programme. Each district was requested to
nominate ONE ward-based outreach, community activators or vaccination site team (depending on the category) for each district
ROLE CATEGORIES MATRIX/INDICATORS (these are guidelines and District Teams were requested to use
their own best judgement)
Building
demand in
communities
Most effective Ward-Based Outreach / CHW
Team
Highest number of households reached
Outstanding Community Based Activators (non-
government)
This category recognises religious groups, NGO’s, CBO’s, traditional leadership, trade
unions or and other groupings driving the uptake of vaccinations in each sub-district
through communications and social mobilisation.
Efficiency and
quality at
vaccination
sites
Most Effective Vaccination Site (public)
Sub-district with the most accurate and updated data on EVDS Updated information on the stock visibility system Efficient data capturing teams Qualitative assessment of team effectiveness and user-friendliness Innovations in expanding access Ensuring participation of people with disabilitiesMost Effective Vaccination Site (private)
Innovative
partnerships
Most Innovative Partnerships to promote
vaccination uptake
This category recognises any innovative partnerships to expand access (outreach or
transport solutions) or to incentivise participation in the vaccination programme
Coverage of Vooma
Vaccination Weekend
Article Sentiment
N = 107 (by Monday 4 Oct)
Positive33%
Neutral61%
Negative6%
20
Vaccination trends in the past month (8 Sept – 7 Oct 2021)
355,000 vaccinations achieved over the weekend, and upward trend has been sustained.
1st dose vaccinations up 26%:Weekday average in the week following of 106,393 compared to average of 84,121 for weekdays in the previous 2 weeks (excluding the Heritage Day holiday).
But this average is still far too low: 1st
dose vaccinations need to average 250,00 a day to achieve the target of 70% adult coverage by end of the year.
0
50,000
100,000
150,000
200,000
250,000
8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 1 2 3 4 5 6 7 8
Total and (1st Pfizer + J&J) 08 Sep - 08 Oct 2021
Total J&J or 1st dose
Pre-Voomamedia
23
Sites open over weekend (Fri- Sun)
Weekend 1-3 Oct 2021 1 Oct 2021 2 Oct 2021 3 Oct 2021
Eastern Cape 369 367 240 183Private 42 40 42 2Public 327 327 198 181
Free State 119 93 73 22Private 25 25 25Public 94 68 48 22
Gauteng 844 843 349 135Private 199 198 199 1Public 645 645 150 134
KwaZulu-Natal 329 254 225 104Private 78 77 78 1Public 251 177 147 103
Limpopo 78 61 78 2Private 51 51 51 2Public 27 10 27
Mpumalanga 88 84 81Private 36 36 36Public 52 48 45
North West 90 88 88Private 17 17 17Public 73 71 71
Northern Cape 79 50 51 7Private 7 7 7Public 72 43 44 7
Western Cape 328 289 207 53Private 125 125 125Public 203 164 82 53
Grand Total 2324 2129 1392 506
Planned sites
There were 16% more sites open on Voomaweekend relative to the average over previous weekends in September (excl. Heritage Day weekend).
Actual sites
Comparing the number of vaccinations per weekend
Number of Vaccinations by WeekendCompared to previous weekends in September (excl Heritage Day weekend), Vooma achieved a14% increase in total number of
vaccinations.
Vooma achieved a 28% increasein total vaccinations compared to what was expected during 1-3 October.
Number of weekend first dose vaccinations
Compared to previous weekends in September (excl Heritage Day weekend), Vooma achieved a 16% increase in first dose vaccinations.
Vooma achieved a 25% increasein first dose vaccinations compared to what was expected over 1-3 October.
Comparing total vaccinations per weekend, by insurance status
Total Vaccinations by Weekend (Fri + Sat + Sun)
Uninsured population● Compared to previous weekends in September (excl Heritage Day weekend),
Vooma achieved 21% increase in total vaccinations.● Compared to the expected total vaccinations during 1-3 October, Vooma achieved
23% increase in total vaccinations.
Insured population● Compared to previous weekends in September (excl Heritage Day weekend),
Vooma achieved 10% decrease in total vaccinations.● Compared to the expected total vaccinations during 1-3 October, Vooma achieved
45% increase in total vaccinations.
45%
23%
Comparing first dose vaccinations per weekend, by insurance status
First Dose Vaccinations by Weekend (Fri + Sat + Sun)
Uninsured population● Compared to previous weekends in September (excl Heritage Day weekend),
Vooma achieved 25% increase in first dose vaccinations.● Compared to the expected first dose vaccinations during 1-3 October, Vooma
achieved 22% increase in first dose vaccinations.
Insured population● Compared to previous weekends in September (excl Heritage Day weekend),
Vooma achieved 40% decrease in first dose vaccinations.● Compared to the expected first dose vaccinations during 1-3 October, Vooma
achieved 15% increase in first dose vaccinations.
22%
15%
Comparing throughput in open sites
Average Number of First Dose Vaccinations per Site by Weekend
There is a decreasing trend in the average number of first dose vaccinations per site on weekends.
During September, throughput per site was consistent on Vooma compared to previous weekends (excl Heritage Day weekend).
Vaccination trends by age group
First Dose Vaccinations by Age Group
The age profile of vaccinations during Vooma was similar to that of previous weekends, with somewhat higher uptake amongst individuals <30 years.
Vaccination trends by sex
First Dose Vaccinations by Sex
The sex profile of vaccinations during Vooma weekend is consistent with that of previous weekends.
Vaccination trends by insurance status
First Dose Vaccinations by Insurance Status An increasing proportion of first dose vaccinations is amongst the uninsured population. This trend remained consistent during Vooma weekend.
Effect of Vooma in priority vs non priority districts
First Dose Vaccinations by District Priority
Prioritised districts (x22) only achieved a 6% increase in first dose vaccination uptake during Vooma weekend (weekends in Sept excl. Heritage Day weekend)
Share of Total First Dose Vaccinations by District Priority
Sub-Analysis of Sat – Sun vaccination uptake (2-3 Oct 2021)(to explore the effects of extending opening hours over the weekend)
Comparing total vaccinations per weekend (Sat-Sun)
Expected vs. Actual Total Vaccinations per Weekend (Sat + Sun)Compared to previous weekends in September (exclHeritage Day weekend), Voomaachieved 116% increase in total
vaccinations.
Vooma achieved a 141% increase in total vaccinations compared to what was expected over 1-3 October.
Comparing total vaccinations per weekend, by insurance status (Sat – Sun)
Total Vaccinations by Weekend (Sat + Sun)
Uninsured population● Compared to previous weekends in September (excl Heritage Day
weekend), Vooma achieved 140% increase in first dose vaccinations.● Compared to the expected first dose vaccinations during 1-3 October,
Vooma achieved 135% increase in first dose vaccinations.
Insured population● Compared to previous weekends in September (excl Heritage Day weekend),
Vooma achieved 43% increase in first dose vaccinations.● Compared to the expected first dose vaccinations during 1-3 October, Vooma
achieved 175% increase in first dose vaccinations.
Comparing first dose vaccinations per weekend (Sat – Sun)
Compared to previous weekends in September (excl Heritage Day weekend), Vooma achieved a 132% increase in first dose vaccinations.
Vooma achieved a 138% increase in first dose vaccinations compared to what was expected over 1-3 October.
Expected vs. Actual First Dose Vaccinations per Weekend (Sat + Sun)
Comparing first dose vaccinations per weekend, by insurance status (Sat – Sun)
First Dose Vaccinations by Weekend (Sat + Sun)
Uninsured population● Compared to previous weekends in September (excl
Heritage Day weekend), Vooma achieved 158% increase in first dose vaccinations.
● Compared to the expected first dose vaccinations during 1-3 October, Vooma achieved 140% increase in first dose vaccinations.
Insured population● Compared to previous weekends in September (excl Heritage Day
weekend), Vooma achieved 1.4% increase in first dose vaccinations.● Compared to the expected first dose vaccinations during 1-3 October,
Vooma achieved 180% increase in first dose vaccinations.
Comparing throughput in open facilities, by insurance status (Sat – Sun)
Average Number of First Dose Vaccinations per Open Facilityby Weekend (Medical Aid Supplied)
Average Number of First Dose Vaccinations per Open Facilityby Weekend (No Medical Aid Supplied)
Vaccination trends by insurance status (Sat – Sun)
First Dose Vaccinations by Insurance Status
An increasing proportion of first dose vaccinations is amongst the uninsured population. This trend remained consistent during Vooma weekend.
Vaccination trends by sex (Sat – Sun)
First Dose Vaccinations by Sex
The sex profile of vaccinations during Vooma weekend is consistent with that of previous weekends.
Vaccination trends by sex for uninsured population (Sat – Sun)
First Dose Vaccinations by Sex (No Medical Insurance Supplied)
Vaccination trends by age group (Sat – Sun)
First Dose Vaccinations by Age Group
The age profile of vaccinations during Voomawas similar to that of previous weekends, with somewhat higher uptake amongst individuals <30 years.
4444
Key takeaways
The Vooma Vaccination Weekend helped build momentum for the broader demand acceleration strategy.
We were able to make districts the focus of much attention- unprecedented level of political and social mobilisation in every district in SA.
We achieved 71% of the target of 500,000 vaccinations for the weekend – although this was lower than we had hoped for, these are the ambitious targets we have to set if we are to come close to achieving 70% coverage of all adults by the end of the year. We recommend retaining the target of 500,000 for the next Vooma weekends.
Human resource constraints are a big challenge to sustaining weekend sites - all provinces need to review daily vaccination patterns to ensure hours of opening are used most efficiently and to potentially increase weekend hours.
Demand is elastic (η= ~0.25) – we can achieve more by intensifying communication, social mobilisation and ensuring access.
These strategies will improve uptake, but will need to be augmented by additional strategies (such as cost-offset and incentive strategies) to achieve the coverage goals
4545
Where to next for demand acceleration
More definitive analysis:• Ensure we have diagnosed the problem correctly• Start linking uptake to specific interventions
Location-specific concerted strategies:e.g. Bojanala Platinum DM
Sub-national leadership engagement:Business, religious leaders, unions, traditional leadership
Intensified public communication:• Radio & TV• Print & social media• Ordinary people as champions ‘Vooma Vax Champs’
Thorough appraisal of incentives• For consideration
Next dates (TBC):• 1 Nov (Voting day) – sites open• 12-14 Nov – full Vooma• 3-5 Dec – full Vooma
4747
Thank you to all those who gave ‘Vooma’ to the weekend
To His Excellency, President Cyril Ramaphosa and the Presidency team To the GCIS teams at national, provincial and district leavel To all leaders and sports and arts & culture personalities who participated in the Vooma Vaccination
Weekend To all health workers, health service managers and volunteers To media and communications companies which provided substantial support To foundations, funders and implementing partners which provided support To all other people who gave ‘Vooma’ to the weekend.
May we exceed our target of 500,000 in the next Vooma Vaccination Weekend!12-14 November 2021