Motivating teachers to improve early grade learning

KIUFUNZA:

Cash on Delivery: Motivating teachers to improve early grade learning

Part I | What’s the problem?

Tooli&lelearningishappeninginearlygrades

3% 5%8%

12%

20%

47%53%

12%

21%

32%

46%

58%

66%70%

25%

52%56%

70% 71%

79% 78%

1 2 3 4 5 6 7

Sharemasterin

gskill(%

)

Grade

Math:Grade2mul8plica8on(Uwezo,2013)Examples:7x4,11x2

Notinschool Publicschool Privateschool

Teachermo3va3onislow

35%

33%

32%

54%

19%

27%

Inclass

Atschool,outofclass

Absentfromschool

Whereismyteacher?

2016 2015

(DatafromKiuFunzasurprisevisits,2016)

Cost:Teaching,AbsenceandMo3va3on

Sources:BESTdata;KiuFunzasurveysandimplementaQondata.

1,724

793

138

Annualprimaryschoolwagebill

Lossduetoclassroomabsence

(46%)

CostofCOD(highesQmate)

TZSBillion

s

TripleChallengeinEduca3on

Governmentfacesthetriplechallengeof:

ImprovinglearninginschoolsLearningistooslow

SpendingtheeducaQonbudgetmoreeffecQvelyGrowingschoolpopulaQonsandbudgetrequirements

EnsuringteachersaremoQvatedTheyarethekeyactors

Cash on Delivery: Motivating teachers to improve early grade learning

Part 2 | What can we do?

CashonDeliveryaddressesthethreechallenges}  CashonDelivery(COD)isanincenQvesystemthatlinksteachersbonuspaymentstotheskillslearnedbythechildrentheyteach.

}  Itcommunicatestoallteachersthatlearningisvaluableandthatlearningprogressisrewarded.

}  CashonDelivery•  Improveslearning(impactevidenceKiuFunza)•  Reducescostperpasser•  Isappreciatedbyteachers

CashonDeliveryimproveslearningoutcomes

}  Yes!TheCG-CODcombinaQontreatment:20%increaseinthepassratesforbothKiswahiliandMath•  IncenQvesimproveeffecQvenessofinputfinancing

ThepowerofKiuFunzaincen3ves

RESOURCES ACCESSPEDAGOGYINCENTIVESSBMKIUFUNZAIMPACT

Teacherincen3vesworkinothercountriesCOUNTRY KEYFEATURES IMPACT(SD) IMPACTcompared

withrural-urbantestscoredifference

Tanzania(Experiment)

140CODschools +0.18 21%

Brasil(Pernambuco)(Largescale)

950schools;prim&sec

+0.12 14%

Chile(Largescale)

All6,500basiceducaQonschools

+0.16to+0.25 19—30%

Kenya(Experiment)

50Schools,primary +0.14 17%

India(Experiment)

GroupincenQveIndividualincenQve100schoolstotal

+0.16+0.27

19%32%

Cash on Delivery: Motivating teachers to improve early grade learning

Part 3 | Why is it worth doing?

Valueformoney

}  Largeskillimpact(passrates+20%)

}  CostlowrelaQvetoexisQngbudget

}  ExcludesCG(nowsentdirectly)

}  GovernmentintervenQon:•  Schoolvisitscheaper•  TesQngdataNECTA

1.8%

2.4%

3%

CommunicaQoncosts,school

visits

CODcostStI-III(bonus)

StudenttesQngcosts

KiuFunza2013-14interven8oncosts

%ofBusinessasUsualBudget

Teacherslikeincen3vepay

•  75%haveaveryfavorableopinion,20%somewhatfavorable

75%

20%

4%0%

1%Veryfavorable

Somewhatfavorable

Neutral

Somewhatunfavorable

Veryunfavorable

“Whatisyouropinionaboutpayingteachersabonusbasedonstudentperformanceimprovement?”

Performanceincen3vesarenotnewinTanzania

}  SchoolIncenQveGrant(SIG)in2014•  Basedonlearningimprovements•  SIGbonuspaidtoschool•  Onlysmallnumberofschoolscanwin

}  KiuFunza’sdesign•  a)allteacherscanearn,morestudentsbenefit•  b)thebonusispaidtoteachersdirectly•  c)thebonusrepresentsasignificantvalue(e.g.,1monthsalary)

•  d)theincenQveiscommunicatedclearly

Cash on Delivery: Motivating teachers to improve early grade learning

Part 4 | How do we do it?

Must-havestostartaCashonDeliveryscalepilot}  MinisterialcommitmentandaCODfundtopaytheincenQves

}  AgreementonincenQvedesignandperformancemeasure

}  ClearandengagingcommunicaQontoteachers•  atthestartoftheyeartoensuretheincenQveofferisknownandunderstood

•  anerthepaymentsaresenttoprovidefeedback}  Accesstoteacherandtestdata}  EfficientstructuretomanageincenQveimplementaQon

Execu3on:HowtoimplementCashonDelivery?

1.  Startofschoolyear•  QualitycommunicaQon:incenQveoffer,FAQflyer•  OrganizeCODteacherdatabase:teacherassignmentandbankaccountdata

2.  Endofschoolyear•  Studenttestdataandaudits•  Createpaysheets•  Paybonuses

KeyCashonDeliverydesigndecisions(1)

}  ‘What’:thetargetindicatorthatismeasuredandpaidfor}  Valueaddedlearning:thedifferencebetweenwhatastudentcandobeforeandanerayearofschooling•  Measure:increaseinpassrate•  Risk:weakstudentsexcludedtoboostpassrate•  SoluQon:combinedscore-flowmeasure(penalizesexclusion)

•  BrasilusesthisaskeyeducaQonindicatorandtargetatalllevels(IDEB)

}  Equityofopportunity:payforprogresstowardsschoolspecifictarget

}  ‘Who’:whoseperformanceismeasured,individualteachersorgroupsofteachers?

}  NaQonalexamdata:performanceofteams•  StandardIVnaQonalassessment:measuresperformanceofteachersinStandardI-IV

•  PSLE:measuresperformanceofteachersinStandardV-VII}  Standards:•  Earlygradesonly:I-IV

KeyCashonDeliverydesigndecisions(2)

}  Sizeofexpectedbonus•  Nottoosmall•  Costexample:ifmaxbonusisonemonthofbasicsalarythenweneedaCODfundof8%(1/12)ofannualpersonnelexpenseinincenQvizedgrades(I-IV)

}  Schools:allschoolsorasub-setofschools•  e.g.lowestrankedschools;orruralschools•  Equity•  Focusputsbudgetatacceptablelevel

KeyCashonDeliverydesigndecisions(3)

Equity:CashonDeliverycanreducelearninginequality

}  Equityofopportunity:payforprogresstowardsschoolspecifictarget•  Targetsarebasedonpastschoolperformance•  Apoorlyperformingschoolgetsatargetjustabovepastperformance

•  MinisterdecideshowambiQoustargetiseachyear}  Focusonmostdisadvantagedschools•  Willreducelearninggapwithhighperformers•  Helptoavractteacherstotheseschools•  Canreducebudgetrequirement

Summary

}  Toolivlelearningishappeninginearlygrades,partlybecause,}  TeachermoQvaQonislow

}  Cash-on-DeliveryimprovesteachermoQvaQon}  Cash-on-Deliveryimproveslearningoutcomes}  PerformanceincenQvesarenotnewinTanzania}  Teacherslikeperformance-basedpay

}  Cash-on-DeliveryconceptisreadyforGovernmenttopilotit}  AteacherincenQvepolicyisabiginvestment;weshouldtryitandtestimpactbeforefulladopQon

KiuFunzateam}  Tanzaniateam•  Twaweza•  COSTECH•  TAMISEMI•  DistrictImplemenQngPartners•  DistrictOffices•  EDI(Bukoba,implementaQonmanagement)

}  Globalteam•  PrincipalInvesQgators

•  IsaacMbiQ,UniversityofVirginia•  KarthikMuralidharan,UCSanDiego

•  InnovaQonsforPovertyAcQon(surveymanagement)

Ahsantenisana