RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in...
Transcript of RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in...
![Page 1: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/1.jpg)
RoB 2.0:Arevisedtooltoassessriskofbiasinrandomizedtrials
MatthewPageUniversityofBristol,UK
WithspecialthankstoJulianHiggins,Jelena Savović,Asbjørn Hróbjartsson,IsabelleBoutron,BarneyReeves,RoyElbers,JonathanSterne
![Page 2: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/2.jpg)
Overview
• ReminderoftheCochraneriskofbiastoolforrandomizedtrials• Theneedforanewtool• Developmentofthenewtool• Keyinnovationstothetool• Someexcerptsfromthetool• Someunresolvedissues
![Page 3: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/3.jpg)
3
BMJ 2011; 343: d5928
![Page 4: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/4.jpg)
4
Foam dressings for venous leg ulcers
![Page 5: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/5.jpg)
CurrentCochranetoolforriskofbiasinrandomizedtrials
• Sixsourcesofbias(withoptional‘Other’)
• Foreachsource,• Freetexttodescribewhathappened• Judgement:Lowrisk/Unclearrisk/Highriskofbias
• Somesourcesofbiascanberepeatedfordifferentendpoints
![Page 6: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/6.jpg)
CurrentCochranetoolforriskofbiasinrandomizedtrials
• CochraneRoB toolisverywidelyused(Jørgensen 2016)• 100outof100Cochranereviewsfrom2014(100%)• 31outof81non-Cochranereview(38%)
• >2700citationsfromnon-Cochranesources
• Thescientificdebateonriskofbiashascontinued
• Evaluationstudiesofthetool• Userexperience:surveyandfocusgroups(Savovic 2014)• Inter-agreementstudies(e.g.Hartling2009&2013)• Actualuseinreviewsandpublishedcomments(Jørgensen2016)
![Page 7: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/7.jpg)
Someissuesraisedwithexistingtool
• Usedsimplistically
• Usedinconsistently (domainsaddedorremoved)
• Modestagreement rates
• Only5-10%oftrialsinCochranereviewsarescoredasLowriskofbias
• overuseof“unclearrisk”?
• RoB judgementsaredifficult forsomedomains,particularlyincompleteoutcomedataandselectivereporting
• Challengeswithunblindedtrials
• Notwellsuitedtocross-overtrialsorcluster-randomizedtrials
• Notwellsetuptoassessoverallriskofbias
![Page 8: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/8.jpg)
Funding
• Therevisedtoolforrandomizedtrials(RoB2.0)wassupportedbytheUKMedicalResearchCouncil NetworkofHubsforTrialsMethodologyResearch(MR/L004933/1- N61)
![Page 9: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/9.jpg)
RoB2.0:developmentchronology
• RevisionoftheRoBtoolstartedinMay2015• 1st DevelopmentmeetingheldinBristolinAugust2015• 1st ‘workingdraft’ofthetoolcompletedJanuary2016• PilotingphaseFeb– March2016• Revised‘workingdraft’• 2nd DevelopmentmeetingheldinBristolon21-22April2016• Developmentoffurtherguidanceandpiloting• ReleasedforSeoulColloquium
![Page 10: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/10.jpg)
RoB2.0:contributors
• Coregroup:• JulianHiggins,Jelena Savović,MatthewPage,AsbjørnHróbjartsson,Isabelle
Boutron,BarneyReeves,RoyElbers,JonathanSterne• WorkingGroupmembers:
• DougAltman,NatalieBlencowe,MikeCampbell,ChristopherCates,RachelChurchill,MarkCorbett,NickyCullum,FrancoisCurtin,AmyDrahota,SandraEldridge,JonathanEmberson,BrunoGiraudeau,JeremyGrimshaw,ShareaIjaz,SallyHopewell,AsbjørnHróbjartsson,PeterJüni,JamieKirkham,TobyLasserson,TianjingLi,StephenSenn,SashaShepperd,IanShrier,NandiSiegfried,LesleyStewart,PennyWhiting
• And:HenningKeinke Andersen,MikeClarke,JonDeeks,GeraldineMacDonald,RichardMorris,MonaNasser,Nishith Patel,JaniRuotsalainen,HolgerSchünemann, JayneTierney
![Page 11: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/11.jpg)
Keyinnovations
• Result-focussed assessments• Fixed(inclusive)biasdomains,notmodifiable• “Signallingquestions”tofacilitateriskofbiasjudgements• Newresponseoptionsforriskofbias,without‘Unclear’option• Formaloverall riskofbiasjudgement
• Somerethinkingoftheassessment:• Importantdistinctionbetweeneffectsofinterest• Selectivereportingfocusesonreportedresult
![Page 12: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/12.jpg)
RoB1.0 RoB2.0
Randomsequencegeneration(selectionbias) Biasarisingfromtherandomization
processAllocationconcealment(selectionbias)
Blindingofparticipantsandpersonnel(performancebias)
Biasduetodeviationsfromintendedinterventions
Incompleteoutcomedata(attritionbias) Biasduetomissingoutcomedata
Blindingofoutcomeassessment(detectionbias) Biasinmeasurementoftheoutcome
Selectivereporting(reportingbias) Biasinselectionofthereportedresult
Otherbias N/A
N/A Overallbias
Fundingandvestedintereststobeaddressed,butnotwithinthispartofthewiderframeworkWorkinggroupledbyAsbjørn Hróbjartsson and
IsabelleBoutron
![Page 13: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/13.jpg)
Signallingquestionsandjudgements
• Signallingquestionsareintroducedtomakethetooleasier(andmoretransparent)• ‘Yes’,‘Probablyyes’,‘Probablyno’,‘No’,‘Noinformation’
• Riskofbiasjudgementsfollowfromanswerstosignallingquestions(canbeover-ridden)• ‘Lowriskofbias’,‘Someconcerns’,‘Highriskofbias’
• Achangeintheinterpretationofthejudgements,sothata‘Highriskofbias’judgementinonedomainputsthewholestudyathighriskofbias
• Overallriskofbiasjudgementcanthenbecompletedautomatically(canbeover-ridden)
![Page 14: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/14.jpg)
Overallriskofbiasjudgement
Lowriskofbias Thestudyisjudgedtobeatlowriskofbias foralldomainsforthisresult.
Someconcerns Thestudyisjudgedtobeatsomeconcernsinatleastonedomainforthisresult.
Highriskofbias Thestudyisjudgedtobeathighriskofbias inatleastonedomainforthisresult.ORThestudyisjudgedtohavesomeconcernsformultipledomains inawaythatsubstantiallylowersconfidenceintheresult.
![Page 15: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/15.jpg)
riskofbias.info
![Page 16: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/16.jpg)
Someexcerptsfromthetool
![Page 17: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/17.jpg)
![Page 18: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/18.jpg)
![Page 19: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/19.jpg)
![Page 20: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/20.jpg)
Examplealgorithm
4.1Wereoutcomeassessorsawareoftheinterventionreceivedby
studyparticipants?
4.2Wastheassessmentoftheoutcomelikelyto
beinfluencedbyknowledgeofintervention
received?
Highrisk
Someconcerns
Lowrisk
Lowrisk
Y/PY/NI
N/PN
Y/PY
N/PN
NI
![Page 21: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/21.jpg)
Biasarisingfromtherandomizationprocess
![Page 22: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/22.jpg)
Biasarisingfromtherandomizationprocess
• Currenttoolincludestwoseparatedomains:• sequencegeneration• allocationconcealment(bothunder“selectionbias”)
• Botharerelatedtorandomization/allocationofparticipatesintotreatmentarms
• Failuretoimplementeitherprocessadequatelycreatesopportunitiesforeithertheenrolmentintothestudyortheallocationofenrolledparticipantsintogroupstobeinfluencedbyprognosticfactors
• Theendresultisthesame– unbalanced(biased)distributionofpatientsbetweengroups(notafaircomparison,confounding)
Ø ItmakessensetocombineSGandACintoasingledomain
![Page 23: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/23.jpg)
Biasarisingfromtherandomizationprocess
• EvaluationstudiesoftheuseoftheRoB toolinCochraneshowthatreviewersoftenconsiderbaselineimbalanceas“Otherbias”
• Butthisisrelatedtothesuccessofrandomization
Ø Itmakessensetoincludebaselineimbalanceinthesamebiasdomain
• Indicatorsthatrandomizationwasnotperformedadequately:• unusuallylargedifferencesbetweeninterventiongroupsizes;• asubstantialexcessinstatisticallysignificantdifferencesinbaselinecharacteristics;
• asubstantialexcessinclinicallyimportantdifferencesinbaselinecharacteristics
![Page 24: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/24.jpg)
Biasarisingfromtherandomizationprocess
1.1Wastheallocationsequencerandom?1.2Wastheallocationsequenceconcealeduntil
participantswererecruitedandassignedtointerventions?
1.3Weretherebaselineimbalancesthatsuggestaproblemwiththerandomizationprocess?
Randomizationmethods
Additionalevidenceofproblems
![Page 25: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/25.jpg)
Biasduetodeviationsfromintendedinterventions
![Page 26: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/26.jpg)
Theeffectofinterest
• Thecurrenttoolhasverylittletosayaboutsituationsinwhichblindingisnotfeasible• (otherthantoclassifyasnotblindhencehighriskofbias)
• Issuesofperformancebiasverydifferentfordifferenteffectsofinterest,yetpoorlyaddressedincurrentRoB tool
![Page 27: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/27.jpg)
Theeffectofinterest
• Thecurrenttoolhasverylittletosayaboutsituationsinwhichblindingisnotfeasible• (otherthantoclassifyasnotblindhencehighriskofbias)
• Issuesofperformancebiasverydifferentfordifferenteffectsofinterest,yetpoorlyaddressedincurrentRoB tool
• effectofassignmenttointervention• e.g.doesreferraltophysicaltherapyincreasepost-operativemobility?(thequestionofinteresttoahospitalmanageraboutwhethertointroduceareferralprogramme)
• effectofstartingandadheringtointervention• e.g.doesattendingaphysicaltherapyprogramincreasepost-operativemobility?(thequestionofinteresttoanindividualaboutwhethertoattendphysicaltherapy)
![Page 28: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/28.jpg)
Theeffectofinterest
• Wheninterestedineffectofassignment tointervention• Deviationsfromintendedinterventionarenotimportantprovidingthesedeviationsreflectusualpractice
• e.g.itisusualpracticeforsomereferredpatientstonotattendphysicaltherapy,ortocompleteonlysomesessions
• thisdifferstobehaviourthatreflectsexpectationsofadifferencebetweeninterventionandcomparator
• Wheninterestedineffectstartingandadheringtointervention• Deviationssuchaspooradherence,poorimplementationandco-interventionsmayleadtoriskofbias
• Wethereforehavedifferenttoolsforthesetwoeffectsofinterest
![Page 29: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/29.jpg)
Biasduetodeviationsfromintendedinterventions
Effectofassignment tointervention2.1.Wereparticipantsawareoftheirassignedinterventionduring
thetrial?2.2.Werecarersandtrialpersonnelawareofparticipants'assigned
interventionduringthetrial?2.3.IfY/PY/NIto2.1or2.2:Weretheredeviationsfromthe
intendedinterventionbeyondwhatwouldbeexpectedinusualpractice?
2.4.IfY/PYto2.3:Werethesedeviationsfromintendedinterventionunbalancedbetweengroupsand likelytohaveaffectedtheoutcome?
2.5Wereanyparticipantsanalysedinagroupdifferentfromtheonetowhichtheywereassigned?
2.6IfY/PY/NIto2.5: Wastherepotentialforasubstantialimpact(ontheestimatedeffectofintervention)ofanalysingparticipantsinthewronggroup?
Blinding
Deviationsreflectusual
practice?
Firstprincipleof
ITT
![Page 30: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/30.jpg)
Biasduetodeviationsfromintendedinterventions
Effectofstartingandadheringtointervention2.1.Wereparticipantsawareoftheirassignedintervention
duringthetrial?2.2.Werecarersandtrialpersonnelawareofparticipants'
assignedinterventionduringthetrial?2.3.IfY/PY/NIto2.1or2.2:Wereimportantco-interventions
balancedacrossinterventiongroups?2.4.Wastheinterventionimplementedsuccessfully?2.5.Didstudyparticipantsadheretotheassignedintervention
regimen?2.6.IfN/PN/NIto2.3,2.4or2.5:Wasanappropriateanalysis
usedtoestimatetheeffectofstartingandadheringtotheintervention?
Blinding
Specificdeviations
Overcomebyanalysis?
![Page 31: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/31.jpg)
Biasduetomissingoutcomedata
![Page 32: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/32.jpg)
Missingoutcomedata
• Whencompleteoutcomedataforallparticipantsisnotavailableforyourreview• attrition- losstofollowup,withdrawals,othermissingdata• exclusions– someavailabledatanotincludedinreport
• Considerations• howmuchdataismissingfromeachgroup?(includenumbersinyourdescription)
• whyisitmissing?• howwerethedataanalysed?
Source:CochraneTraininghttp://training.cochrane.org/resource/assessing-risk-bias-included-studies
![Page 33: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/33.jpg)
Biasduetomissingoutcomedata
3.1.Wereoutcomedataavailableforall,ornearlyall,participantsrandomized?
3.2.IfN/PN/NIto3.1:Aretheproportionsofmissingoutcomedataandreasonsformissingoutcomedatasimilaracrossinterventiongroups?
3.3.IfN/PN/NIto3.1:Isthereevidencethatresultswererobusttothepresenceofmissingoutcomedata?
Anymissingdata?
Amountandreasons?
Resultsrobust?
![Page 34: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/34.jpg)
Biasinmeasurementoftheoutcome
![Page 35: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/35.jpg)
Biasinmeasurementoftheoutcome
• Systematicdifferencesbetweengroupsinhowoutcomesareassessed
• Someoutcomesaremorepronetobiasthanothers• Patient-reportedoutcome(e.g.pain,qualityoflife)• Observer-reportedinvolvingjudgement(e.g.clinicalexamination)
• Observer-reportednotinvolvingjudgement(e.g.all-causemortality)
![Page 36: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/36.jpg)
Biasinmeasurementoftheoutcome
4.1.Wereoutcomeassessorsawareoftheinterventionreceivedbystudyparticipants?
4.2.IfY/PY/NIto4.1:Wastheassessmentoftheoutcomelikelytobeinfluencedbyknowledgeofinterventionreceived?
Blinding?
Assessmentinfluenced?
![Page 37: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/37.jpg)
Biasinselectionofthereportedresult
![Page 38: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/38.jpg)
Selectivereporting
• Currenttooltakesabroadapproachtoselectivereporting• Anyevidenceofitinthetrialreports?
38
![Page 39: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/39.jpg)
Results
• Selectivenon-reportingbiasestheresultofthemeta-analysiswhichcannotincludethetrialthatomittedtheoutcome;itdoesnotbiasthetrialresult
• Thisissimilartopublicationbias(non-reportingofastudy)
WeincludeonlyselectionofthereportedresultintheRoB 2.0tool
...andconsiderselectivenon-reporting inotherways
![Page 40: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/40.jpg)
Biasinselectionofthereportedresult
Trialresultisbiasedbecauseithasbeenselectedonthebasisoftheresultsfrommultiple:• Outcomemeasurements
• Scales• Definitionsof/criteriaforanevent• Timepoints
• Analyses• Unadjustedvsadjustedmodels• Differentsetsofcovariatesinadjustedmodels• Finalvaluesvschangefrombaselinevsanalysisofcovariance• Continuousscaleconvertedtocategoricaldatawithdifferentcut-
points
![Page 41: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/41.jpg)
Biasinselectionofthereportedresult
Arethereportedoutcomedatalikelytohavebeenselected,onthebasisoftheresults,from...
5.1....multipleoutcomemeasurements(e.g.scales,definitions,timepoints)withintheoutcomedomain?
5.2...multipleanalysesofthedata?
Selectiveoutcomereporting
Selectiveanalysisreporting
![Page 42: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/42.jpg)
Piloting
• RoB 2.0hasundergonemultiplephasesofpiloting• informeddevelopmentandrefinement• moreisalwayswelcome
• Formalstudiesofinter-rateragreementnotyetperformed
• Fullguidanceavailableatriskofbias.info• initialdraft,subjecttominorrefinements
![Page 43: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/43.jpg)
Someunresolvedissues
• Howmanyresultstoassessperstudy?• Howtointegrateintodatacollectionprocess?• Howtopresentassessmentsinareview?
• Implementation• RoB 2.0willneedcarefulconsiderationtomaketheprocessefficientformultipleoutcomes
• DiscussionsinitiatedwithRevMan andCovidence teamatSeoulColloquium
![Page 44: RoB2.0: A revised tool to assess risk of bias in ... · Current Cochrane tool for risk of bias in randomized trials • Six sources of bias (with optional ‘Other’) • For each](https://reader030.fdocuments.in/reader030/viewer/2022041214/5e03242dd9e2ea2f2041f318/html5/thumbnails/44.jpg)
Concludingremarks
• WebelieveRoB 2.0offersconsiderableadvantagesovertheexistingtool
• Onceprogrammedintosoftware,weexpectthetoolwillbeeasytouseandintegrateintotheinterpretationofresults
• WeareextremelygratefultoallthosewhohavecontributedtothedevelopmentofRoB 2.0
• RoB 2.0isavailableatriskofbias.info