Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud
description
Transcript of Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud
![Page 1: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/1.jpg)
Assessment of methodological quality and outcomes of clinical trials
Christian Gluud
Copenhagen Trial Unit Centre for Clinical Intervention Research
RigshospitaletCopenhagen University Hospital
![Page 2: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/2.jpg)
Evidence-basedclinical practice
• The patient’s values (concerns, expectations, preferences)
• The best clinical research evidence
![Page 3: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/3.jpg)
Levels of evidence
![Page 4: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/4.jpg)
Important aspects of clinical research
- all levels of the hierachy
• Systematic errors (domains) • Systematic errors (design) • Random errors (play of chance)
![Page 5: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/5.jpg)
Levels of evidence
• Risk of systematic errors (domain)• Risk of systematic errors (design)• Risk of random errors
![Page 6: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/6.jpg)
Important aspects of randomised clinical trials
and meta-analyses
• Systematic errors (domains)
• Systematic errors (design)
• Random errors (play of chance)
![Page 7: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/7.jpg)
Domains associated with bias risk
• Generation of the allocation sequence• Allocation concealment• Blinding• Incomplete outcome data (intention-to-treat)• Outcome reporting bias• Industry bias• Other components associated with bias
![Page 8: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/8.jpg)
Meta-analysis of several trials
Low risk of bias
High risk of bias
Overall
![Page 9: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/9.jpg)
Ratio of odds ratios (ROR)Ratio of odds ratios (ROR)
Odds ratio of trials with unclear or inadequateOdds ratio of trials with unclear or inadequate
component (high risk of bias)component (high risk of bias)
divided bydivided by
odds ratio of trials with adequate odds ratio of trials with adequate
component (low risk of bias)component (low risk of bias)
![Page 10: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/10.jpg)
Control of selection biasGeneration of the allocation sequence
• Low risk of bias Computer system, table of random numbers, or similar
• High risk of bias Not described or quasi-randomised (excluded)
![Page 11: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/11.jpg)
BRANDO Sequence generation
• 112 meta-analyses with• 944 randomised clinical trials • 696 (73.7%) with high risk of bias• ROR 0.89 (95% CI 0.82 to 0.96)
![Page 12: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/12.jpg)
Control of selection biasAllocation concealment
• Low risk of bias Central independent unit, sealed envelopes (only if perfect placebo)
• High risk of bias Not described or open table of random numbers
![Page 13: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/13.jpg)
BRANDO Allocation concealment
• 146 meta-analyses with• 1292 randomised clinical trials • 916 (70.9%) with high risk of bias• ROR 0.93 (95% CI 0.87 to 0.99)
![Page 14: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/14.jpg)
Control of detection bias(reporting bias and observer bias)
Blinding
• Low risk of bias Identical placebo or comparator
• High risk of bias Not described or not blinded
![Page 15: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/15.jpg)
BRANDO Blinding
• 104 meta-analyses with• 1057 randomised clinical trials • 467 (44.2%) with high risk of bias• ROR 0.87 (95% CI 0.79 to 0.96)
![Page 16: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/16.jpg)
Industry sponsorship and research outcome
• Lundh et al, The Cochrane Library 2012
• Cross-sectional studies, cohort studies, systematic reviews and meta-analyses that quantitatively compared primary research studies of drugs or medical devices sponsored by industry with studies with other sources of sponsorship
![Page 17: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/17.jpg)
Favourable beneficial results
![Page 18: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/18.jpg)
Favourable harms results
![Page 19: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/19.jpg)
Favourable conclusions
![Page 20: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/20.jpg)
Important aspects of randomised clinical trials
and meta-analyses
• Systematic errors (domains)
• Systematic errors (design)
• Random errors (play of chance)
![Page 21: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/21.jpg)
Design errors affecting external validity of randomised trials include
‘wrong’: • Centres• Participants• Experimental intervention• Control intervention• Goal - explanatory or pragmatic• Trial structure - parallel group, crossover, etc.• Objective - superiority, equivalence, non-inferiority• Outcome• Unit of analysis
![Page 22: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/22.jpg)
Important aspects of randomised clinical trials
and meta-analyses
• Systematic errors (domains)
• Systematic errors (design)
• Random errors (play of chance)
![Page 23: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/23.jpg)
Mean number of patients per intervention arm (SEM) in 383 randomised trials
published in Gastroenterology from 1964-2000 (Kjærgard et al. 2002)
![Page 24: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/24.jpg)
TA(C)E for hepatocellular carcinoma – trial sequential
analysis
![Page 25: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/25.jpg)
The pernicious yin-yang interplay between random errors and systematic error
PUBLICATION BIASPUBLICATION BIAS
![Page 26: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/26.jpg)
![Page 27: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/27.jpg)
![Page 28: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/28.jpg)
![Page 29: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/29.jpg)
Number of patients with serum HBV DNA at end of treatment
![Page 30: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/30.jpg)
Trial sequential analysis of serum HBV DNA
DARIS 4620 pts. Pc 54%, RRR 20%, alpha=5%, beta=20%, diversity=85%
Trial sequential analysis of serum HBV DNA at end of treatment
![Page 31: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/31.jpg)
Number of pts without seroconversion from HBeAg to anti-HBe
![Page 32: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/32.jpg)
DARIS 891 pts. Pc 86%, RRR 20%, alpha=5%, beta=20%, diversity 79%
Trial sequential analysis of seroconversion from HBeAg to anti-HBe
![Page 33: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/33.jpg)
Trial variable Global Chinese
Trial registration Often insufficient Often insufficient
Sample size estimation 50% Less than 25%
Bias risks 95% More than 95%
Comparators Often ill chosen Often ill chosen
Outcomes Putative sourrogates Putative sourrogates
Results Mostly unreliable Mostly unreliable
Depesonolised data in register
Always insufficient Always insufficient
![Page 34: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/34.jpg)
Experimental intervention- systematic errors (domains)- systematic errors (design)- PUBLICATION bias
Control intervention
Randomised clinical trials – most often false due to the people behind!
“…why most research findings are false!” JP Ioannidis
![Page 35: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/35.jpg)
THANK YOU !THANK YOU !
![Page 36: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/36.jpg)
The Cochrane
CollaborationAn international network of professionals,
preparing , maintaining, and disseminating systematic reviews of the effects of health care
![Page 37: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/37.jpg)
Archie Cochrane (1979)
”It is surely a great criticism of our profession that we have not organised a critical summary, by speciality and subspeciality, adapted periodically, of all relevant randomised trials”
![Page 38: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/38.jpg)
The Cochrane Collaboration
• www.cochrane.org• 670 000 randomised trials• Now 5000 systematic reviews• 500 new reviews per year• 500 updated reviews per year• JIF 6.2
![Page 39: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/39.jpg)
Answer to the question:
When is it acceptable to make therapeutic decisions based on patient series, patient-control studies, and cohort studies?
![Page 40: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/40.jpg)
Answer to the question:
When is it acceptable to make therapeutic decisions based on patient series, patient-control studies, and cohort studies?
Only if you have exophtalmus producing intervention effects!
![Page 41: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/41.jpg)
Answer to the question:
When is it acceptable to make therapeutic decisions based on patient
series, patient-control studies, and cohort studies?
As we do not know the intervention effect a priory – and medical research is a
forward moving process – one should always test interventions in randomised clinical trials!
![Page 42: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/42.jpg)
Thomas C Chalmers
• More than 500 publications• More than 25 000 citations• H index above 77
• Always randomize the first patient! The New England Journal of Medicine
1977;296(2):107
![Page 43: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/43.jpg)
Rare diseases and randomised trials
• With 7,000,000,000 (7 billion!) individuals in the world the disease has to be extremily rare – say less than 1/10,000,000 – before it becomes difficult to conduct randomised clinical trials!
• International patient registries• Infrastructures like ECRIN
![Page 44: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/44.jpg)
James Lind 1747
![Page 45: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/45.jpg)
James Lind 1716-1794
![Page 46: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/46.jpg)
James Lind allocated
Two oranges and lemons
Two cider
Two vinegar
Two elixir vitriol
Two spices and garlic
Two sea water
![Page 47: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/47.jpg)
75 498 979 1647 31188823
16155
26322
45020
67522
99373
121584
131223
0
20000
40000
60000
80000
100000
120000
140000
1900 to 1946
1947 to 1951
1952 to 1956
1957 to 1961
1962 to 1966
1967 to 1971
1972 to 1976
1977 to 1981
1982 to 1986
1987 to 1991
1992 to 1996
1997 to 2001
2002 to 2007
Year period
Periodic growth of publications on randomised and controlled clinical trials
![Page 48: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/48.jpg)
1127
1014945
881
713666 632
594 587 559
438 430 426355 349
254 250199 188 175
0
200
400
600
800
1000
1200
Number of publications on randomised and controlled clinical trials published per million inhabitants
![Page 49: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/49.jpg)
James Lind observed
The two on oranges and lemons
regained health in a few days
and could care for the remainder,
that stayed ill
![Page 50: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/50.jpg)
James Lind 1753
![Page 51: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/51.jpg)
James Lind 1747
Yearly ‘International Clinical Trials’ Day’ !!!!!Yearly ‘International Clinical Trials’ Day’ !!!!!
![Page 52: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/52.jpg)
George Löhner and…... 1835
![Page 53: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/53.jpg)
George Löhner and his team of truth loving men
• Clear protocol, published before launch
• Large number of participants (n = 50)
• Perfect randomisation
• Placebo controlled (melted ice)
• Blinded for all parties
• Account for drop outs
• Statistical comparison
![Page 54: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/54.jpg)
Downgrade the evidence in case of risks of errors
I More evidence needed!!!!!!!!!!!!!IIa Systematic review of randomised clinical trials with risk of systematic errors (bias) or of random errors (play of chance) IIb Single randomised clinical trial with risk of systematic errors (bias) or of random errors (play of chance) III Cohort studyIV Case-control studyV Case series
![Page 55: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/55.jpg)
Upgrade the evidence in case of ‘exophthalmus’ producing effects
I Case-control studiesII Case series
Ex: - parachute for plane passengers - insulin for diabetic coma- blood transfusion for severe haemorrhage- defibrillation for ventricular fibrillation- ether to induce anaesthesia
![Page 56: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/56.jpg)
Povl Heiberg 1897
Heiberg knew the solutions
- large numbers - large numbers !!
- randomisation - randomisation !!
- blinding - blinding !!
- independent research - independent research !!
![Page 57: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/57.jpg)
The hierarchy of evidenceIa Systematic review of randomised clinical trials with low risk of systematic errors (bias) and of random errors (play of chance) Ib Single randomised clinical trial with low risk of systematic errors (bias) and of random errors (play of chance) II Cohort studyIII Case-control studyIV Case series
![Page 58: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/58.jpg)
Low risk of systematic errors
High risk of systematic errors
Low risk of random errors
High risk of random errors
![Page 59: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/59.jpg)
![Page 60: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/60.jpg)
Random errors in small trials• False positive results
(type I error)
• False negative results
(type II error)
![Page 61: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/61.jpg)
![Page 62: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/62.jpg)
Components associated with bias risk
• Generation of the allocation sequence• Allocation concealment• Blinding• Incomplete outcome data (intention-to-treat)• Outcome measure reporting bias• Other components associated with bias (vested
interest bias)
![Page 63: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/63.jpg)
TA(C)E for hepatocellular carcinoma – systematic review
![Page 64: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/64.jpg)
Important aspects of randomised clinical trials
and meta-analyses
• Systematic errors (bias) • Random errors (play of chance)• Design errors
![Page 65: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/65.jpg)
The hierarchy of evidenceIa Systematic review of randomised clinical trials with low risk of systematic errors and low risk of random errors Ib Single randomised clinical trial with low risk of systematic errors and low risk of random errors !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!II Cohort studyIII Case-control studyIV Case series
![Page 66: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/66.jpg)
Dangers in non-randomised studies
• Confounding by indication and unmeasured confounding • Biological mechanisms - Limited time of diseases - Cyclical progression of diseases - When do we see patients?
• Psychological mechanism - We see what we want to see (BIAS)! - We believe what we want to believe (astrology)!
![Page 67: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/67.jpg)
Deeks et al (2003) and the International Stroke Trial
• 19,435 patients with ischaemic stroke
• 467 clinical sites
• Randomised to aspirin versus placebo
• Dead or dependent at 6 months
• OR 0.95; 95% CI 0.89 to 1.01
![Page 68: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/68.jpg)
Deeks et al (2003) and the International Stroke Trial
Deeks et al. resample 100 pts/group making
- Small randomised trials (n=14,000) from
randomised groups within centres
- Small controlled cohort studies (n=14,000)
from two centres
![Page 69: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/69.jpg)
Deeks et al. 2003
Randomised clinical trials
![Page 70: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/70.jpg)
Deeks et al. 2003
Controlled cohort studies
![Page 71: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/71.jpg)
Deeks et al. 2003
Controlled cohort studies
Logistic regression
![Page 72: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/72.jpg)
Deeks et al. 2003
Controlled cohort studies
Propensityscores
![Page 73: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/73.jpg)
Meta-analysis of several trials
Low risk of bias
High risk of bias
Overall
![Page 74: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/74.jpg)
Ratio of odds ratios (ROR)Ratio of odds ratios (ROR)
Odds ratio of trials with unclear or inadequateOdds ratio of trials with unclear or inadequate
component (high risk of bias)component (high risk of bias)
divided bydivided by
odds ratio of trials with adequate odds ratio of trials with adequate
component (low risk of bias)component (low risk of bias)
![Page 75: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/75.jpg)
Control of selection biasGeneration of the allocation sequence
• Low risk of bias Computer system, table of random numbers, or similar
• High risk of bias Not described or quasi-randomised (excluded)
![Page 76: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/76.jpg)
BRANDO Sequence generation
• 112 meta-analyses with• 944 randomised clinical trials • 696 (73.7%) with high risk of bias• ROR 0.89 (95% CI 0.82 to 0.96)
![Page 77: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/77.jpg)
Control of selection biasAllocation concealment
• Low risk of bias Central independent unit, sealed envelopes (only if perfect placebo)
• High risk of bias Not described or open table of random numbers
![Page 78: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/78.jpg)
BRANDO Allocation concealment
• 146 meta-analyses with• 1292 randomised clinical trials • 916 (70.9%) with high risk of bias• ROR 0.93 (95% CI 0.87 to 0.99)
![Page 79: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/79.jpg)
Control of detection bias(reporting bias and observer bias)
Blinding
• Low risk of bias Identical placebo or comparator
• High risk of bias Not described or not blinded
![Page 80: Assessment of methodological quality and outcomes of clinical trials Chris tian Gluud](https://reader035.fdocuments.in/reader035/viewer/2022062816/56815970550346895dc6b2f1/html5/thumbnails/80.jpg)
BRANDO Blinding
• 104 meta-analyses with• 1057 randomised clinical trials • 467 (44.2%) with high risk of bias• ROR 0.87 (95% CI 0.79 to 0.96)