Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study,...
-
Upload
wilfred-harrell -
Category
Documents
-
view
220 -
download
0
Transcript of Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study,...
![Page 1: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/1.jpg)
Some Statistics and Epidemiology for the AKT
![Page 2: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/2.jpg)
We’ll try to cover
1. General tips
2. Types of study, the ‘evidence hierarchy’, what you get from each study type
3. Looking at numbers: calculations and data representation
4. Screening: qualities of test, more calculations
![Page 3: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/3.jpg)
Scope
• What I learnt
• Hopefully will give an approach for most questions
• Not everything! (See AKT content guide)
• PasTest / OnExamination
![Page 4: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/4.jpg)
Some General Tips
• A few key formulae - write them down!
• Stats more than anything - ‘RTQ2’
• Flag and return
• If presented with a random chart…(You don’t have to fully understand a graph
to get the information you need)
• Flag and return… (don’t stress)
![Page 5: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/5.jpg)
2. Looking at Evidence
![Page 6: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/6.jpg)
“It is a truth universally acknowledged that a medical intervention justified by observational data must be in want of verification through a randomised controlled trial”
![Page 7: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/7.jpg)
BMJ 2003;327:1459-61
![Page 8: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/8.jpg)
Qualitiative vs. Quantitative
• Focus on quantitative here
• Qualitative:– Generate ‘informed assertions’ or
hypotheses– May inform planning quantitiative research– Focus groups, interviews, questionnaires
Example questions?
![Page 9: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/9.jpg)
Quantitative study types
• Try to be able to identify type of study from a description of the study
• Therefore know what it can and can’t tell you • Any study:
– What is the exposure?– What is the outcome?– What type of study is it?
![Page 10: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/10.jpg)
Rates of liver cancer and HBV seroprevance, by country.
![Page 11: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/11.jpg)
Population Studies• Population studies
– Examples?– Uses– Limitations
• Information from groups, not individuals• Correlations• Generate hypotheses, can’t test them• Confounding• The Ecological Fallacy
![Page 12: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/12.jpg)
The Ecological FallacyUS 2004 elections:
– Republicans won in the poorest 15 states– Democrats won in 9 of the 11 wealthiest
states– So, are wealthy people more likely to vote
for the Democrats?
NO!Incorrect assumption that individuals from wealth states are more likely to be wealthy
= the ecological fallacy
![Page 13: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/13.jpg)
Individual Studies
• Case reports, case series, cross sectional• Generate hypotheses, can’t test them• Cross sectional study: exposure and outcome
at the same time– No temporal relationship– BMI (outcome) and time spent exercising
(exposure)
![Page 14: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/14.jpg)
Analytical Studies
• Generally the most useful for us..can answer questions (not just ask them)
• Observational– No control over exposure
• Interventional– Control over exposure
![Page 15: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/15.jpg)
Observational Studies
• A type of analytical study
• Consider two types…
![Page 16: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/16.jpg)
Women diagnosed with DVT are six times more likely to have a history of oral contraceptive usage
![Page 17: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/17.jpg)
Case - control studies
• It’s all in the title…
• Take cases, find matched controls• Exposure to risk factor is determined retrospectively
![Page 18: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/18.jpg)
Case-control studies
Advantages• Rare diseases• Cheap and quick
Limitations• Need matching• Confounding• Recall bias
Can calculate odds ratios
![Page 19: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/19.jpg)
As study looking at new diagnoses of lung cancer in smokers vs. non-smokers.
![Page 20: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/20.jpg)
Cohort studies
A type of observational, analytical study:• Determine exposure e.g. measure tobacco use• Follow up cohort over a set period of time e.g. 10
years• Measure outcome e.g. new diagnoses of lung
cancer
![Page 21: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/21.jpg)
Cohort studies
Advantages• Generate incidence• Less danger of bias
by poor selection of controls
• No recall bias• Multiple exposures
Limitations• Expensive• Time consuming• Loss to follow-up• Rare conditions?
Can calculate relative risk
![Page 22: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/22.jpg)
Rivaroxiban reduces the risk of ischamic stroke over five years in patients with atrial fibrillation compared
with placebo.
![Page 23: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/23.jpg)
Interventional Studies
Basically a cohort study, but…The difference is that the investigator intervenes:• The investigator determines exposure• Individuals are followed up for a period of time to
determine the outcome.
Need to consider:• Double blind versus single blind• Placebo control• randomisation
![Page 24: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/24.jpg)
RCTRandomisation:• Subjects are randomised into groups (drug vs. placebo, or drug A vs.
drug B…)• The aim is that the groups are identical in every way apart form
exposure to the drug, to minimise confounders• Minimise selection bias• (Also crossover - added safeguard)
Control:• The control group should be identical• The control may receive a placebo intervenion, which ideally looks
and tastes the same
Blinding• The investigators don’t know who has received what when collecting
and analysing data• The subjects don’t know whether they have reviewed placebo or not
![Page 25: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/25.jpg)
RCTs
Advantages• Minimise
confounding and bias
• ‘Gold standard’
Limitations• Extremely expensive• Side effects may
unblind• Ethics
Can calculate relative risk
(remember it is a cohort study)
![Page 26: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/26.jpg)
Meta-anaysis
Not to be confused with a systematic review.A meta-anaylsis:• Aggregate data from multiple trials• Complex analysis - probably less accessible
…but generally analysed by people with less of an interest in deceiving you.
• ‘Gold standard’
![Page 27: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/27.jpg)
Answering Questions
Using EBM in practice:• Need a specific question:
– P– I– C– O
• Need use a systematic means of searching for available evidence
• Need to be able to appraise the evidence– Some useful tools if you have the time
• Or, get someone else to do it:– CKS, Cohrane, BMJ Clinical Evidence
![Page 28: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/28.jpg)
Answering Questions: The Evidence Hierachy
Hierarchy of quality of evidence for quantitative studies• I-1: Systematic review of RCTs• I-2: RCT• II-1: Cohort• II-2: Case-control• II-3: Uncontrolled experiment• III: Expert committees, respected authorities• IV: ‘Somebody once told me’, The Daily Mail,
– case reports, case series
![Page 29: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/29.jpg)
BMJ 2003;327:1459-61
“Only two options exist. The first is that we accept that, under exceptional circumstances, common sense might be applied when considering the potential risks and benefits of interventions. The second is that we continue our quest for the holy grail of exclusively evidence based interventions and preclude parachute use outside the context of a properly conducted trial. The dependency we have created in our population may make recruitment of the unenlightened masses to such a trial difficult. If so, we feel assured that those who advocate evidence based medicine and criticise use of interventions that lack an evidence base will not hesitate to demonstrate their commitment by volunteering for a double blind, randomised, placebo controlled, crossover trial.”
![Page 30: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/30.jpg)
3. Looking at Numbers
![Page 31: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/31.jpg)
Looking at numbers
• Definitions
• Comparing risk between populations
• Looking at data: some other points
• Draw a table if you can!
![Page 32: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/32.jpg)
A few definitions
• Rate– Denominator = person-time at risk– e.g. cases / 1000 at risk population / year
• Incidence
• Prevalence
![Page 33: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/33.jpg)
Comparing risk between populations
• Quantifying risk is basis of measuring effect of an exposure or intervention
• Calculations depend on type of study:– Risk: cohort– Odds: case-control
• Once you have a measure of risk, you can compare between exposed and unexposed– Risk ratio or Odds ratio
![Page 34: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/34.jpg)
Risk• Risk = proportion• 6 our of 10 medical students are female• The risk of being female is 0.6 if you are a
medical student
Risk = affected / total(in this case the exposure is being a medical student, the outcome is being female)
• In a case-control, you don’t know the total exposed, so you can’t calculate risk.
• In a cohort, you determine exposure at the start, so you can
![Page 35: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/35.jpg)
Risk• Remember, in a cohort study, you select
according to exposure, and follow up to determine outcome
• Design a cohort study to look at car accidents in yellow and black cars– Suggest that yellow cars prevent accidents– Let’s suppose there are only two colours of car for
simplicity
![Page 36: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/36.jpg)
Risk• Exposure: car being yellow• Outcome: accident free after 1 year• Plan: determine exposure at the start (record
colour), follow up for one year and monitor for car accidents
• Draw a table– 100 yellow cars, 10 had accidents– 100 black cars, 20 had accidents
![Page 37: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/37.jpg)
Yes No
Yes 90 10 100
No 80 20 100
170 30
Exposure
Outcome
Totals
TotalsNo accidents at 1yr
Being yellow
![Page 38: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/38.jpg)
Risk
• We can calculate the risk in those exposed (yellow car) and those not exposed (black)
• Then we can calculate a ratio of the risks in the two groups
• Work out the formula…
![Page 39: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/39.jpg)
Relative Risk• The risk being accident free at one year if you
have a yellow car relative to if you have a black one = a ratio of the risks
RR = risk (exposed) / risk (unexposed)
• Or, how much more likely are you to be accident free if you drive a yellow car vs. a black one
• So work out the relative risk using our table• If RR = 1, there is no difference in risk.
![Page 40: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/40.jpg)
Yes No
Yes 90 10 100
No 80 20 100
170 30
Exposure
Outcome
Totals
TotalsNo accidents at 1yr
Being yellow
![Page 41: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/41.jpg)
Relative Risk
• Risk in exposed = 0.9• Risk in unexposed = 0.8
• Relative risk = 0.9/0.8 = 1.125
NB from these data you can also calculate an incidence, as mentioned earlier
![Page 42: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/42.jpg)
Absolute Risk Reduction
• ARR is a measure of the reduction in risk which an exposure causes
• This is basically what we want to know to decide whether something is effective – Does it make a difference, and if so how much?
• The main use of ARR is to calculate the NNT
• Could you work out the formula knowing this information?
![Page 43: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/43.jpg)
Absolute Risk Reduction
• Reduction in risk caused by an exposure
ARR = Risk (exposed) - Risk (unexposed)
• In our example:= Risk of accident free (yellow) - Risk (black)= 0.9 - 0.8= 0.1
![Page 44: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/44.jpg)
Number Needed to Treat
• NNT (or NNH - harm) is a useful intuitive number
• Just learn the formula:NNT = 1/ARR
• In this case 1/0.1 =10– So you would need to paint 10 cars yellow
to prevent one accident.
![Page 45: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/45.jpg)
Another example
• A trial looking at effectiveness of nicotine gum on smoking cessation
• 6328 smokers given gum, 1149 stopped• 8380 smokers given placebo, 893
stopped• Calculate the NNT You are allowed a calculator for this one!
– Table– Write out formulae
![Page 46: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/46.jpg)
Yes No
Yes 1149 5179 6328
No 893 7487 8380
2042 12666
Exposure
Outcome
Totals
TotalsSmoking cessation
Nicotine gum
![Page 47: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/47.jpg)
Odds
• Remember, Relative Risk needs the total exposed, which you can’t know from a case-control study
• Odds and Odds Ratio give similar information for data from case-control studies
• Note that in rare conditions the OR approximates the RR (you can work it out if you want, I wouldn’t bother)
![Page 48: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/48.jpg)
Odds
Odds = affected / unaffected
OR = odds (exposed) / Odds (unexposed)
![Page 49: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/49.jpg)
Odds• Consider a study looking retrospectively at
asbestos exposure in patients with mesothelioma
• 100 cases of mesothelioma, 80 recalled aspestos exposure
• 100 controls, 50 recalled aspestos exposure
• Draw a table…
![Page 50: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/50.jpg)
Yes No
Yes 80 50 130
No 20 50 70
100 100
Exposure
Outcome
Totals
TotalsMesothelioma
Aspestos exposure
![Page 51: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/51.jpg)
Odds
• Odds in exposed = 80/50 = 1.6• Odd in unexposed = 20/50 = 0.4• Odds ratio = 1.6 / 0.4 = 4
• I don’t find OR as intuitive as RR, and I think they are less useful– So hopefully less likely to need to calculate
them, but you might!
![Page 52: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/52.jpg)
Looking at numbers
• Some other useful things– P values and confidence intervals, chance
and error– Normal distribution and skewness– (Mean, median and mode)– (Standard deviation, standard error)
![Page 53: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/53.jpg)
Results Interpretation
• The point of any study is to inform us about things in the real world
• We need to consider:– Could the results be due to chance or do
they show a real effect?– Could error have affected the results– Can these results be applied to the real
world, I.e. are they generaliseable?
![Page 54: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/54.jpg)
Results Interpretation
• All a study can tell you is how likely or unlikely things are:– “This study shows X causes Y”– What we actually mean is “it is very likely
that X causes Y”
• How can this be measured?– How do we know if differences are due to
chance or due to a real effect?
![Page 55: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/55.jpg)
Significance
• A significant result is one that is unlikely to be due to chance alone– P value is the probability that the results
seen could have been caused by chance alone
– p < 0.05 or p < 0.01 are generally taken to indicate significance
![Page 56: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/56.jpg)
Significance
• The null hypothesis– This means that the results are due to
chance alone– If your p-value is less than your chosen
level of significance (say 0.05) then you “reject the null hypothesis”
– This means you are saying that you don’t think the results are due to chance.
![Page 57: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/57.jpg)
Significance• Take a finding with a p < 0.01
– This means that the chance that the observed results are due to chance is less than 1 in 100
– Or if you did the same experiment 100 times, one time the results would be due to chance, 99 times they would be due to a real effect.
• As your p value is less than your chosen level of significance, you reject the null hypothesis.
![Page 58: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/58.jpg)
Significance
• P values depend on power, I.e the amount of data available.
• The effect of chance in a small study is greater, hence it would have a bigger p value.
• When planning a study it is necessary to do a power calculation to work out the sample size which is likely to produce a significant result– Let’s not go there… (get a actual statistician)
![Page 59: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/59.jpg)
Confidence Intervals• A confidence interval gives a range for a
value of interest (such as relative risk)– Remember, if RR = 1 that means no effect
• As with p values, a CI is calculated with a chosen significance level (usually 0.05 - giving a 95% CI)
• If a CI range crosses 1, a result is not significant
• A CI gives the largest and smallest effects that are likely given the data
![Page 60: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/60.jpg)
Forest Plot
• Used in meta-analyses
• Plot confidence intervals– Which studies produced a significant
result?– Look at the effect on the values of having
extra power form aggregated data!
![Page 61: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/61.jpg)
Fig 3 Meta-analysis of studies showing impact of opiate substitution treatment in relation to HIV transmission in people who inject drugs among all pooled studies and studies reporting
only adjusted effect estimates .
MacArthur G J et al. BMJ 2012;345:bmj.e5945
©2012 by British Medical Journal Publishing Group
![Page 62: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/62.jpg)
Error
• Results from your data may (will) differ from ‘real life’ - this is error.– Random– Systematic
![Page 63: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/63.jpg)
Error - Random
• Random error occurs because we are only using a selection to get our information, not the whole population (sampling)– ß-error / Type II– Alpha-error / Type I
![Page 64: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/64.jpg)
Error - Random
• Beta / Type II– Conclude there is no association when
there is one– Due to a small study, not enough power,
sample size too small– The danger is that we are not be aware of
risk factors or treatments (also less likely to get published)
![Page 65: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/65.jpg)
Error - Random
• Alpha / Type I– Conclude there is an association when
there isn’t one (much worse)– Minimised by using a small P-value as our
chosen level of significance.– If the risk of harm due to a treatment was
very high, we might use a smaller P-value• P-value = risk of alpha error. 0.05 = 5% risk
![Page 66: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/66.jpg)
Error - Systematic
• Selection bias:– Esp. case-control studies (cases and controls not
comparable)– If controls are selected using criteria related to risk
factors under investigation• Selecting lung cancer controls from resp. clinic
– Rx: good study design and control selection
![Page 67: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/67.jpg)
Error - Systematic
• Information bias:– Mis-classification of disease or exposure
status– Recall bias is the main example
![Page 68: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/68.jpg)
Error - Systematic
• Confounding– Factor which is associated both with exposure and
outcome, and isn’t taken into account• Consider occupation and lung cancer rates• Smoking may be more common in some occupations
– Rx: good study design, anticipating confounders and taking into account
![Page 69: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/69.jpg)
Validity
• Validity: extent to which a variable measures what it is supposed to measure– Internal: study design, inferences about
study population– External: can the results be applied to non-
study patients/populations (is the study generalisable?)
– NB statistical association ≠ causality
![Page 70: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/70.jpg)
Skewness
Positive and negative skew in describing uni-modal data
![Page 71: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/71.jpg)
4. Screening
![Page 72: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/72.jpg)
Screening
• Not time to cover here properly
• Learn the Winson and Jungner criteria– Condition– Test– Treatment– Programme
• Learn about screening test evaluation
![Page 73: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/73.jpg)
Screening Test Evaluation
Again, having a descriptive defintion will help you to work out the formula:
• Sensitivity
• Specificity
• Positive Predictive Value
• Negative Predictive Value
• Likelihood Ratios
![Page 74: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/74.jpg)
Screening Test Evaluation
• Sensitivity and specificity: refer to test
• Predictive values: refer to population– Depend on disease prevalence
• Likelihood ratios: refer to individuals
![Page 75: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/75.jpg)
Screening Test Evaluation
• My advice:
• Draw a table (surprise!)– Consider doing this at the start of the exam
• Be able to work out the formulae from the table and your descriptive definitions
![Page 76: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/76.jpg)
Pos. Neg.
Pos.TRUE
POSITIVEFALSE
POSITIVE
Neg.FALSE
NEGATIVETRUE
NEGATIVE
TRUE
TEST
Remember: ‘positive’ or ‘negative’ refers to the test result
![Page 77: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/77.jpg)
Pos. Neg.
Pos.A B A+B
Neg.C D C+D
A+C B+DA+B C+D
TRUE
TEST
![Page 78: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/78.jpg)
Sensitivity
• How good a test is at picking up cases– What proportion of the cases of disease
are picked up by the test?– Cases of disease = A+C– Picked up by the test (true positives) = A– So…
Sensitivity = A / (A+C)
Pos. Neg.
Pos.A B A+B
Neg.C D C+D
A+C B+DA+B C+D
TRUE
TEST
![Page 79: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/79.jpg)
Specificity
• How specific is a positive test result to cases of the disease?– A specific test would have a small proportion false
positives (B), which mean sit would have a high proportion of true negatives (D)…
– Out of all of those without the disease (B+D)• Remember, specificity is independent of prevalence
– So…Specificity = D / (B+D)
Pos. Neg.
Pos.A B A+B
Neg.C D C+D
A+C B+DA+B C+D
TRUE
TEST
![Page 80: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/80.jpg)
PPV
• Chance that a test +ve actually has the disease– Test +ve who actually have disease (true
positives) = A – All test +ves = A+B– So…
PPV = A / (A+B)
Remember this depends in prevalence, which has important implications for screening
Pos. Neg.
Pos.A B A+B
Neg.C D C+D
A+C B+DA+B C+D
TRUE
TEST
![Page 81: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/81.jpg)
NPV
• Chance that a test -ve really doesn’t have the disease– Test negatives who really don’t have disease (ture
negatives) = D– All test -ves = C+D– So…
NPV = D / (C+D)
Remember this depends in prevalence, which has important implications for screening
Pos. Neg.
Pos.A B A+B
Neg.C D C+D
A+C B+DA+B C+D
TRUE
TEST
![Page 82: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/82.jpg)
Likelihood Ratios
• Useful when considering individuals
• +ve LR: How much more likely a person is to have a disease, if they test positive
• Allow you to take into account pre test probability.
![Page 83: Some Statistics and Epidemiology for the AKT. We’ll try to cover 1.General tips 2.Types of study, the ‘evidence hierarchy’, what you get from each study.](https://reader035.fdocuments.in/reader035/viewer/2022062308/56649e165503460f94b01050/html5/thumbnails/83.jpg)
So what to learn?
• AKT syllabus?– At least read the list of terms with wikipedia at your
side
• Stuff covered here?• Or key bits?
– Familiarity with study types– How to calculate an NNT– What P-values and ORs mean– Wilson and Junger criteria– Screening test evaluation– Mean/median/mode/SD and some graph types