Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician...

61
Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine & Pharmacology

Transcript of Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician...

Page 1: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

G.L. Drusano, M.D.Co-Director

Ordway Research Institute &Research Physician

New York State Department of HealthProfessor of Medicine & Pharmacology

Albany Medical College

Page 2: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

• Monte Carlo simulation was invented by Metropolis and von Neumann

• This technique and its first cousin Markov Chain Monte Carlo have been used since for construction of distributions (Markov Chain Monte Carlo was actually described as a solution to the “simulated annealing problem” in the Manhattan Project –Metropolis et al)

Page 3: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

• The first use of Monte Carlo simulation for drug dose choice and breakpoint determination was presented on October 15, 1998 at an FDA Anti-Infective Drug Products Advisory Committee

• At this time, the drug was presented as “DrugX” but was evernimicin

• The ultimate outcome was predicted by the method (but the drug died)

Page 4: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Role of Monte Carlo Simulation for Dose Choice for Clinical Trials of Anti-Infectives

Page 5: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Role of Monte Carlo Simulation for Dose Choice for Clinical Trials of Anti-Infectives

Required Factors for Rational Dose/Drug Comparison

1. Pharmacodynamic Goals of Therapy

2. Population Pharmacokinetic Modeling

3. Target Organism(s) MIC Distribution

4. Protein Binding Data in Animal and Man

Page 6: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Role of Monte Carlo Simulation for Dose Choice for Clinical Trials of Anti-Infectives

Drusano GL, SL Preston, C Hardalo, et al. Antimicrob Agents Chemother. 2001;45:13-22.

Page 7: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Role of Monte Carlo Simulation for Dose Choice for Clinical Trials of Anti-Infectives

Drusano GL, SL Preston, C Hardalo, et al. Antimicrob Agents Chemother. 2001;45:13-22.

Page 8: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Role of Monte Carlo Simulation for Dose Choice for Clinical Trials of Anti-Infectives

Drusano GL, SL Preston, C Hardalo, et al. Antimicrob Agents Chemother. 2001;45:13-22.

Page 9: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Role of Monte Carlo Simulation for Dose Choice for Clinical Trials of Anti-Infectives

Drusano GL, SL Preston, C Hardalo, et al. Antimicrob Agents Chemother. 2001;45:13-22.

Page 10: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Role of Monte Carlo Simulation for Dose Choice for Clinical Trials of Anti-Infectives

Drusano GL, SL Preston, C Hardalo, et al. Antimicrob Agents Chemother. 2001;45:13-22.

Page 11: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Role of Monte Carlo Simulation for Dose Choice for Clinical Trials of Anti-Infectives

Drusano GL, SL Preston, C Hardalo, et al. Antimicrob Agents Chemother. 2001;45:13-22.

Page 12: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Role of Monte Carlo Simulation for Dose Choice for Clinical Trials of Anti-Infectives

Drusano GL, SL Preston, C Hardalo, et al. Antimicrob Agents Chemother. 2001;45:13-22.

Page 13: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Role of Monte Carlo Simulation for Dose Choice for Clinical Trials of Anti-Infectives

Drusano GL, SL Preston, C Hardalo, et al. Antimicrob Agents Chemother. 2001;45:13-22.

Page 14: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Role of Monte Carlo Simulation for Dose Choice for Clinical Trials of Anti-Infectives

Drusano GL, SL Preston, C Hardalo, et al. Antimicrob Agents Chemother. 2001;45:13-22.

Page 15: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

• What is Monte Carlo simulation, as applied to Infectious Diseases issues?

• What are the technical issues?

• For what is Monte Carlo simulation useful?

Page 16: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

What is Monte Carlo simulation?MC simulation allows us to make use

of prior knowledge of how a target population handles a specific drug to predict how well that drug will perform clinically at the dose chosen for clinical trials and to rationally set breakpoint values for susceptibility

Page 17: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

How is this done?Through use of the mean

parameter vector and covariance matrix, derived from a population PK study, a sampling distribution is set up. This allows the peak concentrations, AUC and Time > threshold to be calculated for all the subjects

Page 18: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

How do we use this to predict the clinical utility of a specific drug dose?

1) Identify the goal of therapy (cell kill, resistance suppression, etc)2) Identify the sources of variability that affect achieving the goal of therapya) PK variability (accounted for by MCS)b) Variability in MIC’s (or EC95, etc)c) Protein binding (only free drug is

active)

Page 19: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

What do we do?As an example, for a drug that is

AUC/MIC driven in terms of goal of therapy (e.g. AUC/MIC of 100 for a good microbiological outcome), we can now take the 2000 (or 10000 or whatever) simulated subjects and divide the AUC by the lowest MIC in the distribution, then determine how many achieve the target of 100. This is then repeated with higher MIC values until the target attainment is zero or some low number

Page 20: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

How does this help evaluate the utility of a specific drug dose?

We have target attainment rates at each MIC value in the organism population distribution. A specific fraction of the organisms have a specific MIC. A weighted average for the target attainment rate (taking an expectation) can be calculated. This value will be the overall “expected” target attainment rate for the outcome of interest for that specific dose.

Page 21: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

Technical Issues

Page 22: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

• What are the factors that may affect the simulation?

►Model mis-specification

►Choice of distribution

►Covariance matrix (full vs diagonal)►Simulating the world from 6

subjects

Page 23: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

Model Mis-specification

Page 24: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

• Model mis-specificationSometimes, data are only available

from older studies where full parameter sets and their distributions were not reported

• Some investigators have used truncated models for simulation (1 cmpt vs 2 cmpt)

• This may have more effect for some drugs relative to others (β lactams vs quinolones)

Page 25: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

Choice of Distribution

Page 26: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

• There are many underlying distributions possible for parameter values

• Frequently, there are insufficient numbers of patients to make a true judgement

• One way to at least make the choice rational is to examine how one distribution vs another recapitulates the mean parameter values and measure of dispersion

• A quinolone example follows (N vs Log-N)

Page 27: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

Param Pop Mean

Sim Mean

Pop SD

Sim SD

Distr

Vol 23.32 22.80 33.51 30.15 LN

Kcp 2.662 2.985 9.591 11.84 LN

Kpc 0.9327 0.7515 12.03 4.388 LN

SCL 6.242 6.252 4.360 4.303 LN

Page 28: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

Param Pop Mean

Sim Mean

Pop SD

Sim SD

Distr

Vol 23.32 36.82 33.51 24.23 N

Kcp 2.662 8.926 9.591 6.311 N

Kpc 0.9327 9.914 12.03 7.370 N

SCL 6.242 6.936 4.360 3.817 N

Page 29: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

• Here, it is clear that the Log-normal distribution better recaptures the mean parameter values and, in general, the starting dispersion (except Kpc)

• And for AUC distribution generation, it is clear that Log-normal is preferred because it performs better for the parameter of interest (SCL) for both mean value and dispersion

• We have seen examples where there is no substantive difference (N vs Log-N)

Page 30: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

Full vs Major DiagonalCovariance Matrix

Page 31: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

• Sometimes, only the population standard deviations are available and only a major diagonal covariance matrix can be formed

• Loss of the off-diagonal terms will generally cause the distribution to become broader (see example)

• One can obtain an idea of the degree of impact if the correlation among parameters is known (of course if this is known, one could calculate the full covariance matrix!)

Page 32: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

Mean = 139.6

Median = 120.2

SD = 82.4

95% CI = 41.2-348.8

Mean = 140.4

Median = 121.4

SD = 83.5

95% CI = 40.7-351.4

0 200 400 600 800 1000Levofloxacin 750 mg AUC-Full Covariance Matrix

0

100

200

300

400

500

600

700

800

900

1000

Co

un

t

0.00

0.02

0.04

0.06

0.08

0.10

Pro

po

rtion

pe

r Ba

r

Page 33: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

Simulating the WorldFrom 6 Subjects

Page 34: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulationn = 6 n = 25

n = 50

Page 35: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

• Obviously, the robustness of the conclusions are affected by the information from which the population PK analysis was performed

• If the “n” is small, there may be considerable risk attendant to simulating the world

• One of the underlying assumptions is that the PK is reflective of that in the population of interest – care needs to be taken and appropriate consideration given to the applicability of the available data to the target population

Page 36: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation• But, in the end, something is probably better than

nothing, so simulate away, but interpret the outcomes conservatively

• It is also important to examine the SD’s, as drawing inferences on drug dose from volunteer studies, where CV%’s are sometimes circa 10% may be risky

• How many simulations should be done? - Answer: as always, it depends

• To stabilize variance in the far tails of the distribution (> 3 SD), it is likely that one would require > 10000 simulations

Page 37: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

• Utility of Monte Carlo simulation, a non-exhaustive list:

► Determination of drug dose to attain a specific endpoint

► Determination of a breakpoint

► Examine variability in drug penetration

Page 38: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

Some New Stuff:

1) Effect simulations for combinations

2) Use of estimated GFR in simulations

3) Identification of a resistance-counterselective dose

Page 39: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

Hope W et al. J Infect Dis 2005;192:673-680.

Page 40: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

Hope W et al. J Infect Dis 2005;192:673-680.

Greco Model for Combination Chemotherapy

Page 41: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

Hope W et al. J Infect Dis 2005;192:673-680.

Greco Model for Combination Chemotherapy

Page 42: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

Hope W et al. J Infect Dis 2005;192:673-680.

Page 43: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo SimulationA

B

C

A

B

C

5-FC 30 mg/Kg/dayAmphotericin B 1 mg/Kg/day

5-FC 30 mg/Kg/dayAmphotericin B 0.6 mg/Kg/day

5-FC 30 mg/Kg/dayAmphotericin B 0.3 mg/kg/day

Page 44: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

• It is straightforward to model combinations of agents

• Our laboratory has also done so for anti-retrovirals

• For Amphotericin B/5-FC, it is clear that the current dose of 5-FC is far too large (at least for C. albicans) and only adds toxicity

• Monte Carlo simulation shows that use of 30 mg/Kg 5-FC with Ampho B doses as low as 0.3 mg/Kg gives up little effect, but would have significantly diminished toxicity

Page 45: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Population Pharmacokinetic Parameter Values for Ceftobiprole

  Kh Vc K23 K32 CLsl CLint

Units h-1 L h-1 h-1 L/h L/h

Mean 51.8 7.65 3.05 1.10 0.510 2.35

Median 59.9 7.05 1.20 0.960 0.484 2.46

S.D. 17.5 3.89 5.14 0.951 0.318 1.98

Page 46: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Observed vs. Predicted Plot after the Bayesian Step

Observed = 1.003 x Predicted + 0.627; r2 = 0.947; p << 0.001

Page 47: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Ceftibiprole 500mg IV Q12H,30% Dosing Interval, 1hr Inf

0.1 1.0 10.0MIC (mg/L)

0.00.10.20.30.40.50.60.70.80.91.0

Fra

ctio

na

l Ta

r ge

t At t

ain

me

nt

12010080604020

ClCr (ml/min)

Target Attainment Probabilities for a 500 mg dose of ceftobiprole administered as a 1 hour, constant rate intravenous infusion every 12 hours. Target was maintaining free drug concentrations in excess of the MIC for 30% of the dosing interval. Estimated creatinine clearances were held constant for each analysis at the indicated values between 20 ml/min and 120 ml/min.

Page 48: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.
Page 49: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.
Page 50: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Gumbo et al. J Infect Dis 2004;190:1642-1651.

Page 51: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

11 )/(()1( XVSCLRdtdX c

SSSkSSSgS NMKENLKdtdN maxmax )1(

RRRkRRRgR MNKENLKdtdN maxmax )1(

)/)(1( POPMAXNNE SR

))//(()/( 5011HHH

c ECVcXVXL

HHHc ECVcXVXM 5011 )//(()/(

The model system delineated above was applied to all the data simultaneously

Gumbo et al. J Infect Dis 2004;190:1642-1651.

Page 52: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo Simulation

Gumbo et al. J Infect Dis 2004;190:1642-1651.

Total Population Resistant Population

Moxifloxacin Concentrations

Page 53: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte-Carlo Simulation and Moxifloxacin in Mtb Therapy

• Therapeutic target; moxifloxacin AUC/MIC of 53 in patients for resistance suppression

• Moxifloxacin doses of 400 mg a day, 600 mg a day, and 800 mg a day taken by 10,000 simulated patients

• Prior information: published population pharmacokinetic parameters

Page 54: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Moxifloxacin 400 mg a day. Target attainment=59.3%

The target here and in the next two slides is suppression of the resistant population

Page 55: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Moxifloxacin 600 mg a day. Target attainment=86.4%

Page 56: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Moxifloxacin 800 mg a day. Target attainment=93.1%

Page 57: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Moxifloxacin and M.tuberculosis Conclusion

• Moxifloxacin resistance in sub-therapeutic exposure occurs early during 2nd week of therapy.

• Drug doses associated with excellent microbial kill may amplify resistant population.

• Drug exposure associated with suppression of resistance is an AUC0-24/MIC of 53.

• Moxifloxacin daily dose of 800 mg may be better for MDRTB as opposed to current 400 mg a day dose recommended by CDC/IDSA/ATC because of resistance issues. Such a dose would need careful clinical evaluation because of QTc prolongation

Page 58: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo SimulationOverall Conclusions

• MCS is useful for rational breakpoint determination• MCS allows insight into the probability that a

specific dose will attain its target• This has been prospectively validated• The technique rests upon certain assumptions and

is as reliable as the assumptions • Care needs to be taken when applying the method,

particularly as regards applicability of the population studied and population size, among other issues

Page 59: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

Monte Carlo SimulationSense and Non-Sense

• WE CAN DO BETTER AND WE SHOULD!– As an aside, I have trying since the early 1980’s

to interest the infectious diseases community (and granting agencies) in pharmacodynamic modeling, notably WITHOUT SUCCESS!

– WELL!

Page 60: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.

George

Page 61: Monte Carlo Simulation G.L. Drusano, M.D. Co-Director Ordway Research Institute & Research Physician New York State Department of Health Professor of Medicine.