Designing a pilot study using adaptive DP-optimality

29
Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz Designing a pilot study using adaptive DP-optimality Abhishek Gulati Stephen Duffull PODE, 2013

Transcript of Designing a pilot study using adaptive DP-optimality

Page 1: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

Designing a pilot study using adaptive

DP-optimality

Abhishek Gulati

Stephen Duffull

PODE, 2013

Page 2: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

• Low molecular weight heparin drugs (e.g. enoxaparin) are

used acutely in the treatment of various cardiovascular

diseases

• For example, heart attacks, deep vein thrombosis

• They act by reducing blood clot formation which encourages

clots to resolve

• Too much bleeding

• Too little further clots

• A test is needed to assess bleeding/clotting risk so we can get

the dose correct

Context - health

Page 3: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

Clotting is complex and complicated

TF VII VIIa

VIIa:TF VII:TF

II

IIa

V

Va

TAT

Xa

Xa:Va

IIa:Tmod

Tmod

PC APC

PS

APC:PS

X

Pg

P Fg

F

XF

DP

XIII XIIIa

XI XIa

XIIa

VIII

VIIIa

IX IXa

IXa:VIII

a

TFPI

Xa:TFPI

VIIa:TF:Xa:TFPI

r31

r32

r36

VKH2

VKO VK

Warfarin

IXa:AT-III:Heparin

Xa:AT-III:Heparin

AT-III:Heparin

r1

r2 r3

r4

r5

r6

r7 r8

r9

r10

r11

r12

r13

r14

r15

r16

r17

r18

r19

r20

r21

r22

r23

r24

r25

r26

r27

r28

r29 r30

r33

r35

r37

r34

r44

r45 r48

r47

pII

pVII

pIX

pX

pP

C

pPS

K

Pk

CA

XII

IIa:AT-III:Heparin

r38 r39 r40

r41

r42

r43

r46 VK_p

Page 4: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

A clotting time test

• The test is based on the notion that if you reduce the ability

of the blood to form a clot then the time to clot (clotting time)

will be prolonged.

• The degree of prolongation will determine the therapeutic or

toxic potential of the anticoagulant (enoxaparin).

– A clotting time of 10-20 seconds is normal.

– A clotting time of 40 to 80 seconds is therapeutic

– A clotting time of > 80 seconds may result in bleeding

• Note for a patient with a clotting disorder a normal clotting

time may result in further clot formation.

Page 5: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

Development of a clotting test

Proof-of-mechanism study

(in-silico and an in-vitro n-of-1 experiment)

Pilot study

(6 healthy volunteers)

Proof-of-concept study

(20 healthy volunteers)

Evaluation in patients

...

Page 6: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

• The proof-of-mechanism supported the thesis that we postulated

for setting up a test,

• However the curse of heterogeneity resulted in the test not

performing well in subsequent individuals

– Significant variability in clotting time responses between

individuals

• A pilot study was needed to determine the experimental

conditions under which its performance would be acceptable

across a wider range of individuals

• Two factors {Xa, Z} were considered as design variables.

Why the pilot?

Page 7: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

• Xa is used to cause an in-vitro clot.

– Too little and the clot doesn’t occur

– Too much and the clot occurs too fast and is insensitive to

enoxaparin

• Z is used to reduce variability of the clotting time response for

the in-vitro clot.

– Too little and it doesn’t work

– Too much and Z causes a clot to occur of its own accord.

The factors

Page 8: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

The pilot experiment

• A blood sample is taken from a subject

• The sample is split into different vials and 4 known amounts

of enoxaparin are added to provide concentrations of {0, 0.25,

0.5, 1.0} U/mL

• The two factors of interest are added (Xa & Z)

• The time for the blood to form a clot is measured

(= clotting time)

• Only a single combination of Xa and Z to be used per subject

• We can only study 6 subjects for the pilot

Page 9: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

• Minimax design

– Choose values that minimize the maximal variance in the

experimental cases

• Factorial design

– Consider a design that factors across all reasonable values

• Adaptive design

– Consider a method to determine the probability of success

over any values of Xa, Z by modelling the response

surface

Methods for choosing values of Xa & Z

Page 10: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

The response surface

• The response surface is described by a parametric function

with unknown parameter vector ()

• A surface will be determined for each of the 4 concentrations

of the anticoagulant enoxaparin {0, 0.25, 0.5, 1}

• From these 4 surfaces a utility function can be applied that

determines the overall success or failure of the test

Page 11: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

The adaptive design

• The parameters are estimated using an adaptive design

• This method is linked to D-optimality for parameter

estimation.

• It is also important for the pilot study to provide some

empirical evidence of the utility of the test and for this

purpose we used P-optimality (to optimise the probability of

experimental success)

• A utility function was used to incorporate experimental

success

Page 12: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

Aim

• To conduct a pilot study with 6 subjects to determine values

of {Xa, Z} to take forward into a proof-of-concept study

Page 13: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

Response surface

bXa

E

Z faf

fCT

5

2

][

][1

XaKf

f

Xaf

DXaZ

EXa

][

][1

enoxaparinK

enoxaparinf

DEE

][

][1

ZK

Zf

DZZ

Parameters, β = {a, b, KDE, KDZ }

The response surface (CT)

over values of Xa and Z is

determined for each

concentration value of

enoxaparin {0, 0.25, 0.5, 1}

Page 14: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

Formulating a utility from a set of

response surfaces

• The response surface will be determined for each of the 4

concentrations of enoxaparin.

• The response surface is characterised by a particular clotting

time over a range of values of Xa and Z.

• Values of the clotting time that are desirable are then

determined so that a utility can be formed.

– High utility = appropriate clotting times

Page 15: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

Defining success

1. (10s > CT >30s) | ([enoxaparin] = 0)

2. (CT fold prolongation is > 1.3) | ([enoxaparin] = 0.25)

3. (CT fold prolongation > 2 fold more than CT

([enoxaparin] = 0.25)) | ([enoxaparin] = 1)

4. (CT fold prolongation is < 5) | ([enoxaparin] = 1)

5. All CT values must be < 200s

Success = 1 when 1-5 are true

Page 16: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

Visual assessment of conditions

Xa Z

Page 17: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

DP-optimality

nsuccess CT when 0.1,

ysuccess CT when 0.9,U

Parameters, β = {a, b, KDE, KDZ }

Design variables, ξ = {Xa, Z}

UenoxaparinM pF

1

Ξ

])[,,ˆ(maxargˆ ξβξξ

p = number of parameters

Page 18: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

Adaptive design

Enroll subject i

Collect data

Fit the CT

model

Optimize

design

Initial design (0) i = 1

)ξ(ˆ

)(β̂

Pool data

i++

Page 19: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

A simulation study

Page 20: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

• The performance of the design were assessed by simulation

• 100 virtual trials (of 6 patients) were simulated and analysed as

per the pilot study protocol

• Assessment of the precision and accuracy of parameter values

were considered for both D and DP optimal designs

Methods

Page 21: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

Results

• Design performance for success

– D-optimal designs success=y on 24% of simulations

– DP-optimal design success=y on 94% of simulations

• Parameter values were estimated accurately by the 5th subject

• Not all parameter values could be estimated for the first few

subjects

Page 22: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

a

KDE

Page 23: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

b

KDZ

Page 24: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

The Actual Study

Page 25: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

Pilot study results

Adaptive Design

Iteration Subjects Design points Parameter values

(pooled data) Xa Z a KDE b KDZ

1 1 15 0.80 31 - - -

2 1,2 15 0.80 31 - - -

3 1,2,3 15 0.80 42 4.2 - -

4 1,2,3,4 15 0.80 74 3.2 10 -

5 1,2,3,4,5 15 3.3 52 3.1 11 25

6 1,2,3,4,5,6 15 0.90 60 3.1 11 7.1

Page 26: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

Clotting time response surfaces

Enoxaparin = {0, 0.25, 0.5, 1}

E = 0 E = 0.25

E = 0.5 E = 1

Page 27: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

Predicted Probability of Success

% s

ucc

ess

Page 28: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

• An adaptive design using DP-optimality provided a useful

method for designing the pilot study

• Fewer subjects were required than for a factorial design

• We have assumed that the parametric function provides a good

description of the response surface – this was based on our

understanding of the clotting system

• We have ranges of {Xa, Z} that are likely to provide a

successful proof-of-concept study (just completed)

Discussion

Page 29: Designing a pilot study using adaptive DP-optimality

Otago Pharmacometrics Group, School of Pharmacy, University of Otago ~ www.pharmacometrics.co.nz

Assoc Prof Geoff Isbister

Dr Jim Faed

University of Otago Research Grant

University of Otago Postgraduate Scholarship (Abhishek)

Staff at Southern Community Laboratories, Dunedin Hospital

Acknowledgements