Challenges in Utilizing Accelerated Approval Robert J. Temple, M.D. Deputy Center Director for...

22
Challenges in Utilizing Challenges in Utilizing Accelerated Approval Accelerated Approval Robert J. Temple, M.D. Robert J. Temple, M.D. Deputy Center Director for Clinical Deputy Center Director for Clinical Science Science Center for Drug Evaluation and Research Center for Drug Evaluation and Research U.S. Food and Drug Administration U.S. Food and Drug Administration Accelerated Approval in Accelerated Approval in Rare Diseases Rare Diseases May 15, 2013 May 15, 2013

Transcript of Challenges in Utilizing Accelerated Approval Robert J. Temple, M.D. Deputy Center Director for...

Challenges in Utilizing Challenges in Utilizing Accelerated ApprovalAccelerated Approval

Robert J. Temple, M.D.Robert J. Temple, M.D.Deputy Center Director for Clinical ScienceDeputy Center Director for Clinical ScienceCenter for Drug Evaluation and ResearchCenter for Drug Evaluation and Research

U.S. Food and Drug AdministrationU.S. Food and Drug Administration

Accelerated Approval in Rare Accelerated Approval in Rare DiseasesDiseasesMay 15, 2013May 15, 2013

Surrogates in GeneralSurrogates in GeneralSurrogates come in many flavors. They are biomarkers of some kind, Surrogates come in many flavors. They are biomarkers of some kind, laboratory or clinical measurements that in some way are related to a laboratory or clinical measurements that in some way are related to a clinical outcome. But not all prognostic biomarkers are potential surrogates clinical outcome. But not all prognostic biomarkers are potential surrogates because changing them may or may not affect the outcome. A marker may because changing them may or may not affect the outcome. A marker may or may not be on the causal pathway for an outcome and they can vary as to or may not be on the causal pathway for an outcome and they can vary as to whether they are early or late on the causal pathway for the outcome. Thus, whether they are early or late on the causal pathway for the outcome. Thus, a biomarker can be an indicator of risk but not the cause of the risk. (CRP, a biomarker can be an indicator of risk but not the cause of the risk. (CRP, for example, may indicate the presence of an inflammatory risk of CAD, but for example, may indicate the presence of an inflammatory risk of CAD, but may not cause it.) Many years ago, the “New York School” thought elevated may not cause it.) Many years ago, the “New York School” thought elevated BP was not a cause of vascular disease but a response to it, and that BP was not a cause of vascular disease but a response to it, and that lowering BP would be bad for CV outcome, not good.lowering BP would be bad for CV outcome, not good.

The hallmark, however, for use of a surrogate for AA is that improvement in The hallmark, however, for use of a surrogate for AA is that improvement in the surrogate is “reasonably likely” to predict the clinical benefit, which the surrogate is “reasonably likely” to predict the clinical benefit, which means we think it is likely to be causal or to be responding in the same way means we think it is likely to be causal or to be responding in the same way that the actual cause is responding. If it is that the actual cause is responding. If it is suresure to predict the outcome, we to predict the outcome, we give regular approval (BP, hyperkalemia, elevated LDL, at least for a statin).give regular approval (BP, hyperkalemia, elevated LDL, at least for a statin).

2

Surrogates – where/why Surrogates – where/why usedused

You would use a surrogate in AA to approve a drug for a serious or life-You would use a surrogate in AA to approve a drug for a serious or life-threatening disease that has a meaningful advantage over available threatening disease that has a meaningful advantage over available therapy when, for some reason, the “real” endpoint is too difficult, or too therapy when, for some reason, the “real” endpoint is too difficult, or too delayed, to assess (NOT, usually, because the expected clinical effect is delayed, to assess (NOT, usually, because the expected clinical effect is not seen in a trial).not seen in a trial).

Why would it be too hard, assuming your surrogate is on the causal Why would it be too hard, assuming your surrogate is on the causal path? Two main reasons:path? Two main reasons:

1.1.The “real” effect is delayed.The “real” effect is delayed.

2.2.The clinical outcome effect is very rare, even though the surrogate The clinical outcome effect is very rare, even though the surrogate effect is common.effect is common.

[Simply failing to show the expected effect, when the endpoint is [Simply failing to show the expected effect, when the endpoint is common, e.g., because biomarkers are easier to affect than clinical common, e.g., because biomarkers are easier to affect than clinical outcomes is probably not a good reason. Arguably, at least, we did that outcomes is probably not a good reason. Arguably, at least, we did that for midodrine, and showing a real benefit has been remarkably difficult]for midodrine, and showing a real benefit has been remarkably difficult]

3

Surrogate – Effect Surrogate – Effect DelayedDelayed

Some genetic diseases, although present at birth, have no Some genetic diseases, although present at birth, have no consequences for many years (Huntington’s Disease, high risk consequences for many years (Huntington’s Disease, high risk genes for Alzheimer’s Disease, breast cancer, ovarian cancer, genes for Alzheimer’s Disease, breast cancer, ovarian cancer, polycystic kidney disease). It might be desirable/essential to polycystic kidney disease). It might be desirable/essential to suppress them early, staving off the later disease, but you suppress them early, staving off the later disease, but you would not know the impact for years to decades.would not know the impact for years to decades.

In more familiar territory, a clear anti-cancer effect (shrinking In more familiar territory, a clear anti-cancer effect (shrinking the tumor or delaying progression), depending on the tumor, the tumor or delaying progression), depending on the tumor, may not have a demonstrated survival effect for years.may not have a demonstrated survival effect for years.

We usually want very effective anti-neoplastic drugs sooner We usually want very effective anti-neoplastic drugs sooner than that, so AA is common in oncology.than that, so AA is common in oncology.

4

Surrogate – Rare Surrogate – Rare OutcomeOutcome

Depending on age, other risks, etc., elevated BP or Depending on age, other risks, etc., elevated BP or LDL will cause consequences (AMI, stroke, death) LDL will cause consequences (AMI, stroke, death) rarely (<1%) so that a trial to examine their effect, rarely (<1%) so that a trial to examine their effect, even if effect is large, could be very large, very even if effect is large, could be very large, very difficult, and very prolonged. And, because of other difficult, and very prolonged. And, because of other risk factors (most risks are multi-factorial), the effect risk factors (most risks are multi-factorial), the effect may not be as large as one could hope, maybe 20% for may not be as large as one could hope, maybe 20% for an antihypertensive instead of 100%.an antihypertensive instead of 100%.

For a bad disease with no treatment, even if mortality For a bad disease with no treatment, even if mortality is only a few percent, there is, appropriately, a sense is only a few percent, there is, appropriately, a sense of urgency in getting a treatment likely to be effective.of urgency in getting a treatment likely to be effective.

5

Getting Clinical EvidenceGetting Clinical Evidence

Although surrogates may be available, nonetheless, where Although surrogates may be available, nonetheless, where it is reasonably possible, ways to show an effect on the it is reasonably possible, ways to show an effect on the actual clinical outcome should be considered. It may be actual clinical outcome should be considered. It may be possible, under 505(d), as amended in 1997, to rely on a possible, under 505(d), as amended in 1997, to rely on a single, well-controlled study and “confirmatory evidence,” single, well-controlled study and “confirmatory evidence,” as a basis for approval. FDA’s guidance “Providing Clinical as a basis for approval. FDA’s guidance “Providing Clinical Evidence of Effectiveness for Human Drugs and Biological Evidence of Effectiveness for Human Drugs and Biological Products” describes many ways to do this. It should be Products” describes many ways to do this. It should be appreciated that historically controlled trials, plausible appreciated that historically controlled trials, plausible when a disease's natural history is well-described, can be a when a disease's natural history is well-described, can be a basis for approval, and often are for orphan diseases. basis for approval, and often are for orphan diseases. There has long been explicit recognition of the need for There has long been explicit recognition of the need for flexibility in dealing with serious rare diseases in 312.80 flexibility in dealing with serious rare diseases in 312.80 (Subpart E), reinforced in FDASIA.(Subpart E), reinforced in FDASIA.

6

7

Past ActivityPast Activity

FDA has used the mechanisms suggested FDA has used the mechanisms suggested under Subpart E (312.80) and Subpart H under Subpart E (312.80) and Subpart H (314.510) fairly often as a basis for approval (314.510) fairly often as a basis for approval for orphan drugs. The “score” is described in a for orphan drugs. The “score” is described in a paper by Frank Sasinowski of NORD published paper by Frank Sasinowski of NORD published in 2011; setting forth the “Quantum of in 2011; setting forth the “Quantum of Effectiveness Evidence in FDA’s Approval of Effectiveness Evidence in FDA’s Approval of Orphan Drugs.” Apart from demonstrating Orphan Drugs.” Apart from demonstrating flexibility, it suggests the pathways other than flexibility, it suggests the pathways other than AA that FDA has used and that therefore can AA that FDA has used and that therefore can be considered, several of which I will expand be considered, several of which I will expand onon

8

Past HistoryPast HistoryThe NORD report makes interesting reading, but the cases I The NORD report makes interesting reading, but the cases I would emphasize are these:would emphasize are these:

1. Historically controlled studies include both comparisons 1. Historically controlled studies include both comparisons of outcomes on drug and an explicit non-treated group over of outcomes on drug and an explicit non-treated group over a similar time period, and baseline controlled studies in a similar time period, and baseline controlled studies in which the treated group is compared with the “natural which the treated group is compared with the “natural history” of the disease, but not a specific group of patients. history” of the disease, but not a specific group of patients. This is common in oncology, where tumor response rates This is common in oncology, where tumor response rates are often a basis for accelerated approval (or even full are often a basis for accelerated approval (or even full approval) because it is clear that tumors do not shrink in approval) because it is clear that tumors do not shrink in the absence of treatment. It is clear that a major issue in the absence of treatment. It is clear that a major issue in these cases is the quality of the data defining the natural these cases is the quality of the data defining the natural history, i.e., what actually occurs in the absence of therapy.history, i.e., what actually occurs in the absence of therapy.

2. Very small randomized studies that are nonetheless 2. Very small randomized studies that are nonetheless successful in showing effects, sometimes the only study, successful in showing effects, sometimes the only study, and sometimes the second study, supporting effectiveness.and sometimes the second study, supporting effectiveness.

9

Historical ControlsHistorical ControlsNatural History of the Natural History of the

DiseaseDiseaseThere are two critical reasons for trying to define as There are two critical reasons for trying to define as well as possible the natural history of an orphan well as possible the natural history of an orphan disease and the variability of that history.disease and the variability of that history.

1. If the natural history is very well defined and the 1. If the natural history is very well defined and the drug effect is large, a single-arm, historically drug effect is large, a single-arm, historically controlled study (baseline controlled or with an controlled study (baseline controlled or with an explicit historical control group) can be, and explicit historical control group) can be, and sometimes has been, the basis for approval.sometimes has been, the basis for approval.

BUT, you really must know the history, as a long-past BUT, you really must know the history, as a long-past example illustrates. It suggests that one must always example illustrates. It suggests that one must always be concerned about even natural histories that seem be concerned about even natural histories that seem clearly defined.clearly defined.

10

Historical ControlsHistorical ControlsFulminant Hepatitis BFulminant Hepatitis B

In a letter to the NEJM in 1971, Gocke described 9 cases of In a letter to the NEJM in 1971, Gocke described 9 cases of acute fulminant hepatitis B, all fatal despite exchange acute fulminant hepatitis B, all fatal despite exchange transfusion, steroids. Then they gave 8 patients with hepatic transfusion, steroids. Then they gave 8 patients with hepatic coma or pre-coma anti-Australia antigen serum with 5/8 coma or pre-coma anti-Australia antigen serum with 5/8 survival.survival.

Gocke thought, maybe, they were done, and was concerned Gocke thought, maybe, they were done, and was concerned about the ethics of doing a controlled trial, but in the end he about the ethics of doing a controlled trial, but in the end he was unsure about whether current patients and Rx were all the was unsure about whether current patients and Rx were all the same so they did an NHLBI-sponsored RCT of hyperimmune same so they did an NHLBI-sponsored RCT of hyperimmune globulin vs normal serum in 30 centers with 63 patients, 53 of globulin vs normal serum in 30 centers with 63 patients, 53 of whom were analyzed (10 did not have hepatitis B antigen or whom were analyzed (10 did not have hepatitis B antigen or had no specimens).had no specimens).

Survival was 9/28 (32%) on placebo and 7/25 (28%) on hepatitis Survival was 9/28 (32%) on placebo and 7/25 (28%) on hepatitis B immune globulin, surely a surprise in view of the historical B immune globulin, surely a surprise in view of the historical experience [Acute Hepatic Failure Study Group. Failure of experience [Acute Hepatic Failure Study Group. Failure of specific immunotherapy in fulminant type B hepatitis. Amer. Int specific immunotherapy in fulminant type B hepatitis. Amer. Int Med (1977); 86: 272-277.]Med (1977); 86: 272-277.]

11

Historical ControlsHistorical Controls

So care in use of historical controls is So care in use of historical controls is critical. It greatly helps when critical. It greatly helps when mechanism of disease is clear and drug mechanism of disease is clear and drug is designed to reverse/correct the is designed to reverse/correct the mechanism.mechanism.

2. The second major reason to 2. The second major reason to understand the natural history is that it understand the natural history is that it will help greatly in designing a will help greatly in designing a randomized trial if one is needed.randomized trial if one is needed.

12

A Concurrently Controlled A Concurrently Controlled Clinical Trial Is NeededClinical Trial Is Needed

In many cases, even for orphan diseases, In many cases, even for orphan diseases, the natural history is not “fixed” enough the natural history is not “fixed” enough or well known enough and a randomized or well known enough and a randomized trial will be needed (one or 2, separate trial will be needed (one or 2, separate question). It is therefore critical to think question). It is therefore critical to think about how to do that most efficiently. about how to do that most efficiently. There are 2 specific designs to consider:There are 2 specific designs to consider:

• Enrichment designsEnrichment designs• Crossover and N of 1 designsCrossover and N of 1 designs

13

Efficiencies in Concurrently Efficiencies in Concurrently Controlled TrialsControlled Trials

But first, a pitch:But first, a pitch:

As I’ve noted, and as NORD documents, we have relied on historical As I’ve noted, and as NORD documents, we have relied on historical controls and they can indeed be persuasive, but there will usually controls and they can indeed be persuasive, but there will usually be a “kernel” of doubt, always a concern for a drug developer, so it be a “kernel” of doubt, always a concern for a drug developer, so it is critical to ask: can this be avoided?is critical to ask: can this be avoided?

I recall, 20-30 years ago, hearing Tom Chalmers urge people, I recall, 20-30 years ago, hearing Tom Chalmers urge people, especially where bad diseases were involved, to “randomize the especially where bad diseases were involved, to “randomize the first patient,” because later, if there were hints of effect, there will first patient,” because later, if there were hints of effect, there will be growing reluctance to do so. I just read the invitation to the be growing reluctance to do so. I just read the invitation to the Cochrane Colloquium in Canada in Sept and their plans for the Cochrane Colloquium in Canada in Sept and their plans for the Thomas C. Chalmers Award, which saysThomas C. Chalmers Award, which says

He is perhaps best known for the notion “randomize the first He is perhaps best known for the notion “randomize the first patient,” reflecting the belief that it is more ethical to patient,” reflecting the belief that it is more ethical to

randomize than randomize than to treat in the absence of good evidence.to treat in the absence of good evidence.

Amen.Amen.

14

EfficienciesEfficienciesLet me also note a recent publication by Korn, McShane, Let me also note a recent publication by Korn, McShane, and Friedlin of the NCI [Statistical challenges in the and Friedlin of the NCI [Statistical challenges in the evaluation of treatments for small patient population. evaluation of treatments for small patient population. Science Translational Medicine 2013; 5:1-14] that Science Translational Medicine 2013; 5:1-14] that discusses the full range of design considerations for discusses the full range of design considerations for studies of diseases with small patient populations.studies of diseases with small patient populations.

Enrichment:Enrichment:

In various ways enriched studies seek to test In various ways enriched studies seek to test therapies in therapies in patients with a high likelihood of having patients with a high likelihood of having an endpoint an endpoint (prognostic enrichment) or of having a (prognostic enrichment) or of having a response (predictive response (predictive enrichment), each of which allows enrichment), each of which allows for a smaller study. One for a smaller study. One specific design is the specific design is the randomized withdrawal study, where randomized withdrawal study, where patients doing patients doing well on a treatment are randomized to continued well on a treatment are randomized to continued treatment or placebo, a kind of predictive enrichment. treatment or placebo, a kind of predictive enrichment.

The first study of this type we saw was the basis for The first study of this type we saw was the basis for approval approval for nifedipine for vasospastic angina.for nifedipine for vasospastic angina.

15

16

17

Modified Study DesignsModified Study Designs1. Cross-over Studies1. Cross-over Studies

For a persistent disease, where the drug modifies symptoms or For a persistent disease, where the drug modifies symptoms or the the

underlying disease in a reversible way, a randomized cross-over underlying disease in a reversible way, a randomized cross-over study study

should decrease the needed sample size by about a factor of two, should decrease the needed sample size by about a factor of two, as as

each subject serves as own control.each subject serves as own control.

All subjects are exposed to both treatments.All subjects are exposed to both treatments.

Should minimize inter-subject variabilityShould minimize inter-subject variability

Would appear attractive in such conditionsWould appear attractive in such conditions• epilepsyepilepsy• chronic painchronic pain• many metabolic abnormalitiesmany metabolic abnormalities• diabetic controldiabetic control

18

Modified Study Modified Study DesignsDesigns

2. N of 1 designs2. N of 1 designs

Really a kind of x-over. A classic study was Gelfand, et al in 1976 Really a kind of x-over. A classic study was Gelfand, et al in 1976 NEJM, a NEJM, a

study of danazol in HAE.study of danazol in HAE.

NineNine patients (with attacks of ≥ 1 per month) were assigned to a patients (with attacks of ≥ 1 per month) were assigned to a random random

sequence of drug or placebo, to be taken for 1 month, but treatment sequence of drug or placebo, to be taken for 1 month, but treatment was was

stopped if there was an attack, and patient moved to the next stopped if there was an attack, and patient moved to the next treatment.treatment.

Total of 46 or 47 course of drug or placeboTotal of 46 or 47 course of drug or placebo

1/46 danazol courses had an attack1/46 danazol courses had an attack44/47 placebo courses had an attack44/47 placebo courses had an attack

The p-value was described as < 0.01, but that was the per patient The p-value was described as < 0.01, but that was the per patient result. result.

Pooled would be far smaller.Pooled would be far smaller.

Note 2 thingsNote 2 thingsA tiny number of patients had MANY treatmentsA tiny number of patients had MANY treatmentsIt worked out because effect was largeIt worked out because effect was large

When Accelerated Approval Is When Accelerated Approval Is NeededNeeded

There are many famous surrogate errors (I promised There are many famous surrogate errors (I promised Emil I would not mention antiarrhythmics and CAST) but Emil I would not mention antiarrhythmics and CAST) but there are many others:there are many others:Drugs raise HDL but leave CV outcomes unchanged or Drugs raise HDL but leave CV outcomes unchanged or worseworseQuinidine prevents AF recurrence but increases Quinidine prevents AF recurrence but increases mortalitymortalityManyMany inotropes improve cardiac function and exercise inotropes improve cardiac function and exercise but kill patientsbut kill patientsDigoxin improves exercise in CHF but does not affect Digoxin improves exercise in CHF but does not affect death death Erythropoietin raises hemoglobin in renal disease (low Erythropoietin raises hemoglobin in renal disease (low hemoglobin predicts bad outcome) but worsens outcomehemoglobin predicts bad outcome) but worsens outcome

19

When Accelerated Approval Is When Accelerated Approval Is NeededNeeded

What helps?What helps?

The White Paper enumerates many of these.The White Paper enumerates many of these.

1.1.Clear understanding of the pathophysiologic cause of the disease, Clear understanding of the pathophysiologic cause of the disease, together with a clear understanding of what the drug does to that together with a clear understanding of what the drug does to that pathophysiology, and, in particular, what it does at the relevant site pathophysiology, and, in particular, what it does at the relevant site of action (i.e., not just in the blood).of action (i.e., not just in the blood).

How to measure all this is critical, of course, easiest if the How to measure all this is critical, of course, easiest if the disease is deficiency of a blood enzyme or coagulation factor, disease is deficiency of a blood enzyme or coagulation factor, harder if it is a cellular defect.harder if it is a cellular defect.

2.2.You would like to be sure of no off-target effects, but, of course, You would like to be sure of no off-target effects, but, of course, that is often not possible.that is often not possible.

20

What Helps?What Helps?

Hard to put into words, but you’d like the effect on the Hard to put into words, but you’d like the effect on the marker to at least appear to be directly translatable to the marker to at least appear to be directly translatable to the defect.defect.Replace muscle dystrophin at usual amountReplace muscle dystrophin at usual amountReplace a coagulation factorReplace a coagulation factorProvide a missing enzyme in the right locationProvide a missing enzyme in the right location

It helps to know that the clinical defect relates to the It helps to know that the clinical defect relates to the degree of marker abnormality, as measured (blood, tissue).degree of marker abnormality, as measured (blood, tissue).

It should be noted that experience with AA (oncology and It should be noted that experience with AA (oncology and anti-viral) is pretty good to date.anti-viral) is pretty good to date.

21

SummarySummary

For well-understood diseases, true of many orphans as we get For well-understood diseases, true of many orphans as we get better at discovering genetic causes, and where we replace better at discovering genetic causes, and where we replace the defective protein, surrogate endpoints representing the the defective protein, surrogate endpoints representing the correction of the critical causative defect are highly credible.correction of the critical causative defect are highly credible.

Given history it is still preferable to show a tangible clinical Given history it is still preferable to show a tangible clinical effect of treatment if the defect is reversible and if the benefit effect of treatment if the defect is reversible and if the benefit can be soon apparent, but where there is significant delay in can be soon apparent, but where there is significant delay in reversing the defect, an accelerated approval can begin to reversing the defect, an accelerated approval can begin to treat a devastating disease much sooner than would otherwise treat a devastating disease much sooner than would otherwise be possible.be possible.

This is why Subpart H is there and FDASIA endorses it This is why Subpart H is there and FDASIA endorses it strongly.strongly.

22