Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11...

45
Interpreting ADaM Standards with OpenCDISC Madhura Paranjape, Cytel Trupti Bal, Cytel Session CD04 - PhUSE 2012 16-Oct-12 1 PhUSE 2012 - CD04

Transcript of Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11...

Page 1: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

Interpreting ADaM Standards with OpenCDISC

Madhura Paranjape, Cytel

Trupti Bal, Cytel

Session CD04 - PhUSE 2012

16-Oct-12 1 PhUSE 2012 - CD04

Page 2: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

2

This presentation is based on first-hand experience of the presenters, their opinions and learnings.

However this is not to be construed as an official statement endorsed by Cytel

Disclaimer

2 PhUSE 2012 - CD04 16-Oct-12

Page 3: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

3 3

Agenda

• Introduction

• ADaM datasets workflow

• About OpenCDISC Validator

• Examples Handling TRTP ADaM for ISS AVAL vs. AVALC Additional cases

• Conclusion

• Discussion/Questions

3 16-Oct-12 PhUSE 2012 - CD04

Page 4: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

Analysis Dataset Model (ADaM)

• CDISC defined and FDA accepted standard

• Introduced in recent past

• Evolving

4

Introduction

4 PhUSE 2012 - CD04 16-Oct-12

Page 5: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

Ensuring compliance may seem like a tightrope walk

due to

a) Evolving standard – as yet unfamiliar

b) Stringent timelines

5

Introduction

5 5 16-Oct-12 PhUSE 2012 - CD04

Page 6: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

• Validation of datasets plays an important role

Ensure study specific needs are addressed

Datasets are ADaM compliant

6

Introduction

6 6 16-Oct-12 PhUSE 2012 - CD04

Page 7: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

7 7 PhUSE 2012 - CD04 16-Oct-12

SDTM datasets ADaM

Program development

ADaM specs

ADaM datasets

Final ADaM datasets

ADaM independent validation

OpenCDISC Validator

ADaM datasets workflow

OpenCDISC Validator is freely available and easy to use.

Page 8: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

8 8 PhUSE 2012 - CD04 16-Oct-12

About OpenCDISC Validator

Page 9: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

The tool for ensuring clinical data compliance with CDISC standards ADaM compliance check: • 130 rules based on ADaM Validation Checks • Gives a detailed report with issues categorized by

a) Severity: Error, Warning and Notice b) Type: Consistency, Format, Limit, Metadata, Presence, System

and Terminology • Extra pair of eyes for ensuring compliance with ADaM

9 9 PhUSE 2012 - CD04 16-Oct-12

About OpenCDISC Validator

Page 10: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

10 10 PhUSE 2012 - CD04 16-Oct-12

SDTM

datasets ADaM

Program

development

ADaM

specs

ADaM datasets workflow for examples

OpenCDISC

Validator

ADaM

datasets

Final

ADaM

datasets

ADaM

independent

validation

Page 11: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

11 11 PhUSE 2012 - CD04 16-Oct-12

Handling TRTP AVAL vs. AVALC

ADaM for ISS Additional Cases

Interpreting OpenCDISC messages and Understanding

ADaM

Page 12: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 12

Background

Problem

Reason

Lessons/

Solutions

Steps to go through

Page 13: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

Case 1

Handling TRTP

13 16-Oct-12 PhUSE 2012 - CD04

Page 14: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 14

• Study Design: Randomized, parallel

• Phase: III

• Dataset: ADEG

• OpenCDISC version: 1.2.1

Handling TRTP

TRTP:

• Record level Identifier

• Represents planned Treatment for a record

Page 15: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 15

ECG Assessment

Handling TRTP

Screening Visit 1 Visit 9 Visit 5

TRT A

TRT B

SDTM EG Dataset USUBJID EGTESTCD EGSTRESN EGSTRESU VISIT

ABC1201 HR 70 BEATS/MIN Screening ABC1201 HR 70 BEATS/MIN Visit 1

ABC1201 HR 72 BEATS/MIN Visit 5 ABC1201 HR 71 BEATS/MIN Visit 9

Page 16: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 16

ADEG Dataset

USUBJID (Unique Subject

Identifier)

TRTP (Planned

Treatment)

PARAMCD (Parameter

Code)

AVAL (Analysis

Value)

AVISIT (Analysis Visit)

ABC1201 HR 70 Screening

ABC1201 TRT A HR 70 Visit 1 ABC1201 TRT A HR 72 Visit 5

ABC1201 TRT A HR 71 Visit 9

SDTM EG Dataset USUBJID EGTESTCD EGSTRESN EGSTRESU VISIT ABC1201 HR 70 BEATS/MIN Screening ABC1201 HR 70 BEATS/MIN Visit 1

ABC1201 HR 72 BEATS/MIN Visit 5 ABC1201 HR 71 BEATS/MIN Visit 9

Handling TRTP

Page 17: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 17

AD1008: Null Value in variable marked as Required

ADEG ERROR

Handling TRTP

Page 18: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 18

ADEG Dataset

Details of Error:

USUBJID TRTP PARAMCD AVAL VISIT

ABC1201 HR 70 Screening

ABC1201 TRT A HR 70 Visit 1

ABC1201 TRT A HR 72 Visit 5

ABC1201 TRT A HR 71 Visit 9

Handling TRTP

Page 19: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

• The visit is screening

• No planned treatment at screening

• No valid value for TRTP

• Need to keep it blank

16-Oct-12 PhUSE 2012 - CD04 19

Handling TRTP

Page 20: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 20

Handling TRTP

Solution Override error because OpenCDISC Validator used SDTM definition

Page 21: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 21

• Required variables can be null

SDTM ADaM

• Required variables in ADaM

• Current version of OpenCDISC Validator allows null values in TRTP

Can be Null Can not be Null

TRTP STUDYID

USUBJID

ARM

PARAM

Handling TRTP

Page 22: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

Case 2

ADaM for ISS

22 16-Oct-12 PhUSE 2012 - CD04

Page 23: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 23

• Study Design:

Integrated Safety Summary (ISS) of 3 studies

• Dataset: ADLB

• OpenCDISC version: 1.3

ADaM for ISS

Page 24: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 24

ADaM for ISS

Laboratory schedule for 3 studies

V1 V2

Visits

V3 V4 V5 V6 Study

111 SCREEN I NG

Day 1 Week 2 Week 4 Month 2 Month 4 Month 6

112 Day 1 Day 10 Month 1 Month 6 Month 12 Follow up

113 Day 1 Month 1 Month 2 Month 3 Month 4 Month 5

Page 25: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 25

ADaM for ISS

SDTM to ADaM mapping

Study VISIT

111 Week 2

112 Day 10

113 Month 1

SDTM ADaM

AVISIT

Visit 2 (Week 2)

Visit 2 (Day 10 )

Visit 2 (Month 1)

AVISITN

2

STUDYID PARAMCD AVISIT AVISITN ABC111 ALT VISIT 1 (DAY 1) 1 ABC111 ALT VISIT 2 ( WEEK 2) 2 ABC112 ALT VISIT 1 ( DAY 1) 1 ABC112 ALT VISIT 2 ( DAY 10) 2 ABC113 ALT VISIT 1 ( DAY 1) 1 ABC113 ALT VISIT 1 ( MONTH 1) 2

ADLB snapshot

Page 26: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 26

ADLB ERROR

ADaM for ISS

AD0110: Inconsistent value for AVISIT Different Visit names for same AVISITN

Page 27: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

ADaM consistency principle:

AVISIT and AVISITN should have consistent values

for a given PARAMCD

16-Oct-12 PhUSE 2012 - CD04 27

ADaM for ISS

Page 28: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 28

• Different visit schedule for 3 studies • Analysis was study specific • Analysis visits were not defined in ISS SAP

ADaM for ISS

Page 29: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 29

Need to have Consistency within visits

Solution 1:

Solution 2:

ADaM for ISS

Drop AVISIT and AVISITN Add SDTM Visits

Study Specific Analysis

Remap to AVISIT and AVISITN

Integrated Analysis

Page 30: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 30

• ADaM IG does not strictly cover ISS/ ISE

• How much ADaM compliant datasets should be in such cases?

ADaM for ISS

Page 31: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

Case 3

AVAL vs. AVALC

31 16-Oct-12 PhUSE 2012 - CD04

Page 32: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 32

• Design: Placebo Controlled Study

• Phase: III

• Dataset: ADLB

• OpenCDISC version: v1.2.1

AVAL vs. AVALC

• AVAL: Analysis Value (Numeric)

• AVALC: Analysis Value (Character)

• AVAL and AVALC one to one relation

Page 33: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 33

For laboratory assessments if majority of results are indefinite, imputation of these values will be considered. Thus if the result has indefinite value, the upper limit, lower limit or median values need to be used in the summary. (for example, 0.1 can be used if the result is <0.1, >0.1, +0.1, or 0.1+)

USUBJID LBTESTCD VISIT LBSTRESC LBSTRESN ABC01023 GGT SCREENING >4 . ABC01023 GGT VISIT 1 3 3 ABC01023 GGT VISIT 3 >1 .

SDTM LB Dataset

Snapshot of Statistical analysis Plan

AVAL vs. AVALC

Page 34: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 34

LBSTRESC >4 3

>1

SDTM LB Dataset

AVAL AVALC 4 >4 3 3 1 >1

ADLB Dataset

AVAL vs. AVALC

USUBJID PARAMCD VISIT AVALC AVAL ABC01023 GGT SCREENING >4 4 ABC01023 GGT VISIT 1 3 3 ABC01023 GGT VISIT 3 >1 1

ADLB Dataset

Page 35: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 35

AD0149: Inconsistent value for AVALC

ADLB ERROR

AVAL vs. AVALC

Page 36: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 36

ADLB Dataset

Details of Error:

USUBJID PARAMCD VISIT AVALC AVAL ABC01023 GGT SCREENING >4 4 ABC01023 GGT VISIT 1 3 3 ABC01023 GGT VISIT 3 >1 1

AVAL vs. AVALC

Page 37: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

• AVAL values derived as per SAP

• Integer portion of indefinite value is used

• Hence AVALC = AVAL not possible

16-Oct-12 PhUSE 2012 - CD04 37

AVAL vs. AVALC

Page 38: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 38

Solution:

• Dropped AVALC

• Added LBSTRESC and LBSEQ

Lessons:

• Add LBSTRESC and LBSEQ for consistency

• Create different dataset with character and numeric results

AVAL vs. AVALC

Page 39: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 39

Recap

Handling TRTP

Core Attributes of SDTM & ADaM are

not ‘interchangeable’

Null values allowed in ADaM

“Required” variables

ADaM for ISS

AVISIT AND AVISITN have to

be consistent with each other

Need to determine how

compliant ISS/ISE needs to be with

ADaM

AVAL vs. AVALC

AVAL and AVALC need to have one

to one relation

Addition of SDTM variables for

consistency and traceability

Page 40: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 40

Additional Cases: 1

Study design: Open label Dataset: ADAE

Warning: Configuration Unavailable

Structure recently released Structure: SDTM + Added variables

Non-BDS, Non-ADSL structure cannot be reviewed

Page 41: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 41

Additional Cases: 2

Study design: Open label Dataset: ADMH

AD1005: Neither AVAL or AVALC present in dataset

Addition of Central Variable ASTDT to Non-BDS dataset

Need to determine structure of dataset beforehand Addition of central variables leads to BDS

Page 42: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 42

Additional Cases: 3

Study design: Any Dataset: Any BDS where time is imputed

AD0040: Variable ending in *TMF not in TIMEF codelist (described as D= Day, M= Month, Y= Year)

ASTMF flagged as ‘Y’. Value should be either H= Hours, M= Minutes, S= Seconds)

Correct Check, Incorrect Description!!!

Page 43: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

16-Oct-12 PhUSE 2012 - CD04 43

Recap

• Non-BDS cannot be reviewed by OpenCDISC Validator yet

• Addition of Central Variables should be considered for BDS type datasets only

• Need to consult ADaM/Study specific guidelines before acting on a OpenCDISC Message

Page 44: Interpreting ADaM Standards through OpenCDISC · validation . 16-Oct-12 PhUSE 2012 - CD04 11 Handling TRTP AVAL vs. AVALC ADaM for ISS Additional Cases Interpreting OpenCDISC messages

• ADaM more flexible than SDTM to address analysis needs

• Boon: Datasets can be suited to analysis

• Bane: Interpretation may change as per context/analysis

• OpenCDISC Validator valuable tool: Quick review

• OpenCDISC evolving with ADaM

• Independent Validation cannot be substituted

44 44 PhUSE 2012 - CD04 16-Oct-12

Conclusion

Walk the tightrope with OpenCDISC