Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing...

18
Paper SM07 ---------------------------------------- PhUSE EU Connect 2019 ---------------------------------- Automate Validation of Statistical Reports Neel Patel Deepak Kumar Anik Chatterjee Disclaimer - Any views or opinions presented in this presentation are solely those of author and do not necessarily represent those of the company.

Transcript of Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing...

Page 1: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples

Paper SM07 ----------------------------------------

PhUSE EU Connect 2019

----------------------------------

Automate Validation of Statistical Reports

Neel PatelDeepak KumarAnik Chatterjee

Disclaimer - Any views or opinions presented in this presentation are solely those of author and do not necessarilyrepresent those of the company.

Page 2: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples

Agenda

• Ideation• How it works?• Benefits & Challenges• Process (demo)• Conclusion• Potential• Questions

PhUSE EU Connect 2019 2

Page 3: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples

Ideation – Problem

• Independent programmers validate reports.• Visual comparison is performed with original output.• Some safety reports are 20+ pages long.• Chances of oversight is high during manual comparison.

PhUSE EU Connect 2019 3

Page 4: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples

Ideation – Problem

• Independent programmers validate reports.• Visual comparison is performed with original output.• Some safety reports are 20+ pages long.• Chances of oversight is high during manual comparison.

Multiply this problem with 10x because we have many studies.

PhUSE EU Connect 2019 4

Page 5: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples

Ideation – Solution

What can be done???

PhUSE EU Connect 2019 5

Page 6: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples

Ideation – Solution

Is it possible to convert RTF reports to SAS dataset?

The answer is YES!

We followed two-step process.1. Read the RTF reports and convert them to SAS dataset2. Compare that SAS dataset with independently generated dataset.

PhUSE EU Connect 2019 6

Page 7: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples

Ideation – Solution

PhUSE EU Connect 2019 7

Page 8: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples

How it works?

Segregating rows into columns.

PhUSE EU Connect 2019 8

Page 9: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples

How it works?

Removal of controlled characters and making it human readable.

PhUSE EU Connect 2019 9

Page 10: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples

Benefits

• Time efficient (human eye vs. machine)• Additional layer of check• Saves time in repetitive checking• Can be reused in multiple studies

Challenges• Initial time investment for writing up QC code• Title & footnote can not be checked

PhUSE EU Connect 2019 10

Page 11: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples

What is next?

Imagine if there is a SAS functions which can perform all discussed steps and even perform comparison...

PhUSE EU Connect 2019 11

Page 12: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples

Why FCMP?

• Functions are independent from the main program unlike macros.• Macro variables can get mixed with global vs. local variables.• PROC FCMP written in (essentially) in SAS syntax.• Ease of use in SQL / DATA step etc.

PhUSE EU Connect 2019 12

Page 13: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples

Show me more!

PhUSE EU Connect 2019 13

Page 14: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples

Conclusion

• Automation helps in faster output review.• Saves lot of time and efforts (mostly for safety reporting).• Reduce the chances of oversight during visual review process

PhUSE EU Connect 2019 14

Page 15: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples

Acknowledgment

• Anik Chatterjee (Team Lead, Novartis) for original ideation and assistance. His constant guidance helped through ideation to final paper and presentation.

• Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples in easy language and it heled us a lot.

PhUSE EU Connect 2019 15

Page 16: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples

Potential

• Automation helps in faster output review.• Saves lot of time and efforts.

PhUSE EU Connect 2019 16

Page 17: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples

Questions

PhUSE EU Connect 2019 17