Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte...
Transcript of Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte...
![Page 1: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/1.jpg)
Apps To Enable AI In EHR Research
Ben Glicksberg, PhD Butte Lab
Bakar Computational Health Sciences Institute University of California, San Francisco (UCSF)
@BenGlicksberg
![Page 2: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/2.jpg)
Clinical Informatics in the era of big data
“The Quantified Self” Electronic Health Records
![Page 3: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/3.jpg)
The power and diversity of EHR studies
![Page 4: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/4.jpg)
Towards a learning health system
![Page 5: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/5.jpg)
Challenges of using EHR data for research
• EHRs are challenging to represent health state o heterogeneous
o noisy o incomplete o structured / unstructured
o redundant o subject to random errors o subject to systematic errors o …and so and so forth
Patient
Reconstruction
EHR
Break down
![Page 6: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/6.jpg)
EHR barriers to entry • Computational • Domain knowledge:
• Structure • Language
Bodenreider, O (2004): Medical Language System (UMLS) : integrating biomedical terminology
![Page 7: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/7.jpg)
Cross-validation & replication in EHR research
EPIC Cerner
Model/Results Model/Results
![Page 8: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/8.jpg)
OMOP common data model (CDM)
Resources: https://www.ohdsi.org/ http://www.ohdsi.org/web/wiki/doku.php http://forums.ohdsi.org/ https://github.com/OHDSI/ (most documentation)
Language
Structure
Analysis
![Page 9: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/9.jpg)
CDM facilitates cross-validation and reproducibility
FHIR
OMOP
![Page 10: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/10.jpg)
OMOP CDM across the UC system
UC Health Data Analytics Platform
Health Data Warehouse
Network for cross-validation experiments
OMOP
![Page 11: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/11.jpg)
The OMOP system is efficient but complicated • OMOP still requires extensive domain and computational expertise
![Page 12: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/12.jpg)
OHDSI has developed powerful, advanced tools
https://github.com/OHDSI https://www.ohdsi.org/analytic-tools/
![Page 13: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/13.jpg)
…that are sometimes too advanced for most tasks
http://remembar.me/wp-content/uploads/2018/07/garage-pegboard-organization-interior-furniture-full-image-for-tool-storage-special-tools-and-ideas.jpg
https://www.ikea.com/ms/en_CA/customer_service/assembly_instructions/assembly_instructions1.html
![Page 14: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/14.jpg)
ROMOP a light-weight R package for interfacing with OMOP-formatted Electronic Health Record data Glicksberg et al. JAMIA Open (ooy059)
![Page 15: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/15.jpg)
Goals of ROMOP
1. Automatically connect to OMOP EHR relational database
2. Enable non-technical experts to easily pull data into R-object
3. Facilitate follow-up analyses
![Page 16: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/16.jpg)
What can ROMOP do? 1. Explore CDM fields 2. Generate population statistics 3. Search for patients:
• Any vocabulary • Inclusion/Exclusion criteria • Flexible search strategies
(e.g., and vs. or) 4. Retrieve all relevant data for
patients: • Demographics • Encounters • Clinical
5. Automatically map concepts to ontologies
6. Export search report
![Page 17: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/17.jpg)
Public sandbox server: interactive tutorial
http://romop.ucsf.edu
• 1MM patients from CMS synthesized clinical dataset (DE-SymPUF) • Package: https://github.com/BenGlicksberg/ROMOP
![Page 18: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/18.jpg)
Data and CDM exploration
![Page 19: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/19.jpg)
Define cohorts/Find patients
![Page 20: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/20.jpg)
Extract Data
![Page 21: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/21.jpg)
Summarize cohort
![Page 22: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/22.jpg)
PatientExploreR dynamic visualization of clinical history in OMOP format Glicksberg et al. (in revision)
![Page 23: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/23.jpg)
No flexible application exists
![Page 24: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/24.jpg)
EPIC
OMOP
Goals
![Page 25: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/25.jpg)
Public Sandbox Server
http://patientexplorer.ucsf.edu
- Synthesized data (no PHI) from CMS - 1 million patients - OMOP format - Open to the public
Code: https://github.com/BenGlicksberg/PatientExploreR
![Page 26: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/26.jpg)
![Page 27: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/27.jpg)
![Page 28: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/28.jpg)
Automatically generated
clinical history
![Page 29: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/29.jpg)
![Page 30: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/30.jpg)
Explore Trends in Data/ Outcomes (targeted)
![Page 31: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/31.jpg)
Explore Trends in Data/ Outcomes (numeric; targeted)
![Page 32: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/32.jpg)
Explore Trends in Data/ Outcomes (multiplex)
![Page 33: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/33.jpg)
Explore Trends in Data/ Outcomes (multiplex timeline)
![Page 34: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/34.jpg)
How might these tools enable AI-based EHR research?
![Page 35: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/35.jpg)
How well can we predict…
• Risk for disease • Disease onset • Symptom severity • Treatment response • Medication adverse events • Ideal dose of medication • Symptom flares • Length of stay in hospital
Beau Norgeot, MS
![Page 36: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/36.jpg)
More representation/data = better reflection of dx
How will model trained here…
…perform here?
1. Precision medicine: finding similar patients to go beyond treating doctor’s, clinic’s, department’s, hospital’s, or even
institution’s expertise.
2. Disease representation in EHR: electronic phenotyping algorithms might not be fully generalizable. Building as a
“meta” signature will be more robust
4. Multi-omic factors: incorporating genetics and environmental data (e.g., pollution) can
help pinpoint etiology and discern GxE interactions
3. Prediction: training and testing models across multiple institutions, alone and in conjunction,
will enable identifying ideal strategies
![Page 37: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,](https://reader033.fdocuments.in/reader033/viewer/2022051922/600fb3a31acb24056a1d435f/html5/thumbnails/37.jpg)
Acknowledgements Boris Oskotsky, PhD Vivek Rudrapatna, MD, PhD Debajyoti Datta, MD, PhD Beau Norgeot Nadav Rappoport, PhD Ted Goldstein, PhD Atul Butte, MD, PhD
Eugenia Rutenberg, MBA Angelo Pelonero Angela Rizk-Jackson, PhD Sharat Israni, PhD
Nicholas Giangreco Phyllis Thangaraj Nicholas Tatonetti, PhD
Li Li, MD Khader Shameer, PhD Riccardo Miotto, PhD Kipp Johnson Marcus Badgeley Mark Shervey Rong Chen, PhD Joel Dudley, PhD
Dana Ludwig, MD Remi Frazier Nelson Lee Rick Larsen Community and Developers