Preprint
Machine Learning

Scalable and accurate deep learning with electronic health records

Alvin Rajkomar(Google (United States)), Eyal Oren(Google (United States)), Kai Chen(Google (United States)), Andrew M. Dai(Google (United States)), Nissan Hajaj(Google (United States)), Michaela Hardt(Google (United States)), Peter J. Liu(Google (United States)), Xiaobing Liu(Google (United States)), Jake Marcus(Google (United States)), Mimi Sun(Google (United States)), Patrik Sundberg(Google (United States)), Hector Yee(Google (United States)), Kun Zhang(Google (United States)), Yi Zhang(Google (United States)), Gerardo Flores(Google (United States)), Gavin E. Duggan(Google (United States)), Jamie Irvine(Google (United States)), Quoc Le(Google (United States)), Kurt Litsch(Google (United States)), Alexander Mossin(Google (United States)), Justin Tansuwan(Google (United States)), De Wang, James Wexler(Google (United States)), Jimbo Wilson(Google (United States)), Dana Ludwig(University of California, San Francisco), Samuel L. Volchenboum(University of Chicago), Katherine Chou(Google (United States)), Michael Pearson(Google (United States)), Srinivasan Madabushi(Google (United States)), Nigam H. Shah(Stanford University), Atul J. Butte(University of California, San Francisco), Michael D. Howell(Google (United States)), Claire Cui(Google (United States)), Greg S. Corrado(Google (United States)), Jeffrey Dean(Google (United States))
May 4, 2018npj Digital Medicine2,808 citations

2.8k

Citations

120

Influential Citations

npj Digital Medicine

Venue

2018

Year

Abstract

Predictive modeling with electronic health record (EHR) data is anticipated to drive personalized medicine and improve healthcare quality. Constructing predictive statistical models typically requires extraction of curated predictor variables from normalized EHR data, a labor-intensive process that discards the vast majority of information in each patient's record. We propose a representation of patients' entire raw EHR records based on the Fast Healthcare Interoperability Resources (FHIR) format. We demonstrate that deep learning methods using this representation are capable of accurately predicting multiple medical events from multiple centers without site-specific data harmonization. We validated our approach using de-identified EHR data from two US academic medical centers with 216,221 adult patients hospitalized for at least 24 h. In the sequential format we propose, this volume of EHR data unrolled into a total of 46,864,534,945 data points, including clinical notes. Deep learning models achieved high accuracy for tasks such as predicting: in-hospital mortality (area under the receiver operator curve [AUROC] across sites 0.93-0.94), 30-day unplanned readmission (AUROC 0.75-0.76), prolonged length of stay (AUROC 0.85-0.86), and all of a patient's final discharge diagnoses (frequency-weighted AUROC 0.90). These models outperformed traditional, clinically-used predictive models in all cases. We believe that this approach can be used to create accurate and scalable predictions for a variety of clinical scenarios. In a case study of a particular prediction, we demonstrate that neural networks can be used to identify relevant information from the patient's chart.

Analysis

Why This Paper Matters

This paper is a landmark in applying deep learning to electronic health records (EHRs) because it tackles two major barriers: the labor-intensive process of feature engineering and the difficulty of harmonizing data across different hospital systems. By using the Fast Healthcare Interoperability Resources (FHIR) format, the authors show that raw, sequential patient data can be fed directly into neural networks, preserving the richness of the entire record. This approach is scalable and generalizable, as validated across two independent academic medical centers without site-specific tuning.

The significance lies in its potential to democratize predictive modeling in healthcare. Traditional models require curated variables and often fail to transfer between institutions. This work suggests that deep learning can learn directly from the raw data, capturing subtle patterns that might be lost in manual feature extraction. The high accuracy for tasks like in-hospital mortality (AUROC 0.93-0.94) and discharge diagnoses (AUROC 0.90) demonstrates clinical utility, while outperforming existing models sets a new benchmark.

Technical Contributions

  • FHIR-based representation: Converts raw EHR data into a standardized, sequential format that includes all data types (e.g., lab results, medications, clinical notes) without manual curation.
  • Scalable deep learning architecture: Processes 46.8 billion data points from 216,221 patients, showing that neural networks can handle the volume and heterogeneity of real-world EHR data.
  • Multi-task prediction: Simultaneously predicts multiple outcomes (mortality, readmission, length of stay, diagnoses) from a single model, demonstrating efficiency and shared representation learning.
  • Cross-site validation: Achieves consistent performance across two different academic medical centers without site-specific harmonization, proving robustness.

Results

  • In-hospital mortality: AUROC 0.93-0.94 across sites.
  • 30-day unplanned readmission: AUROC 0.75-0.76.
  • Prolonged length of stay: AUROC 0.85-0.86.
  • Final discharge diagnoses: frequency-weighted AUROC 0.90.
  • Deep learning outperformed traditional clinically-used predictive models in all tasks.
  • The study used a large dataset: 216,221 patients, 46.8 billion data points.

Significance

This paper has had a major impact on the AI in healthcare field, with over 2,800 citations. It demonstrated that deep learning can work directly on raw EHR data, bypassing the need for manual feature engineering and site-specific harmonization. This has inspired subsequent work on foundation models for healthcare, such as BEHRT and Med-BERT, and has influenced the design of clinical decision support systems. The approach is now a standard baseline for EHR-based predictive modeling, and its success has accelerated the adoption of AI in hospital systems.