Preprint
Large Language Models

Recent Advances in Large Language Models for Healthcare

Khalid Nassiri(Université de Moncton), Moulay A. Akhloufi(Université de Moncton)
April 16, 2024BioMedInformatics97 citations

97

Citations

2

Influential Citations

BioMedInformatics

Venue

2024

Year

Abstract

Recent advances in the field of large language models (LLMs) underline their high potential for applications in a variety of sectors. Their use in healthcare, in particular, holds out promising prospects for improving medical practices. As we highlight in this paper, LLMs have demonstrated remarkable capabilities in language understanding and generation that could indeed be put to good use in the medical field. We also present the main architectures of these models, such as GPT, Bloom, or LLaMA, composed of billions of parameters. We then examine recent trends in the medical datasets used to train these models. We classify them according to different criteria, such as size, source, or subject (patient records, scientific articles, etc.). We mention that LLMs could help improve patient care, accelerate medical research, and optimize the efficiency of healthcare systems such as assisted diagnosis. We also highlight several technical and ethical issues that need to be resolved before LLMs can be used extensively in the medical field. Consequently, we propose a discussion of the capabilities offered by new generations of linguistic models and their limitations when deployed in a domain such as healthcare.

Analysis

Why This Paper Matters

This survey arrives at a critical juncture where large language models are rapidly being explored for clinical applications. The paper systematically organizes the fragmented literature on LLMs in healthcare, making it accessible to both AI researchers and medical professionals. By categorizing architectures like GPT, BLOOM, and LLaMA alongside medical datasets, it provides a structured overview that helps practitioners understand the current state of the art.

The emphasis on ethical and technical challenges is particularly timely. As LLMs begin to influence clinical decision-making, issues such as data privacy, bias, and model interpretability become paramount. The paper's balanced discussion of capabilities versus limitations offers a sobering counterpoint to overly optimistic narratives, which is essential for responsible deployment.

Technical Contributions

  • Architecture taxonomy: Clearly delineates the main LLM families (GPT, BLOOM, LLaMA) and their parameter scales, helping readers compare model sizes and design choices.
  • Dataset classification: Proposes a multi-criteria classification of medical datasets by size, source (e.g., electronic health records, scientific literature), and subject, which aids in understanding data diversity and potential biases.
  • Application mapping: Identifies key use cases such as assisted diagnosis, patient communication, and research acceleration, providing a roadmap for future work.
  • Challenge enumeration: Lists specific technical hurdles (e.g., hallucination, domain adaptation) and ethical concerns (e.g., fairness, accountability) that need addressing.

Results

The paper does not present new experimental results. Instead, it synthesizes findings from prior work, noting that LLMs have demonstrated remarkable language understanding and generation capabilities in medical contexts. No concrete metrics (e.g., accuracy, F1 scores) are reported, as the focus is on qualitative trends and open problems.

Significance

This survey contributes a foundational reference for the growing intersection of LLMs and healthcare. By clearly outlining the landscape, it enables researchers to identify gaps and prioritize efforts. Its discussion of ethical and technical barriers is crucial for guiding safe and effective integration of LLMs into clinical workflows, potentially influencing regulatory frameworks and best practices in the field.