Patient State Modeling in Critical Care: LLMs and Continuous State Estimation

Summary

Precise modeling of patient states in critical care–essential for timely intervention and outcome prediction–remains constrained by two fundamental challenges: 1) existing models struggle to integrate heterogeneous data streams (e.g. physiological signals, clinical notes, etc.), and 2) ground-truth labels for key states like sedation levels rely on sparse, subjective nurse assessments collected intermittently. To address multimodal integration, the team developed MedTsLLM, a framework that aligns numerical time-series with unstructured clinical text, by augmenting large language models (LLMs) to interpret a patient’s physiological signals within the context of their medical records. To address label sparsity, the sedation scoring work applies machine learning to continuous physiological signals such as heart rate variability, generating high-fidelity proxies that replace intermittent manual assessments with continuous, objective baselines. By improving both how models synthesize multimodal data and the temporal resolution of patient state labels, these efforts advance the capacity to track and predict patient trajectories with greater precision in critical care settings.

Related Publications

  1. Chan N, Parker F, Zhang C, Bennett W, Jia MY, Fackler J, Ghobadi K. MedTsLLM: Medical Time Series Analysis Using Multimodal LLMs. IEEE Journal of Biomedical and Health Informatics. 2025 Oct 16.
    https://ieeexplore.ieee.org/abstract/document/11205278/
  2. Chan N, Parker F, Bennett W, Wu T, Jia MY, Fackler J, Ghobadi K. Leveraging LLMs for multimodal medical time series analysis. Machine Learning for Healthcare Conference. PMLR 2024 Nov 25.
    https://proceedings.mlr.press/v252/chan24a.html

External Researchers

Jim Fackler, MD (JHU School of Medicine)

Collaborating Agencies