Clinical AI Radar

2026-10-05

Machine learning evaluated on patients, from new PubMed records — not preprints.

99papers read
→
8shortlisted
→
4must-read

7 s · 99,441 input tokens · ≈ $0.0042 · jev-1.13.0 via typesafe

Must-read ≥ 95%

97%new methodpubmed

Mapping Clinical Intent in Internet Hospitals: Identifying and Profiling Patient Demand via Natural Language Processing.

Xu R, Liu J, Ye H et al. · Comput Struct Biotechnol J

External validation 97%
Abstract

Patient-generated text in internet hospitals represents a massive but unstructured source of clinical demand. Misalignment between rigid administrative menus and actual patient intent leads to triage inefficiency and resource mismatches. We developed a hybrid artificial intelligence framework to decode patient needs and optimize service allocation using real-world data from a tertiary internet hospital, with external validation on an independent multihospital dataset (N = 497). In this study, we analyzed 28,851 inquiries from a tertiary internet hospital using a 2-stage approach: (a) unsupervised K-Means clustering to discover intrinsic intent taxonomies, and (b) supervised classification using a fine-tuned MacBERT model. We benchmarked this specialized small model against traditional baselines and state-of-the-art large language models (LLMs; Qwen2.5 and HuatuoGPT-II) on a gold-standard dataset of 4,814 annotated records. Unsupervised analysis identified 8 distinct patient intents, revealing substantial semantic overlap between rehabilitation and follow-up requests. The fine-tuned MacBERT model achieved a weighted F1-score of 0.680, outperforming both the medical-specific LLM (F1 = 0.595) and the general LLM (F1 = 0.585). External validation on an independent nationwide platform dataset (N = 497) confirmed cross-platform transferability, with the hybrid learning framework achieving a weighted F1 of 0.578 versus 0.389 (Qwen2.5-7B) and 0.190 (HuatuoGPT-II). Departmental analysis exposed distinct "demand fingerprints": 39% of Neurology inquiries focused on prescription renewals, whereas 68% of Dermatology inquiries involved initial symptom consultations. These findings indicate that, within the studied Chinese hospital setting, fine-tuned task-specific models may offer superior utility over general LLMs for clinical triage, with the performance gap widening under domain shift-though multicenter prospective validation is required to establish generalizability. Mapping intent fingerprints across specialties provides a quantifiable basis for restructuring digital hospital operations.

pubmed:42828413Useful?👍👎
97%new methodpubmed

Construction and multi-center validation of a model based on blending ensemble learning for predicting stroke-associated pneumonia following acute ischemic stroke.

Liu X, Fu Q, Yang S et al. · Front Neurol

External validation 97%Prospective 91%
Abstract

Background: Stroke-associated pneumonia (SAP) is a common and serious infectious complication following acute ischemic stroke (AIS), leading to worsened clinical outcomes. We aimed to develop and validate a novel predictive model based on Blending Ensemble Learning, to enable early, precise screening and individualized risk stratification for SAP. Methods: In this multi-center study, a derivation cohort was initially established using 1,123 patients admitted between 2022 and 2024. Subsequently, 199 patients were prospectively enrolled in early 2025 as a temporal validation set, and 287 patients were extracted from a regional health big data platform (covering 12 hospitals) to serve as an external validation set. High-value clinical and biomarker features were identified via least absolute shrinkage and selection operator (LASSO) regression. To overcome the limitations of single classifiers, a Blending Ensemble Learning strategy was adopted to construct the final predictive model. The model underwent comprehensive evaluation for discrimination, calibration, and clinical utility, and was benchmarked against single random forest (RF) and extreme gradient boosting (XGBoost) models. Results: Seventeen predictors were identified, including systemic immune-inflammation index (SII), neutrophil-to-lymphocyte ratio (NLR), the National Institutes of Health Stroke Scale (NIHSS), and D-dimer. The Blending ensemble model demonstrated superior discrimination in the validation cohort, achieving an Area Under the Receiver Operating Characteristic Curve (AUC) of 0.898 (95% CI: 0.845-0.951), which significantly outperformed the optimal single model. Furthermore, SHapley Additive exPlanations (SHAP) analysis highlighted hyperinflammation, immunothrombosis, and nutritional depletion as pivotal mechanisms driving SAP pathogenesis. Conclusion: The proposed Blending ensemble model exhibits excellent generalizability and high sensitivity. The accompanying web-based tool provides robust decision support for identifying high-risk patients and implementing early precision interventions.

pubmed:42827455Useful?👍👎
96%applicationpubmed

Machine learning-based prediction of postoperative venous thromboembolism in orthopedic surgery using the MIMIC-IV database and external validation.

Wu G, Cai G, Wu G et al. · Front Surg

External validation 96%
Abstract

Objective: A risk prediction model for venous thromboembolism (VTE) after orthopedic surgery was constructed and validated using machine learning algorithms, providing a reference for the early identification of high-risk individuals in clinical settings. Method: Patients who underwent orthopedic surgery were retrospectively collected from the Medical Information Mart for Intensive Care (MIMIC-IV) database as the modeling group. The patients were randomly divided into training and internal test sets in a 7:3 ratio. A total of 156 patients who underwent orthopedic surgery in our hospital from January 2022 to July 2025 were selected for the external validation set. Predictive variables were selected using the least absolute shrinkage and selection operator (LASSO) regression. Six machine learning models were constructed: logistic regression (LR), decision tree (DT), random forest (RF), extreme gradient boosting (XGB), light gradient boosting machine (LGBM), and naive Bayes (NBM). The model performance was evaluated by using the area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, specificity, F1 score, and G-mean. The interpretability of the optimal model was analyzed using the calibration curves, decision curve analysis (DCA), and SHAP methods. Results: The MIMIC-IV database included 461 patients (VTE incidence rate, 15.8%). LASSO regression identified two predictive variables: fibrinogen and D-dimer levels. The AUC of the LGBM model in the internal test set was 0.893 (95% CI: 0.820-0.966), and in the external validation, the AUC of the LGBM model was 0.788. The predictive performance of this model was superior to that of the other five models tested. The calibration curve indicated that the model was well calibrated, and the decision curve suggested a clinical net benefit within the 0.1-0.6 threshold range. SHAP analysis showed that elevated fibrinogen and D-dimer levels were positively correlated with the risk of VTE. Conclusion: The LGBM model constructed based on the MIMIC-IV database has excellent predictive efficacy for VTE after orthopedic surgery and certain external generalization abilities. Fibrinogen and D-dimer levels are key predictive factors. This model can serve as a preliminary reference tool for risk stratification of VTE after orthopedic surgery.

pubmed:42827598Useful?👍👎
95%applicationpubmed

Machine learning-based early prediction of severe pneumonia risk in hospitalized leukemia patients: a dual-center retrospective cohort study.

Huang J, Wu Q, Zhang Y et al. · Front Cell Dev Biol

External validation 95%
Abstract

Background: Severe pneumonia is a major infectious complication in patients with leukemia and may rapidly progress to respiratory failure or septic shock. Disease- and treatment-related immunosuppression increases susceptibility, yet population-specific early risk-stratification tools are limited. Objectives: To develop and externally validate a machine learning model for predicting severe pneumonia in hospitalized patients with leukemia. Methods: Data from 2,978 leukemia patients at two Chinese hospitals were retrospectively analyzed. The derivation cohort was divided into training and internal test sets; SMOTE was applied only to the training set. LASSO and SVM-RFE were used for predictive feature selection, eight machine learning algorithms were compared, and RCS was used for exploratory association analysis. The final model was presented as a nomogram. Results: Seven predictors were retained: age, history of myelosuppression, acute lymphoblastic leukemia (ALL) subtype, cardiac insufficiency, atrial fibrillation, red blood cell distribution width-standard deviation (RDW-SD), and prothrombin time activity. Logistic regression showed the best generalizability, with an area under the curve (AUC) of 0.801 in external validation. Sensitivity analyses showed similar discrimination with multiple imputation and complete-case analysis. Conclusion: We developed and externally validated an interpretable model for severe pneumonia in hospitalized patients with leukemia. Because direct programmed-cell-death biomarkers were not measured and SMOTE substantially altered training prevalence, mechanistic interpretation and absolute-risk calibration require caution. Prospective recalibration and clinical-impact evaluation are needed before routine use.

pubmed:42827898Useful?👍👎

Maybe 90% to 95%

94%applicationpubmed

Early prediction of in-hospital acute brain injury following cardiac arrest using machine learning: development and external validation.

Niu Y, Xu T, Fan J et al. · Front Neurol

External validation 94%
Abstract

Background: Neurological injury is common after cardiac arrest (CA), but early and accurate assessment remains challenging. Existing evaluation methods often lack sensitivity and specificity. This study aims to develop and validate an interpretable machine learning model for early and reliable assessment of brain injury and its prognostic relevance in ICU patients. Methods: In this study, we analyzed 1,419 CA patients from the MIMIC-IV database, randomly split into training and validation cohorts. Six machine learning (ML) algorithms-logistic regression (LR), XGBoost, artificial neural network (ANN), random forest (RF), support vector machine (SVM), and k-nearest neighbors (KNN) were developed and evaluated. The top-performing model was interpreted using SHapley Additive exPlanations (SHAP), identifying eight key predictors of brain injury. Finally, clinical data from cardiac arrest patients at our hospital were collected for external validation to assess the model's generalizability and practical utility in an ICU setting. Results: Among the six machine learning models, the Random Forest model achieved the highest numerical performance in both the internal test and external validation cohorts. In the internal test cohort, Random Forest achieved an ACC of 88.7%, sensitivity of 80.0%, specificity of 90.6%, F1 score of 0.714, NPV of 95.5%, PPV of 64.5%, and AUC of 0.901. In the external validation cohort, Random Forest achieved an ACC of 88.8%, sensitivity of 77.8%, specificity of 90.8%, F1 score of 0.677, NPV of 95.8%, PPV of 60.0%, and AUC of 0.889. SHAP analysis identified eight influential predictors: age, hemoglobin, OASIS, temperature, blood urea nitrogen, white blood cell count, non-invasive diastolic pressure, and non-invasive systolic pressure. Conclusion: Machine learning offers strong potential for early prediction of acute brain injury in in-hospital cardiac arrest patients. Our interpretable model addresses the "black box" concern by providing transparent insights into key predictive features.

pubmed:42827460Useful?👍👎
92%applicationpubmed

Development and external validation of a machine learning model for three-tier disability risk stratification in older adults.

Mao Y, Guo Z, Wang J et al. · Front Public Health

External validation 92%
Abstract

Background: Global aging has made disability among older adults a major public health challenge. Existing prediction models often lack external validation and actionable risk stratification. This study aims to develop and externally validate an explainable, three-tier machine learning framework for disability risk prediction and stratification among older adults. Methods: The training set and internal validation set were derived from the longitudinal development cohort of the China Health and Retirement Longitudinal Study (CHARLS, n = 3,599). An independent cross-sectional survey (n = 2,066) was used for external validation of the model. Individuals 65 years of age and older were included. Disability was defined by basic activities of daily living (BADL). After feature selection, five candidate machine learning techniques were evaluated to identify the optimal model. The SHapley Additive exPlanations (SHAP) was used to interpret the optimal model. Ultimately, a three-tier risk stratification method was developed and verified using Decision Curve Analysis (DCA) and the Cochran-Armitage trend test. Results: LASSO regression identified seven critical predictors. The Extreme Gradient Boosting (XGBoost) achieved the optimal balance, achieving the optimal balance of predictive performance in the internal testing set (AUC = 0.737) and external validation cohort (AUC = 0.782). SHAP analysis revealed age, age-adjusted Charlson Comorbidity Index (ACCI), and lower limb mobility as the paramount global predictors. The established risk stratification thresholds (33.17 and 65.23%) successfully categorized older adults into three levels. This three-tier system exhibited a significant gradient increase in actual disability incidence within the external set (P trend < 0.001) and a broad positive net clinical benefit in DCA. Discussion: The XGBoost model showed satisfactory and consistent performance in external validation. SHAP provided clinically meaningful insights, emphasizing age, lower-limb mobility, psychological status, and comorbidity burden. The validated three-tier system bridges the translational gap between complex predicted probabilities and practical clinical decisions.

pubmed:42827749Useful?👍👎
91%empirical studypubmed

Toward Responsible and Privacy-Preserving Generation of Inpatient Clinical Discharge Notes Using Large Language Models.

Burn F, Zwick C, Weibel J et al. · Comput Struct Biotechnol J

Language models 91%
Abstract

Writing discharge notes (DNs) is a time-intensive task in inpatient care that contributes substantially to physician workload and burnout. Large language models (LLMs) offer potential opportunities to automate clinical documentation. However, concerns regarding accuracy, reliability, data privacy protection laws and data governance, and compliance with healthcare privacy remain. This study evaluated the performance of locally deployed, domain-adapted LLMs for generating German-language DN in internal medicine. In this retrospective study, electronic health record data from a Swiss tertiary care hospital were used. Clinical information from 3 inpatient scenarios served as input for the 3 open source LLMs (Mixtral 8×7B, Mixtral 8×22B, and LLaMA 3.1 70B). Zero-shot prompting, 4-shot in-context learning, and supervised fine-tuning using QLoRA were compared. Generated DNs were evaluated using automated metrics, blinded physician assessment with direct comparison of all relevant clinical information using the modified Physician Documentation Quality Instrument, and additionally an LLM-as-a-judge framework and a Turing Test. Across all evaluation methods, the fine-tuned Mixtral 8×7B model achieved the best overall performance compared with prompting-based approaches and larger nonspecialized models. Simpler cases consistently received higher-quality ratings. Physician inter-rater agreement was low, highlighting the challenges of objective quality assessment for clinical documentation. In a Turing Test, physicians were unable to reliably distinguish artificial intelligence-generated from clinician-authored DNs, performing at chance level, demonstrating that high-quality DN generation is feasible using locally deployed LLMs within secure hospital infrastructures. Domain-specific fine-tuning substantially improves performance and may enable practical deployment. Future work should address further hallucination mitigation, robustness across medical specialties, and real-world integration.

pubmed:42828363Useful?👍👎
90%applicationpubmed

First-in-human evaluation of real-time pixel-level AI-assisted anatomical segmentation in neurosurgery: pituitary surgery as an exemplar.

Khan DZ, Mao Z, Wijekoon A et al. · Pituitary

Prospective 90%
Abstract

Introduction: Precise anatomical navigation is fundamental to safe endoscopic pituitary surgery, a high-stakes procedure characterised by a challenging learning curve. While traditional navigation systems often rely on workflow-disrupting probes or static preoperative imaging, advancements in computer vision AI (CVAI) now enable dynamic, real-time pixel-level anatomical segmentation directly from live surgical video. Our group has previously conducted a series of preclinical human-computer interaction studies to refine the system's design, alongside digital and high-fidelity physical simulations demonstrating the potential benefit of AI assistance in improving surgical performance, training, and safety. Building on this foundation, the current study represents a first-in-human evaluation of real-time pixel-level CVAI anatomical segmentation in the neurosurgical operating room - assessing feasibility, human factors and clinical outcomes, while iteratively improving the system. Method: Guided by the DECIDE-AI and IDEAL frameworks, this single-centre evaluation comprises an initial proof-of-concept of CVAI anatomical segmentation in endoscopic transsphenoidal pituitary surgery. The AI model utilised a DINOv3-derived vision transformer architecture, deployed via a high-performance edge computing unit to achieve low-latency real-time inference without reliance on cloud infrastructure. Feasibility and functionality were assessed via structured questionnaire, prospective observation, and blinded retrospective review of the recordings of the endoscopic surgical video feed and wider operating room environment. Continuous multi-stakeholder feedback through validated human factors surveys drove iterative technical refinements between cases. Routine clinical outcomes, aligning with the standard pituitary surgery core outcome set, were collected. Results: Eight patients with pituitary adenomas were enrolled. The CVAI system was successfully deployed in six cases, demonstrating acceptable real-time pixel-level sella segmentation accuracy. Deployment failed pre-operatively in two cases owing to a single platform-level boot-configuration issue. Iterative refinement between cases was driven by our experience and surgical team feedback. This resulted in the integration of additional anatomical structure segmentations (e.g., carotid arteries), enhanced model accuracy via training dataset expansion, and hardware firmware upgrades. Multi-stakeholder surveys demonstrated satisfactory system feasibility, usability, and acceptability among the surgical team. Both prospective observation and retrospective video review confirmed the absence of adverse events, including no significant distraction to the primary surgeon, and there were no AI-related clinical complications. Conclusion: This first-in-human early clinical evaluation (IDEAL Stage 1) of real-time pixel-level AI anatomical segmentation in live neurosurgery demonstrates feasibility, showcases iterative system evolution, and reports clinical and human factors outcomes. Future work will include a larger single-centre case series (IDEAL Stage 2a) with more surgical teams to further iterate the system and explore its impact on safety, training and workflow. As the underpinning AI models improve and integrate with other intra-operative navigational technologies, such tools will likely be the cornerstone of intra-operative surgical decision support systems.

pubmed:42829367Useful?👍👎