Evaluating a machine learning tool for predicting hospital-acquired acute kidney injury

NewsGuard 100/100 Score

Hospital-acquired acute kidney injury (HA-AKI) is a common complication in hospitalized patients that can lead to chronic kidney disease and is associated with longer hospital stays, higher health care costs and increased mortality. Given these negative consequences, preventing HA-AKI can improve hospitalized patient outcomes. However, anticipating HA-AKI onset is difficult due to a large number of contributing factors involved.

Researchers from Mass General Brigham Digital tested a commercial machine learning tool, the Epic Risk of HA-AKI predictive model, and found it was moderately successful at predicting risk of HA-AKI in recorded patient data. The study found a lower performance than those recorded by Epic Systems Corporation's internal validation, highlighting the importance of validating AI models before clinical implementation.

The Epic model works by assessing adult inpatient encounters for the risk of HA-AKI, marked by predefined increases in serum creatinine levels. After training the model using data from MGB hospitals, the researchers tested it on data from nearly 40,000 inpatient hospital stays for a five-month period between August 2022 and January 2023. The dataset was extensive with many points collected on patient encounters, including information such as patient demographics, comorbidities, principal diagnoses, serum creatinine levels and length of hospital stay. Two analyses were completed looking at encounter-level and prediction-level model performance.

The investigators observed that the tool was more reliable when assessing patients with lower risk of HA-AKI. Although the model could confidently identify which low-risk patients would not develop HA-AKI, it struggled to predict when higher-risk patients might develop HA-AKI. Results also varied depending on the stage of HA-AKI being evaluated -;predictions were more successful for Stage 1 HA-AKI compared to more severe cases.

The authors concluded overall that implementation may result in high false-positive rates and called for further study of the tool's clinical impact.

We found that the Epic predictive model was better at ruling out low-risk patients than identifying high-risk patients. Identifying HA-AKI risk with predictive models could help support clinical decisions such as by warning providers against ordering nephrotoxic medications, but further study is needed before clinical implementation."

Sayon Dutta, MD, MPH, lead study author of Mass General Brigham Digital's Clinical Informatics team, and emergency medicine physician at Massachusetts General Hospital

Journal reference:

Dutta, S., et al. (2024). External Validation of a Commercial Acute Kidney Injury Predictive Model. NEJM AI. doi.org/10.1056/aioa2300099.


The opinions expressed here are the views of the writer and do not necessarily reflect the views and opinions of News Medical.
Post a new comment

While we only use edited and approved content for Azthena answers, it may on occasions provide incorrect responses. Please confirm any data provided with the related suppliers or authors. We do not provide medical advice, if you search for medical information you must always consult a medical professional before acting on any information provided.

Your questions, but not your email details will be shared with OpenAI and retained for 30 days in accordance with their privacy principles.

Please do not ask questions that use sensitive or confidential information.

Read the full Terms & Conditions.

You might also like...
Combining blood pressure drug with dietary-resistant starch may help stave off diabetic kidney disease