AI model enhances detection of immune-related adverse events in cancer patients

While immune checkpoint inhibitors (ICIs) can provide lifesaving treatment for patients with cancer, they have also been found to cause immune-related adverse events (irAEs) -; side effects that can impact almost every organ in the body to varying degrees. The frequency and severity of irAEs in real-world datasets are not well understood, making it difficult to combine cases effectively across institutions and gain insights into the optimal management of these patients. Since current approaches to investigate irAEs are done manually and are inefficient, researchers from Mass General Brigham have incorporated the use of a prebuilt large language model (LLM) to identify information relating to instances of irAEs in hospital settings.

The LLM identified the most common hospitalizing irAEs, including ICI-induced colitis, hepatitis, pneumonitis, and ICI-induced myocarditis, which can be fatal. The LLM was compared to the performance of International Classification of Disease (ICD) codes, which retrospectively identify irAEs, and demonstrated higher accuracy. Results are published in The Journal of Clinical Oncology.

Not only did the LLM demonstrate higher accuracy in detecting irAEs compared to ICD codes, it identified additional cases of irAEs not picked up via manual adjudication, with an excellent specificity/sensitivity and at only 9.53 seconds per chart. As a free and open-source model, the LLM pipeline opens up this field, enabling other institutions to quickly recreate similar databases and has the potential to ignite collaboration in unprecedented ways."

Kerry Reynolds, MD, corresponding author, Director of the Severe Immunotherapy Complications Program at Mass General Cancer Center

This study analyzed 10 years of data in a gold standard, manually curated dataset from patients who were hospitalized after receiving ICI therapy.

"The results demonstrated that the model consistently achieved sensitivities and specificities above 90% across the four irAEs which is excellent," said Reynolds. "Historically, collaboration in the field of irAEs has been concentrated among large academic centers, leaving smaller community hospitals with less opportunity to contribute. This study has the potential to change that. The LLM presented in this study requires minimal computational resources and can be run on a local machine, we are eager to share it with the broader community."

Source:
Journal reference:

Sun, V. H., et al. (2024) GABAergic neuronal lineage development determines clinically actionable targets in diffuse hemispheric glioma, H3G34-mutan Enhancing Precision in Detecting Severe Immune-Related Adverse Events: Comparative Analysis of Large Language Models and International Classification of Disease Codes in Patient Records. Journal of Clinical Oncology. doi.org/10.1200/JCO.24.00326.

Comments

The opinions expressed here are the views of the writer and do not necessarily reflect the views and opinions of News Medical.
Post a new comment
Post

While we only use edited and approved content for Azthena answers, it may on occasions provide incorrect responses. Please confirm any data provided with the related suppliers or authors. We do not provide medical advice, if you search for medical information you must always consult a medical professional before acting on any information provided.

Your questions, but not your email details will be shared with OpenAI and retained for 30 days in accordance with their privacy principles.

Please do not ask questions that use sensitive or confidential information.

Read the full Terms & Conditions.

You might also like...
Common breast cancer therapies may speed up aging, study shows