RapiD_AI as a novel disease and pandemic preparedness tool

In a recent study posted to the medRxiv* preprint server, researchers assessed the RapiD_AI framework for deployable artificial intelligence (AI) for improved pandemic preparedness.

Study: RapiD_AI: A framework for Rapidly Deployable AI for novel disease & pandemic preparedness. Image Credit: cono0430/Shutterstock
Study: RapiD_AI: A framework for Rapidly Deployable AI for novel disease & pandemic preparedness. Image Credit: cono0430/Shutterstock

Background

The coronavirus disease 2019 (COVID-19) pandemic will probably not be the last pandemic the human race will face. Research studying historical pandemics recorded from the 1600s to the present has revealed that the risk of the incidence of a COVID-19-like pandemic has a probability of 2.63% annually and 38% in a lifetime. While it is difficult to prevent such pandemics in the future, it is under our control to be prepared for their adverse impacts with appropriate preparedness. 

About the study

In the present study, researchers developed a framework called RapiD_AI that could guide the usage of pre-trained neural network models as a tool for improving pandemic preparedness.

The study involved three datasets obtained from the same population: (1) DH - general inpatient cohort from a pre-pandemic dataset collected between January 2016 and December 2019, (2) DW1- COVID-19 patients from the first wave of the pandemic enrolled between March and July 2020, and (3) DW2- COVID-19 patients from the second wave of the pandemic enrolled between August 2020 and June 2021.

The observations corresponding to each patient were characterized as per a 77-dimensional feature vector along with a label displaying a respiratory deterioration event within 24 hours. The features comprised commonly assessed laboratory parameters, vital signs, and variance over time.

The experimental process utilized two task definitions that included patient deterioration prediction tasks. The first task was a respiratory deterioration prediction task TRD which was based on the increase in the level of oxygen support required from level zero or one to level two or three or unplanned intensive care unit (ICU) admission. The second task was a general deterioration prediction task TGD defined as either the composite mortality outcome or ICU admission.

The experimental setup was based on three scenarios: A, B, and C. In scenario A, the team demonstrated the value of employing historical data while pretraining RapiD_AI models with the background of a pandemic caused by a novel disease. DH was used to pre-train deep learning models, DW1 was used to either train the benchmark neural networks or XGBoost models or fine-tune pre-trained networks, and DW2 was used as a held-out test dataset to assess model performance.  

Scenario B hypothesized that selecting the most relevant pretraining models could facilitate the achievement of superior performance compared to retraining all historical data. This would also reduce the computational requirement of the pretraining process. The team considered historical examples that had major similarities to COVID-19 data.

Pretraining samples were selected by using human experience in identifying five different disease clusters having varying degrees of similarity to the clinical pattern observed for COVID-19 and using a computational approach that utilized tSNE to cluster all historical data with COVID-19 samples obtained in the initial three weeks of the pandemic. Additionally, scenario C replicated the scenario of a healthcare system that was facing a pandemic and had access to deploy machine learning models.     

Results

The study results showed that the pretraining deep neural network (DNN) models from scenario A improved their performance during the initial 20 weeks of the COVID-19 pandemic. Pretraining these DNN models improved performance by 110.87% relative and 41.71% absolute AUC in the first week and a 3.86% of absolute average AUC in the following 19 weeks of the pandemic.

Furthermore, the RapiD_AI outperformed the baseline XGBoost model in the initial four weeks of the pandemic by 4.37% relative and 3.58% absolute AUC and the overall average by 4.92% relative and 4.21% absolute AUC. These performance improvements can translate into remarkable operational and clinical benefits in the context of a global pandemic. The average gain of 4.21% in the algorithm AUC implied an increase of up to 1399 additional accurate classifications weekly in the UK, which could further lead to improved patient medical interventions.

Scenario B identified that the most frequently noted International Classification of Diseases-10 (ICD10) codes from the 10% of the most similar clusters were I10, Z922, Z864, Z501, I489, N179, Z867, Z921, E119, N390. However, the team highlighted that the code frequency in the general population could impact the composition of the frequently occurring ICD10 codes from selected training clusters and that multiple ICD10 codes observed for every patient made it difficult to ascertain the primary diagnosis.

Scenario C resulted in an 11.93% relative and a 9.32% absolute AUC improvement in performance over the initial two weeks of the pandemic compared to the XGBoost dataset training on only weekly information. The performance gain was consistent over the initial 20 weeks, with an average relative and absolute AUC increase of 7.57% and 6.42%, respectively.

Conclusion

Overall, the study highlighted the working of the RapiD_AI framework as a tool for pandemic preparedness along with the usefulness of machine learning during a pandemic.    

*Important notice

medRxiv publishes preliminary scientific reports that are not peer-reviewed and, therefore, should not be regarded as conclusive, guide clinical practice/health-related behavior, or treated as established information.

Journal reference:
Bhavana Kunkalikar

Written by

Bhavana Kunkalikar

Bhavana Kunkalikar is a medical writer based in Goa, India. Her academic background is in Pharmaceutical sciences and she holds a Bachelor's degree in Pharmacy. Her educational background allowed her to foster an interest in anatomical and physiological sciences. Her college project work based on ‘The manifestations and causes of sickle cell anemia’ formed the stepping stone to a life-long fascination with human pathophysiology.

Citations

Please use one of the following formats to cite this article in your essay, paper or report:

  • APA

    Kunkalikar, Bhavana. (2022, August 16). RapiD_AI as a novel disease and pandemic preparedness tool. News-Medical. Retrieved on September 27, 2022 from https://www.news-medical.net/news/20220816/RapiD_AI-as-a-novel-disease-and-pandemic-preparedness-tool.aspx.

  • MLA

    Kunkalikar, Bhavana. "RapiD_AI as a novel disease and pandemic preparedness tool". News-Medical. 27 September 2022. <https://www.news-medical.net/news/20220816/RapiD_AI-as-a-novel-disease-and-pandemic-preparedness-tool.aspx>.

  • Chicago

    Kunkalikar, Bhavana. "RapiD_AI as a novel disease and pandemic preparedness tool". News-Medical. https://www.news-medical.net/news/20220816/RapiD_AI-as-a-novel-disease-and-pandemic-preparedness-tool.aspx. (accessed September 27, 2022).

  • Harvard

    Kunkalikar, Bhavana. 2022. RapiD_AI as a novel disease and pandemic preparedness tool. News-Medical, viewed 27 September 2022, https://www.news-medical.net/news/20220816/RapiD_AI-as-a-novel-disease-and-pandemic-preparedness-tool.aspx.

Comments

The opinions expressed here are the views of the writer and do not necessarily reflect the views and opinions of News Medical.
Post a new comment
Post
You might also like...
Study underscores the economic, mental health impacts of COVID-19 on people hit by climate disasters