AI-collected data could compromise the understanding of early sleep patterns

A dearth of pediatric data collected using artificial intelligence (AI) tools could compromise the understanding of early sleep patterns.

Sleep stages are primarily determined by analyzing the brain waves during sleep, which traditionally is done manually (or semi-automated)."

Mathias Baumert, Associate Professor, School of Electrical and Mechanical Engineering, University of Adelaide

"There has been a big push to automate this labor-intensive and expensive process using deep learning – an AI method that teaches computers to process data in a way that is inspired by the human brain.

"We have found evidence that errors in sleep classification generated using AI could lead to misdiagnosis of sleep disorders, particularly in children."

Nerve impulses in the brain cause electrical activity. An electroencephalogram (EEG) records the brain's electrical activity on a person's scalp. Collected overnight, it provides the input data to deep learning systems.

"Deep learning systems need big EEG databases to learn the brain wave patterns associated with various sleep stages to give reliable results," said Associate Professor Baumert.

"However, most available sleep EEG databases contain adult data only and therefore, the systems developed on those databases seem to have issues when dealing with kids' sleep because they have never "seen" and "learnt" it.

"This means sleep disorders in children could be misdiagnosed due to using adult-biased data sets."

The association between sleep problems, cognitive development and mental health has long been studied and recognized. Early identification of sleep problems, especially in young people, is vital to maximizing the effectiveness of appropriate treatment.

Generally, sleep comprises rapid eye movement (REM) sleep and non-rapid eye movement (NREM) sleep. NREM is categorized into three stages (N1, N2, N3). Prior to the introduction of AI methods for classifying sleep patterns, a technician would examine overnight EEG, 30 seconds at a time, and assign one of the sleep stages to it.

"Sleep follows a typical cyclical pattern of sleep stages that make up the 'sleep architecture' and can be seen in a hypnogram - a graph that represents the stages of sleep over time," said Associate Professor Baumert.

"Clinicians consider several metrics from hypnograms, such as sleep onset latency, sleep efficiency, time spent in each of the sleep stages, and time spent awake after sleep onset, to help them diagnose sleep disorders."

On adult EEG, AI systems assign sleep stages correctly about nine out of ten times – on par with human experts. A similar performance can be achieved for children if pediatric data are included in the deep learning process.

Dr Huy Phan, Alan Turing Institute, UK, who was co-author of the study said improvements are needed in AI systems to avoid bias towards population groups and ensure accurate diagnoses for all patients.

"Even if trained with pediatric data, current AI systems don't work equally well in all patients. While sleep stage classification accuracy appears sufficient when looking at EEG databases as a whole, errors in the sleep metrics of individual patients can be substantial, which is unacceptable for any diagnostic purpose."

"Effective strategies are needed to avoid bias in the learning process and also to identify unusual behavior of AI systems and mitigate the risk of misdiagnoses."

The study was published in the journal Sleep Medicine.

Source:
Journal reference:

Baumert, M., et al. (2023) Automatic sleep staging for the young and the old – Evaluating age bias in deep learning. Sleep Medicine. doi.org/10.1016/j.sleep.2023.04.002.

Comments

The opinions expressed here are the views of the writer and do not necessarily reflect the views and opinions of News Medical.
Post a new comment
Post

While we only use edited and approved content for Azthena answers, it may on occasions provide incorrect responses. Please confirm any data provided with the related suppliers or authors. We do not provide medical advice, if you search for medical information you must always consult a medical professional before acting on any information provided.

Your questions, but not your email details will be shared with OpenAI and retained for 30 days in accordance with their privacy principles.

Please do not ask questions that use sensitive or confidential information.

Read the full Terms & Conditions.

You might also like...
Machine learning reveals sleep quality and anxiety as major predictors of depression