Device converts brain signals into speech, offering hope for patients

In a remarkable application of modern technology, scientists at the University of California have created a device that can decode signals from the brain’s speech centers to produce speech through a synthesizer. The device was featured in a paper entitled “Speech synthesis from neural decoding of spoken sentences”, which was published yesterday in the journal Nature.

The new device could decode brain signals and convert them into speechGorodenkoff | Shutterstock

For most people, speech is their main form of communication and a way of expressing how they feel. Losing the ability to speak through trauma or disease, such as stroke, Parkinson’s disease, throat cancer, motor neuron disease, can be devastating for both patients and their families.

Although devices have been developed to help people recreate speech by tracking eye or facial muscle movements, the process is laborious for users and the synthesized speech is extremely slow. Such devices typically produce up to ten words a minute compared to the 150 words a minute possible with natural speech.

Turning brain signals into speech

Normally, our thoughts are converted by the brain into movements of the lips, jaw, tongue, and larynx to enable us to produce the required words. Now, scientists have used these brain signals to create a computer-simulated vocal tract that can generate speech through a synthesizer.

The technology was tested in five volunteers with epilepsy who were able to speak normally. The volunteers were all due to have electrodes temporarily implanted in their brains to map the source of their seizures before undergoing corrective neurosurgery. This meant that the experimental speech synthesis device could be tested without the need for an additional invasive procedure.

Activity in the regions of the brain involved in language production was tracked as the volunteers read out hundreds of sentences aloud. The recorded signals were then used to produce a “virtual vocal tract” for each participant that simulated the movements in the mouth and throat needed to form different sounds. This was then controlled by the volunteer’s brain activity and instructed a synthesizer to generate speech.

The researchers were ‘impressed’

The resultant speech was mostly intelligible, with listeners being able to discern what was being said up to 70 percent of the time. The speech was slurred in parts and some sounds were not pronounced correctly, but the scientists are confident that they can improve on this by optimizing the algorithms they used.

The technology did not work as well when the researchers tried to decode the brain activity directly into speech, without using a virtual vocal tract.

Co-author of the research Josh Chartier commented: “Clearly, there is more work to get this to be more natural and intelligible but we were very impressed by how much can be decoded from brain activity.”

We hope that these findings give hope to people with conditions that prevent them from expressing themselves that one day we will be able to restore the ability to communicate, which is such a fundamental part of who we are as humans”.

Kate Bass

Written by

Kate Bass

Kate graduated from the University of Newcastle upon Tyne with a biochemistry B.Sc. degree. She also has a natural flair for writing and enthusiasm for scientific communication, which made medical writing an obvious career choice. In her spare time, Kate enjoys walking in the hills with friends and travelling to learn more about different cultures around the world.

Citations

Please use one of the following formats to cite this article in your essay, paper or report:

  • APA

    Bass, Kate. (2019, April 25). Device converts brain signals into speech, offering hope for patients. News-Medical. Retrieved on December 11, 2019 from https://www.news-medical.net/news/20190425/Device-converts-brain-signals-into-speech-offers-hope-for-patients.aspx.

  • MLA

    Bass, Kate. "Device converts brain signals into speech, offering hope for patients". News-Medical. 11 December 2019. <https://www.news-medical.net/news/20190425/Device-converts-brain-signals-into-speech-offers-hope-for-patients.aspx>.

  • Chicago

    Bass, Kate. "Device converts brain signals into speech, offering hope for patients". News-Medical. https://www.news-medical.net/news/20190425/Device-converts-brain-signals-into-speech-offers-hope-for-patients.aspx. (accessed December 11, 2019).

  • Harvard

    Bass, Kate. 2019. Device converts brain signals into speech, offering hope for patients. News-Medical, viewed 11 December 2019, https://www.news-medical.net/news/20190425/Device-converts-brain-signals-into-speech-offers-hope-for-patients.aspx.

Comments

The opinions expressed here are the views of the writer and do not necessarily reflect the views and opinions of News-Medical.Net.
Post a new comment
Post