AI Decodes Speech and Hearing Based on Brain Activity

The proof-of-concept study could be a step toward better assisted communication devices for paralyzed people.

| 2 min read
an illustration of a person's head rendered in 1s and 0s

Register for free to listen to this article
Listen with Speechify
0:00
2:00
Share

ABOVE: © ISTOCK.COM, SAMARETS1984

When people listened to questions from a predetermined set and spoke a response from a group of answer options, a computer program could correctly predict the question based on their brain activity most of the time, researchers report today (July 30) in Nature Communications.

The study, conducted on three people who had arrays of electrodes temporarily implanted in their brains to monitor their brain activity in preparation for surgery for epilepsy, was funded by Facebook and carried out at the University of California, San Francisco (UCSF).

“This is the first time this approach has been used to identify spoken words and phrases,” coauthor David Moses tells The Guardian. “It’s important to keep in mind that we achieved this using a very limited vocabulary, but in future studies we hope to increase the flexibility as well as the accuracy of what we can translate.”

After training on ...

Interested in reading more?

Become a Member of

The Scientist Logo
Receive full access to more than 35 years of archives, as well as TS Digest, digital editions of The Scientist, feature stories, and much more!
Already a member? Login Here

Keywords

Meet the Author

  • Shawna Williams

    Shawna was an editor at The Scientist from 2017 through 2022. She holds a bachelor's degree in biochemistry from Colorado College and a graduate certificate and science communication from the University of California, Santa Cruz.
Share
Image of small blue creatures called Nergals. Some have hearts above their heads, which signify friendship. There is one Nergal who is sneezing and losing health, which is denoted by minus one signs floating around it.
June 2025, Issue 1

Nergal Networks: Where Friendship Meets Infection

A citizen science game explores how social choices and networks can influence how an illness moves through a population.

View this Issue
Unraveling Complex Biology with Advanced Multiomics Technology

Unraveling Complex Biology with Five-Dimensional Multiomics

Element Bioscience Logo
Resurrecting Plant Defense Mechanisms to Avoid Crop Pathogens

Resurrecting Plant Defense Mechanisms to Avoid Crop Pathogens

Twist Bio 
The Scientist Placeholder Image

Seeing and Sorting with Confidence

BD
The Scientist Placeholder Image

Streamlining Microbial Quality Control Testing

MicroQuant™ by ATCC logo

Products

waters-logo

How Alderley Analytical are Delivering eXtreme Robustness in Bioanalysis

Nuclera’s eProtein Discovery

Nuclera and Cytiva collaborate to accelerate characterization of proteins for drug development

Sapio Sciences_Logo

Sapio Sciences Appoints Gordon McCall as Chief Operating Officer to Drive Global Operational Excellence