AI Decodes Speech and Hearing Based on Brain Activity

The proof-of-concept study could be a step toward better assisted communication devices for paralyzed people.

| 2 min read
an illustration of a person's head rendered in 1s and 0s

Register for free to listen to this article
Listen with Speechify
0:00
2:00
Share

ABOVE: © ISTOCK.COM, SAMARETS1984

When people listened to questions from a predetermined set and spoke a response from a group of answer options, a computer program could correctly predict the question based on their brain activity most of the time, researchers report today (July 30) in Nature Communications.

The study, conducted on three people who had arrays of electrodes temporarily implanted in their brains to monitor their brain activity in preparation for surgery for epilepsy, was funded by Facebook and carried out at the University of California, San Francisco (UCSF).

“This is the first time this approach has been used to identify spoken words and phrases,” coauthor David Moses tells The Guardian. “It’s important to keep in mind that we achieved this using a very limited vocabulary, but in future studies we hope to increase the flexibility as well as the accuracy of what we can translate.”

After training on ...

Interested in reading more?

Become a Member of

The Scientist Logo
Receive full access to more than 35 years of archives, as well as TS Digest, digital editions of The Scientist, feature stories, and much more!
Already a member? Login Here

Keywords

Meet the Author

  • Shawna Williams

    Shawna was an editor at The Scientist from 2017 through 2022. She holds a bachelor's degree in biochemistry from Colorado College and a graduate certificate and science communication from the University of California, Santa Cruz.
Share
A greyscale image of cells dividing.
March 2025, Issue 1

How Do Embryos Know How Fast to Develop

In mammals, intracellular clocks begin to tick within days of fertilization.

View this Issue
Discover the history, mechanics, and potential of PCR.

Become a PCR Pro

Integra Logo
3D rendered cross section of influenza viruses, showing surface proteins on the outside and single stranded RNA inside the virus

Genetic Insights Break Infectious Pathogen Barriers

Thermo Fisher Logo
A photo of sample storage boxes in an ultra-low temperature freezer.

Navigating Cold Storage Solutions

PHCbi logo 
The Immunology of the Brain

The Immunology of the Brain

Products

Sapio Sciences

Sapio Sciences Makes AI-Native Drug Discovery Seamless with NVIDIA BioNeMo

DeNovix Logo

New DeNovix Helium Nano Volume Spectrophotometer

Olink Logo

Olink® Reveal: Accessible NGS-based proteomics for every lab

Olink logo
Zymo Logo

Zymo Research Launches the Quick-16S™ Full-Length Library Prep Kit