Visualizing the Vibe

Retrieving sound from video recordings of inanimate objects can have surprising applications.

| 4 min read

Register for free to listen to this article
Listen with Speechify
0:00
4:00
Share

SEEING SOUND: Researchers recovered human speech by analyzing high-speed video recordings of a bag of chips vibrating in response to speech from a cell phone in the same room.ABE DAVIS

Watch what you say. Nearly everything around you—from potted plants to a bag of chips—is catching your vibes. Sound waves pinging off the surfaces of these objects cause tiny vibrations invisible to the naked eye. But a group of MIT researchers led by William Freeman has devised a way to spot these movements on a high-speed video recording and use them to reconstruct the sound that triggered them. Their technique, presented at a meeting in August, effectively turns a variety of everyday objects into visual microphones.

Retrieving speech or song from footage of a shiny piece of foil may seem like the stuff of spy movies, but by magnifying minuscule movements, researchers could do some surprising, far-fetched things. “Our labs have been doing this work ...

Interested in reading more?

Become a Member of

The Scientist Logo
Receive full access to digital editions of The Scientist, as well as TS Digest, feature stories, more than 35 years of archives, and much more!
Already a member? Login Here

Keywords

Meet the Author

  • Jyoti Madhusoodanan

    This person does not yet have a bio.

Published In

Share
A greyscale image of cells dividing.
March 2025, Issue 1

How Do Embryos Know How Fast to Develop

In mammals, intracellular clocks begin to tick within days of fertilization.

View this Issue
Discover the history, mechanics, and potential of PCR.

Become a PCR Pro

Integra Logo
3D rendered cross section of influenza viruses, showing surface proteins on the outside and single stranded RNA inside the virus

Genetic Insights Break Infectious Pathogen Barriers

Thermo Fisher Logo
A photo of sample storage boxes in an ultra-low temperature freezer.

Navigating Cold Storage Solutions

PHCbi logo 
The Immunology of the Brain

The Immunology of the Brain

Products

Sapio Sciences

Sapio Sciences Makes AI-Native Drug Discovery Seamless with NVIDIA BioNeMo

DeNovix Logo

New DeNovix Helium Nano Volume Spectrophotometer

Olink Logo

Olink® Reveal: Accessible NGS-based proteomics for every lab

Olink logo
Zymo Logo

Zymo Research Launches the Quick-16S™ Full-Length Library Prep Kit