A visual microphone that can pick up sound from vibrations in video footage
"Algorithm recovers speech from the vibrations of a potato-chip bag filmed through soundproof glass"
Project website: http://people.csail.mit.edu/mrub/VisualMic/
"When sound hits an object, it causes small vibrations of the object’s surface. We show how, using only high-speed video of the object, we can extract those minute vibrations and partially recover the sound that produced them, allowing us to turn everyday objects—a glass of water, a potted plant, a box of tissues, or a bag of chips—into visual microphones."
"We also explore how to leverage the rolling shutter in regular consumer cameras to recover audio from standard frame-rate videos, and use the spatial resolution of our method to visualize how sound-related vibrations vary over an object’s surface, which we can use to recover the vibration modes of an object."
This is so cool I wish I could take a 3-hour lunch break to really understand how it works!