Davis will show how video can be a powerful way to measure physical vibrations. By relating the frequencies of subtle, often imperceptible changes in video to the vibrations of visible objects, we can reason about the physical properties of those objects and the forces that drive their motion. In my talk I'll show how this can be used to recover sound from silent video (Visual Microphone), estimate the material properties of visible objects (Visual Vibrometry), and learn enough about the physics of objects to create plausible image-space simulations (Dynamic Video).
Abe Davis is a new postdoc at Stanford working with Doug James. He recently completed his PhD at MIT, where he was advised by Fredo Durand. His thesis focused on analyzing subtle variations in video to reason about physical vibrations. Abe has explored applications of his work in graphics, vision, and civil engineering, with publications in SIGGRAPH, SIGGRAPH Asia, and CVPR, as well as top venues in structural health monitoring and nondestructive testing. His dissertation won the 2016 Sprowls award for outstanding thesis in computer science. Abe's research has been featured in most major news outlets that cover science and technology. Business Insider named him one of the "8 most innovative scientists in tech and engineering" in 2015, and Forbes named him one of their "30 under 30" in 2016.