Q&A: Stanford engineers discuss digital doubles

Digital doubles are becoming more powerful and accessible. What could that mean for actors – and society at large?

Professors Gordon Wetzstein and Karen Liu (Computer Science) talk with Stanford News on the emerging technologies that are making digital doubles possible.

In terms of sheer digital ability, filmmakers today have more creative power than ever.

Motion capture makes it possible to use Josh Brolin’s movements to realistically animate the Marvel villain Thanos. Photogrammetry rigs with dozens to hundreds of cameras snap actors from countless angles and illuminations, creating 3D computer models of their faces that can then produce scenes that were never captured in reality. These "digital doubles" allow filmmakers to save money on stunt doubles, portray actors in extreme scenarios, create animated sequences an actor never actually performed, or even digitally replicate actors who have passed away.

"People think this is a new thing, but this technology has been used in film visual effects for the past five to 10 years. Pretty much any Hollywood movie today incorporates this," said Gordon Wetzstein, associate professor of electrical engineering. "To a regular person, it’s very hard to tell whether something is real or a digital double."

Now, emerging technologies like generative AI are making digital doubles even more powerful and accessible, potentially disrupting both the film industry and society at large while also offering new tools for applications like medical diagnostics, biomechanics, and 3D teleconferencing. To learn more, Stanford News sat down with Gordon Wetzstein, whose research includes creating digital facial likenesses, and Karen Liu, professor of computer science, who studies the digital replication of physical human motion.

Read full article "Q&A: Stanford engineers discuss digital doubles," September 26, 2023.