Hao Li
Hao Li | |
---|---|
黎顥 | |
Born | |
Citizenship | German |
Alma mater | ETH Zurich (2010) Karlsruhe Institute of Technology (2006) |
Known for | Human Digitization, Facial Performance Capture |
Awards | TR35 Award ONR YIP |
Scientific career | |
Fields | Computer Graphics, Computer Vision |
Institutions | Pinscreen (Founder/CEO) University of Southern California (Associate Professor) Institute for Creative Technologies (Director) |
Thesis | Animation Reconstruction of Deformable Surfaces (2010) |
Doctoral advisor | Mark Pauly |
Website | www |
Hao Li (Chinese: 黎顥; pinyin: Lí Hào; born January 17, 1981, in Saarbrücken, West Germany) is a computer scientist, innovator, and entrepreneur from Germany, working in the fields of computer graphics and computer vision. He is founder and CEO of Pinscreen, Inc., associate professor of computer science[1] at the University of Southern California, as well as director of the Vision and Graphics Lab at the USC Institute for Creative Technologies.[2] He was previously a visiting professor at Weta Digital and a research lead at Industrial Light & Magic / Lucasfilm.
For his work in non-rigid shape registration, human digitization, and real-time facial performance capture, Li received the TR35 Award in 2013 from the MIT Technology Review.[3] He was named Andrew and Erna Viterbi Early Career Chair in 2015, and was awarded the Google Faculty Research Award and the Okawa Foundation Research Grant the same year. Li won an Office of Naval Research Young Investigator Award in 2018[4] and was named to the DARPA ISAT Study Group in 2019.[5] He is a member of the Global Future Council on Virtual and Augmented Reality of the World Economic Forum.[6]
Early life
Li was born in 1981 in Saarbrücken, Germany (then West Germany). His parents are both Taiwanese immigrants living in Germany.[citation needed]
Education
Li went to a French-German high school in Saarbrücken and speaks four languages (English, German, French, and Mandarin Chinese). He obtained his Diplom (eq. M.Sc.) in Computer Science at the Karlsruhe Institute of Technology (then University of Karlsruhe (TH)) in 2006 and his PhD in Computer Science at ETH Zurich in 2010. He was a visiting researcher at ENSIMAG in 2003, the National University of Singapore in 2006, Stanford University in 2008, and EPFL in 2010. He was also a postdoctoral fellow at Columbia University and Princeton University between 2011 and 2012.
Career
Li joined Industrial Light & Magic / Lucasfilm in 2012 as a research lead to develop the next generation real-time performance capture technologies for virtual production and visual effects. He has been on the faculty in the Computer Science department[1] at the University of Southern California since 2013, where he is currently an associate professor. In 2014, he spent a summer as a visiting professor at Weta Digital working on facial tracking and hair digitization technologies for the visual effects of Furious 7 and The Hobbit: The Battle of the Five Armies. In 2015, he founded Pinscreen, Inc., an Artificial Intelligence startup that specializes on the creation of photorealistic virtual avatars using advanced machine learning algorithms.[7] In 2016, he was appointed director of the Vision and Graphics Lab at the USC Institute for Creative Technologies.
Research
He has worked on dynamic geometry processing and data-driven techniques for making 3D human digitization and facial animation. During his PhD, Li co-created a real-time and markerless system for performance-driven facial animation based on depth sensors which won the best paper award at the ACM SIGGRAPH / Eurographics Symposium on Computer Animation in 2009.[8] The team later commercialized a variant of this technology as the facial animation software Faceshift[9] (acquired by Apple Inc. in 2015 and incorporated into the iPhone X in 2017[10][11]). This technique in deformable shape registration is used by the company C-Rad AB and deployed in hospitals for tracking tumors in real-time during radiation therapy. In 2013, he worked on a home scanning system that uses a Kinect to capture people into game characters or realistic miniature versions.[12] This technology was licensed by Artec and released as a free software Shapify.me. In 2014, he was brought on as visiting professor at Weta Digital to build the high-fidelity facial performance capture pipeline for reenacting the deceased actor Paul Walker[13] in the movie Furious 7 (2015).
His recent research focuses on combining techniques in Deep Learning and Computer Graphics to facilitate the creation of 3D avatars and to enable true immersive face-to-face communication and telepresence in Virtual Reality.[14] In collaboration with Oculus / Facebook, in 2015 he helped developed a facial performance sensing head-mounted display,[15] which allows users to transfer their facial expressions onto their digital avatars while being immersed in a virtual environment. In the same year, he founded the company Pinscreen, Inc.[16] in Los Angeles, which introduced a technology that can generate realistic 3D avatars of a person including the hair from a single photograph.[17] They also work on deep neural networks that can infer photorealistic faces[18] and expressions,[19] which has been showcased at the Annual Meeting of the New Champions 2019 of the World Economic Forum in Dalian.[7]
Due to the ease of generating and manipulating digital faces, Hao has been raising public awareness about the threat of manipulated videos such as deepfakes.[20][21] In 2019, Hao and media forensics expert, Hany Farid, from the University of California, Berkeley, released a research paper outlining a new method for spotting deepfakes by analyzing facial expression and movement patterns of a specific person.[7] With the rapid progress in artificial intelligence and computer graphics, Li has predicted that genuine videos and deepfakes will become indistinguishable in as soon as 6 to 12 months, as of September 2019.[22] In January 2020, Li spoke at the World Economic Forum Annual Meeting 2020 in Davos about deepfakes[23] and how they could pose a danger to society. Li and his team at Pinscreen, Inc. also demonstrated a real-time deepfake technology[24] at the annual meeting, where the faces of celebrities are superimposed onto the participants' face.
Awards
- DARPA Information Science and Technology (ISAT) Study Group Member.[5]
- Office of Naval Research Young Investigator Award.[4]
- Andrew and Erna Viterbi Early Career Chair.[25]
- Okawa Foundation Research Grant.[26]
- Google Faculty Research Award.[27]
- World's top 35 innovator under 35 by MIT Technology Review.[3]
- Best Paper Award at the ACM SIGGRAPH / Eurographics Symposium on Computer Animation 2009.
Media
For his work on visual effects, Hao has been credited in several motion pictures, including Blade Runner 2049 (2017), Valerian and the City of a Thousand Planets (2017), Furious 7 (2015), The Hobbit: The Battle of the Five Armies (2014), and Noah (2014). Hao also appeared as himself in various documentaries on artificial intelligence and deepfakes, including Buzzfeed's Follow This in 2018, CBC's The Fifth Estate in 2018, and iHuman[28] in 2019.
References
- ^ a b [1] Archived 2016-07-07 at the Wayback Machine from faculty roster at USC Computer Science Department, retrieved 2015-03-03.
- ^ "Hao Li to Spearhead Vision and Graphics Lab at the USC Institute for Creative Technologies". viterbi.usc.edu. USC.
- ^ a b [2] from MIT Technology Review TR35 Awards, retrieved 2015-03-03.
- ^ a b "Hao Li Earns Office of Naval Research Young Investigator Award - USC Viterbi | School of Engineering". USC Viterbi | School of Engineering. Retrieved 2018-03-25.
- ^ a b "Hao Li Selected for the DARPA ISAT Study Group". USC Institute for Creative Technologies. Retrieved 2019-12-08.
{{cite web}}
: CS1 maint: url-status (link) - ^ "Global Future Council on Virtual and Augmented Reality". World Economic Forum. Retrieved 2019-12-08.
- ^ a b c Knight, Will. "The world's top deepfake artist is wrestling with the monster he created". MIT Technology Review. Retrieved 2019-12-08.
- ^ "Face/Off: live facial puppetry". ACM.
- ^ "Performance driven facial animation". www.fxguide.com. fxguide.
- ^ "All of Apple's Face-Tracking Tech Behind the iPhone X's Animoji". WIRED. Retrieved 2017-10-25.
- ^ "Professor's research contributed to iPhone X | Daily Trojan". Daily Trojan. 2017-09-27. Retrieved 2017-10-25.
- ^ "Hao Li wants to scan you into your favourite games". wired.co.uk. Wired.
- ^ "How I Made It: USC professor brings computer animation to life". www.latimes.com. LA Times.
- ^ "Who wants to show up as Gandalf at their next meeting?". news.usc.edu. USC.
- ^ "Oculus Rift Hack Transfers Your Facial Expressions onto Your Avatar". technologyreview.com. MIT Technology Review.
- ^ "Stealth Face-Tracking Startup Pinscreen Raises $1.8 Million". uploadvr.com. UploadVR.
- ^ "Pinscreen launches with high-tech distractions for a nerve-wracking election". techcrunch.com. TechCrunch.
- ^ "Photorealistic facial texture from a single still". fxguide.com. fxguide.
- ^ Pierson, David. "Fake videos are on the rise. As they become more realistic, seeing shouldn't always be believing". latimes.com. Retrieved 2018-03-25.
- ^ "FOX 11 In Depth: The dangers of social media". FOX 11 Los Angeles. Retrieved 2019-12-08.
{{cite web}}
: CS1 maint: url-status (link) - ^ O'Neill, Patrick Howell. "The world's top deepfake artist: 'Wow, this is developing more rapidly than I thought.'". MIT Technology Review. Retrieved 2019-12-08.
{{cite web}}
: CS1 maint: multiple names: authors list (link) CS1 maint: numeric names: authors list (link) - ^ Stankiewicz, Kevin (2019-09-20). "'Perfectly real' deepfakes will arrive in 6 months to a year, technology pioneer Hao Li says". CNBC. Retrieved 2019-12-08.
- ^ "Deepfakes: Do Not Believe What You See". World Economic Forum. Retrieved 2020-01-26.
- ^ Thomas, Daniel (2020-01-23). "Deepfakes: A threat to democracy or a bit of fun?". BBC News. Retrieved 2020-01-26.
- ^ "Endowed chairs and professorships at USC Viterbi School of Engineering". USC.
- ^ "USC Professors Earn International Award". USC.
- ^ "Google Faculty Research Award 2015" (PDF).
- ^ Keslassy, Elsa (2019-11-15). "Cinephil Acquires AI-Themed Political Thriller Documentary 'iHuman' (EXCLUSIVE)". Variety. Retrieved 2019-12-09.