Google 'Headset Removal' Brings Your Face Into Mixed Reality Recordings

[kcarbotte]

Google developed a technique that combines advanced technology including machine learning and 3D vision to bring your face back into mixed reality VR recordings.

Google 'Headset Removal' Brings Your Face Into Mixed Reality Recordings : Read more

 

[bit_user]

Yeah, it looks about as creepy as I expected. Perhaps the next iteration will use the mouth expression to deform the eyes, so you don't have people smiling with a blank stare. Perhaps they might also find a way to use the eye trackers to estimate the upper facial expression, and use that to deform the image.

Anyway, I think it's good for brief, distant shots in promo videos. If I were producing content with this system, I'd definitely minimize closeups and frontal shots of more than a second or so.