Google AI now can give YouTube videos a wacky background
Machine learning proves its worth for new video effects tech: distinguishing between faces and backgrounds at 100 frames per second.
Google, though, trained a neural network with lots of carefully labeled imagery that helped it learn how to distinguish facial features -- eyes, hair, glasses, mouths and so on -- from everything else. The result is a system that can swap out backgrounds fast enough to keep up with video. Digital video frames whip by at 30 frames per second, but Google's technology works at 40 frames per second on a Google Pixel 2 phone and more than 100 frames per second on an Apple iPhone 7.
Want to try it out for yourself? Sorry. For now, it's available to only a pretty small number of high-profile YouTubers with access to the YouTube stories service, which offers an ability to share Snapchat-esque short videos.
Google detailed the research in a blog post Thursday.
"Our new segmentation technology allows creators to replace and modify the background, effortlessly increasing videos' production value without specialized equipment," Google programmers Valentin Bazarevsky and Andrei Tkachenka said in the blog post.
See the full story here: https://www.cnet.com/news/google-ai-can-give-youtube-videos-a-wacky-background/