Looks like a simple but perhaps compelling use of ML & AR:
Zenia encompasses the best of computer vision and machine learning. She uses motion tracking and the data from thousands of yoga lessons to analyze my movements. During the practice, Zenia provides gentle feedback and also takes care of basic safety rules.
We are excited to announce the release of BodyPix, an open-source machine learning model which allows for person and body-part segmentation in the browser with TensorFlow.js. With default settings, it estimates and renders person and body-part segmentation at 25 fps on a 2018 15-inch MacBook Pro, and 21 fps on an iPhone X.
BodyPix 2.0 has been released, including multi-person segmentation support and a new live demo!
Here’s a 2-minute concept video followed by a 6-minute on-stage demo.
Certainly looks a lot more pleasant than this classic nightmare 🙃:
Being able to place PSD layers in space & then draw a path to animate an object along it (see attached screenshot) is pretty slick. The Aero iOS app is available now, with desktop & hopefully Android to follow.
How would one go about popping the iconic ol’ gal off her background to display her in 3D? That’s just one of the numerous challenges faced by the artists who enabled seeing new & up-close angles on the piece. Check out the quick tour:
Instead of squeezing models down to a couple of megs & constraining rendering to what a phone alone can do, what if you could use a full-power game engine to render gigabyte-sized models in realtime in the cloud, streaming the results onto your device to combine with the world? That’s the promise of Nvidia CloudXR (which looks similar to Microsoft Azure Remote Rendering), announced this week:
Much like his big bro did last year (see below), our son Henry stepped up to el micrófono to tell tales of meteorological mayhem. It took a village, with mom scoring a green-screen kit from her Adobe video pals & me applying some AR effects created by my talented teammates.
Here’s a behind-the-scenes peek at our advanced VFX dojo/living room. 😌