All posts by jnack

Google releases open-source, browser-based BodyPix 2.0

VR/AR

Over the last couple of years I’ve pointed out a number of cool projects (e.g. driving image search via your body movements) powered by my teammates’ efforts to 1) deliver great machine learning models, and 2) enable Web browsers to run them efficiently. Now they’ve released BodyPix 2.0 (see live demo):

We are excited to announce the release of BodyPix, an open-source machine learning model which allows for person and body-part segmentation in the browser with TensorFlow.js. With default settings, it estimates and renders person and body-part segmentation at 25 fps on a 2018 15-inch MacBook Pro, and 21 fps on an iPhone X.

Enjoy!

Bittersweet Symphony: Lightroom improves iPad import

Mobile, Photography

“Hey, y’all got a water desalination plant, ‘cause I’m salty as hell.” 🙃

First, some good news: Lightroom is planning to improve the workflow of importing images from an SD card:

I know that this is something that photographers deeply wanted, starting in 2010. I just wonder whether—nearly 10 years since the launch of iPad—it matters anymore.

My failure, year in & year out, to solve the problem at Adobe is part of what drove me to join Google in 2014. But even back then I wrote,

I remain in sad amazement that 4.5 years after the iPad made tablets mainstream, no one—not Apple, not Adobe, not Google—has, to the best of my knowledge, implemented a way to let photographers to do what they beat me over the head for years requesting:

  • Let me leave my computer at home & carry just my tablet** & camera
  • Let me import my raw files (ideally converted to vastly smaller DNGs), swipe through them to mark good/bad/meh, and non-destructively edit them, singly or in batches, with full raw quality.
  • When I get home, automatically sync all images + edits to/via the cloud and let me keep editing there or on my Mac/PC.

This remains a bizarre failure of our industry.

Of course this wasn’t lost on the Lightroom team, but for a whole bunch of reasons, it’s taken this long to smooth out the flow, and during that time capture & editing have moved heavily to phones. Tablets represent a single-digit percentage of Snapseed session time, and I’ve heard the same from the makers of other popular editing apps. As phones improve & dedicated-cam sales keep dropping, I wonder how many people will now care.

On we go.

[YouTube]

A surprisingly terrific podcast: “The Great Bitter Lake Association”

Design

Two things I should know by now:

  • Some 99% Invisible podcast is going to seem worthy but so arcane that I just won’t really make time to listen to it.
  • If eventually I do, I’ll be really rewarded for it.

The recent episode about The Great Bitter Lake Association—covering the camaraderie that emerged among sailors in the “Yellow Fleet” that became trapped by the Six-Day War & then stuck in the Suez for years—is totally fascinating. I hope you listen & enjoy. If nothing else, enjoy the homemade postage they created amongst themselves (which eventually became recognized by Egypt & thus usable for sending mail), the discovery of which sets the whole recounting in motion.

NewImage

NewImage

“Sea-thru”: AI-driven underwater color correction

Photography

Dad-joke of a name notwithstanding 😌, this tech looks pretty slick:

PetaPixel writes,

To be clear, this method is not the same as Photoshopping an image to add in contrast and artificially enhance the colors that are absorbed most quickly by the water. It’s a “physically accurate correction,” and the results truly speak for themselves.

And as some wiseass in the comments remarks, “I can’t believe we’ve polluted our waters so much there are color charts now lying on the ocean floor.”

NewImage

[YouTube]