Category Archives: Photography

Snapseed adds automatic object selection & editing

AI/ML, Photography

Back when I worked in Google Research, my teammates developed fast models divide images & video into segments (people, animals, sky, etc.). I’m delighted that they’ve now brought this tech to Snapseed:

The new Object Brush in Snapseed on iOS, accessible in the “Adjust” tool, now lets you edit objects intuitively. It allows you to simply draw a stroke on the object you want to edit and then adjust how you want it to look, separate from the rest of the image.

Check out the team blog post for lots of technical details on how the model was trained.

The underlying model powers a wide range of image editing and manipulation tasks and serves as a foundational technology for intuitive selective editing. It has also been shipped in the new Chromebook Plus 14 to power AI image editing in the Gallery app. Next, we plan to integrate it across more image and creative editing products at Google.

Behind the scenes: Photographing Giuliani

Photography

A recent Time Magazine cover featuring Zohran Mamdani made me recall a super interesting customer visit I did years ago with photographer Gregory Heisler. Politics aside, this is a pretty cool peek behind the curtains on the making of an epic image:

As for the Mamdani shoot, it sounds quite memorable unto itself—for incredibly different reasons:

[Via]

Google Photos adds GenAI features

AI/ML, Google Photos, Photography

The app promises to let you turn static images into short videos and transform them into fun art styles, plus explore a new creation hub.

I’m excited to try it out, but despite the iOS app having been just updated, it’s not yet available—at least for me. Meanwhile, although I just bit the bullet & signed up for the $20/mo. plan, the three video attempts that Gemini allowed me today all failed. ¯\_(ツ)_/¯

Safari: Shake a Tailfeather

Photography

To be honest I’ve never taken a more than passing interest in most birds, and certainly in photographing them, but the insane diversity of those in southern Africa was too much to resist. Here are some of my favorites we spied on our journey through Zimbabwe & Botswana:

Meanwhile we enjoyed visiting Painted Dog Conservation and learning about their tireless efforts to preserved & rehabilitate some of the 6,000 or so of these unique animals that remain in the wild—and that often fall prey to poachers’ snares. Tap/click to see a rather charming little vid:

Here’s a bit more about their work:

Safari: Big Mouths & Small Spots

Photography

Hey friends—we’ve made it home to Cali after a whirlwind trip to Zimbabwe & Botswana. I’ll try to post some observations about the state of photo editing these days, and I’d love to hear yours. Meanwhile, while my body still tries to clue into where & when the heck I am, here are a few small galleries I’ve shared so far:

View this post on Instagram

A post shared by John Nack (@jnack)

View this post on Instagram

A post shared by John Nack (@jnack)

Gone (lion) fishin’

Photography

D’oh—before heading to Zimbabwe & Botswana with my wife to celebrate our 20th anniversary, I neglected to mention that things will be a bit quieter around here than normal. We plan to return to the States next week, and I might share a few posts between now & then. Meanwhile, check out some new friends we made this morning!

AI brings people to tears—of joy

AI/ML, Photography

Several years ago, MyHeritage saw a huge (albeit short-lived) spike in interest from their Deep Nostalgia feature that animated one’s old photos. Everything old is new again, in many senses. Check out Reddit founder Alexis Ohanian talk about how touching he found the tech—as well as tons of blowback from people who find it dystopian.

The new Flux rocks for image restoration

AI/ML, Photography

Please tell me Adobe is hiding off screen, secretly cooking up magic. Please…

Meanwhile, you can try it yourself here.

Sigma BF: Clean AF

Design, Photography

Refreshingly simple design!

Is it for me? Dunno: lately the only thing that justifies shooting with something other than my phone is a big, fast zoom lens, and I don’t know whether pairing such a thing with this slim beauty would kinda defeat the purpose. Still, I must know more…

Here’s a nice early look at the cam plus a couple of newly announced lenses:

SynthLight promises state-of-the-art relighting

AI/ML, Photography, Relighting

Here’s a nice write-up covering this paper. It’ll be interesting to dig into the details of how it compares to previous work (see category). [Update: The work comes in part from Adobe Research—I knew those names looked familiar :-)—so here’s hoping we see it in Photoshop & other tools soon.]

New AI-powered upscalers arrive

AI/ML, Photography

Check out the latest from Topaz:


Alternately, you can run InvSR via Gradio:

Thunder & The Deep Blue Sea

Photography

Everybody needs a good wingman, and when it comes to celebrating the beauty of aviation, I’ve got a great one in my son Henry. Much as we’ve done the last couple of years, this month we first took in the air show in Salinas, featuring the USAF Thunderbirds…

…followed by the Blue Angels buzzing Alcatraz & the Golden Gate at Fleet Week in San Francisco.

In both cases we were treated to some jaw-dropping performances—from a hovering F-35 to choreographed walls of fire—from some of the best aviators in the world. Check ’em out:

And thanks for the nice shootin’, MiniMe!

iPhone goes on safari

Photography

Austin Mann puts the new gear through its paces in Kenya:

Last week at the Apple keynote event, the iPhone camera features that stood out the most to me were the new Camera Control button, upgraded 48-megapixel Ultra Wide sensor, improved audio recording features (wind reduction and Audio Mix), and Photographic Styles. […]

Over the past week we’ve traveled over a thousand kilometers across Kenya, capturing more than 10,000 photos and logging over 3TB of ProRes footage with the new iPhone 16 Pro and iPhone 16 Pro Max cameras. Along the way, we’ve gained valuable insights into these camera systems and their features.

iPhone 16 + AI: Quick helpful summaries

Mobile, Photography

Check out my friend Bilawal’s summary thread, which pairs quick demos from Apple with bits of useful context:

There are some great additional details in this thread from Halide Camera as well:

Photography: Chasing Shreveport Steam

Photography

(And no, I’m not just talking oppressive humidity—though after living in California so long, that was quite a handful.) My 14yo MiniMe Henry & I had a ball over the weekend on our first trip to Louisiana, chasing the Empress steam engine as it made its way from Canada down to Mexico City. I’ll try to share a proper photo album soon, but in the meantime here are some great shots from Henry (enhanced with the now-indispensible Generative Fill), plus a bit of fun drone footage:

GenFill comes to Lightroom!

AI/ML, Generative Fill, Lightroom, Photography

When I surveyed thousands of Photoshop customers waaaaaay back in the Before Times—y’know, summer 2022—I was struck by the fact that beyond wanting to insert things into images, and far beyond wanting to create images from scratch, just about everyone wanted better ways to remove things.

Happily, that capability has now come to Lightroom. It’s a deceptively simple change that, I believe, required a lot of work to evolve Lr’s non-destructive editing pipeline. Traditionally all edits were expressed as simple parameters, and then masks got added—but as far as I know, this is the first time Lr has ventured into transforming pixels in an additive way (that is, modify one bunch, then make subsequent edits that depend on the previous edits). That’s a big deal, and a big step forward for the team.

A few more examples courtesy of Howard Pinsky:

Lego + GenFill = Yosemite Magic

Adobe Firefly, Generative Fill, Photography

Or… something like that. Whatever the case, I had fun popping our little Lego family photo (captured this weekend at Yosemite Valley’s iconic Tunnel View viewpoint) into Photoshop, selecting part of the excessively large rock wall, and letting Generative Fill give me some more nature. Click or tap (if needed) to see the before/after animation:

Google Research promises better image compositing

AI/ML, Photography

Speaking of folks with whom I’ve somehow had the honor of working, some of my old teammates from Google have unveiled ObjectDrop. Check out this video & thread:

A bit more detail, from the project site:

Diffusion models have revolutionized image editing but often generate images that violate physical laws, particularly the effects of objects on the scene, e.g., occlusions, shadows, and reflections. By analyzing the limitations of self-supervised approaches, we propose a practical solution centered on a counterfactual dataset.

Our method involves capturing a scene before and after removing a single object, while minimizing other changes. By fine-tuning a diffusion model on this dataset, we are able to not only remove objects but also their effects on the scene. However, we find that applying this approach for photorealistic object insertion requires an impractically large dataset. To tackle this challenge, we propose bootstrap supervision; leveraging our object removal model trained on a small counterfactual dataset, we synthetically expand this dataset considerably.

Our approach significantly outperforms prior methods in photorealistic object removal and insertion, particularly at modeling the effects of objects on the scene.

Irish blessings

Photography

Hey gang—I hope you’ve had a safe & festive St. Patrick’s Day. To mark the occasion, I figured I’d reshare a couple of the videos I captured in the old country with my dad back in August.

Here’s Co. Clare’s wild burren (“rocky district,” hence the choice of Chieftains/Stones banger)…

…my dad’s grandparents’ medieval town in Galway…

…and my mom’s mother’s farm in Mayo:

Creating the creepy infrared world of Dune

Photography

I really enjoyed Dolby’s recent podcast on Greig Fraser and the Cinematography of Dune: Part Two, as well as this deep dive with Denis Villeneuve on how they modified an ARRI Alexa LF IMAX camera to create the Harkonnens’ alienating home world.

I love this idea and I tried, for Giedi Prime, the home world of Harkonnen, there’s less information in the book and it’s a world that is disconnected from nature. It’s a plastic world. So, I thought that it could be interesting if the light, the sunlight could give us some insight on their psyche. What if instead of revealing colors, the sunlight was killing them and creating a very eerie black and white world, that will give us information about how these people perceive reality, about their political system, about how that primitive brutalist culture and it was in the screenplay.

Happy birthday to Photoshop, Lightroom, and Camera Raw!

Photography

I’m a day late saying it here, but happy birthday to three technologies that changed my life (all our lives, maybe), and to which I’ll be forever grateful to have gotten to contribute. As Jeff Schewe noted:

Happy Birthday Digital Imaging…aka Photoshop, Camera Raw & Lightroom. Photoshop shipped February 19th, 1990. Camera Raw shipped February 19th, 2003 and Lightroom shipped February 19th, 2007. Coincidence? Hum, I wonder…but ya never know when Thomas Knoll is involved…

Check out Jeff’s excellent overview, written for Photoshop’s 30th, as well as his demo of PS 1.0 (which “cost a paltry $895 and could run on home computers like the Macintosh IIfx for under $10,000″—i.e. ~$2,000 & $24,000 today!).

Deeply chill photography

Photography

(Cue Metallica’s Trapped Under Ice!)

Russell Brown & some of my old Photoshop teammates recently ventured into -40º (!!) weather in Canada, pushing themselves & their gear to the limits to witness & capture the Northern Lights:

Perhaps on future trips they can team up with these folks:

To film an ice hockey match from this new angle of action, Axis Communications used a discrete modular camera — commonly seen in ATM machines, onboard vehicles, and other small spaces where a tiny camera needs to fit — and froze it inside the ice.

Check out the results:

Behind—and under—the scenes:

Reflect on this: Project See Through burns through glare

Adobe MAX, AI/ML, Photography

Marc Levoy (professor emeritus at Stanford) was instrumental in delivering the revolutionary Night Sight mode on Pixel 3 phones—and by extension on all the phones that quickly copied their published techniques. After leaving Google for Adobe, he’s been leading a research team that’s just shown off the reflection-zapping Project See Through:

Today, it’s difficult or impossible to manually remove reflections. Project See Through simplifies the process of cleaning up reflections by using artificial intelligence. Reflections are automatically removed, and optionally saved as separate images for editing purposes. This gives users more control over when and how reflections appear in their photos.

DJI “Spotlight Mode” looks rad

Photography

I’ve been flying a bunch here in Ireland this week & can’t wait to share some good stuff soon. (Weren’t transatlantic plane rides meant for video editing?) In the meantime, I’m only now learning of a really promising-looking way to have the drone focus on a subject of interest, leaving the operator free to vary other aspects of flight (height, rotation, etc.). Check it out: