Put your hands together—literally—for the music of MediaPipe

AI/ML, Body Tracking, Google Omni

It’s so fun to see work from a past life enabling whole new modes of expression!

Taking a different approach to hand tracking & creativity, check out this Omni experiment:

From Nano Banana to Beast Mode

AI/ML, Illustration, Nano Banana

As I walked the dogs past our new camper van a few weeks back, Pinterest happened to send me some vintage World War II aircraft art. I thought, heh, how nuts would it be to give the van shark teeth? I snapped a quick pic of the van, popped it plus one of the shark mouth designs into the Gemini app, and had Nano Banana mock up the possibilities:

This helped me bring the inimitable & indulgent Margot onboard with the idea, and soon enough I found myself in Illustrator, recreating the art the old fashioned, point-by-point way. Upon seeing the design, the local graphics shop advised me on some needed mods, so I hopped into Photoshop to oblige, invoking a dash of Generative Fill. Check out the (very real!) results.

To me this is just how AI ought to work—not as a creative replacement, but rather as an accelerant that lets us try more things & communicate ideas better.

Flow to the Upside Down

AI/ML, Google Flow, Google Omni

Fill your head with sweet 80’s synth chords, using Google Omni Flash to reimagine suburbia as a sci-fi dreamscape:

Thank you, Dr. Cerf

Miscellaneous

“Correlation is not causation,” and I hope that Internet pioneer Vint Cerf announcing his retirement from Google has nothing to do with my return. 😉

The news brings to mind a couple of fun memories:

“Taste” sucks

Idle Philosophizing

I’ve been trying to put my finger on exactly why the AI-related buzzword du jour gets under my skin. “Taste” is anything but new, yet I can’t stand the way it gets bandied about, like some mystic shibboleth, by grasping little growth hackers.

I’ll have more to say about this (aren’t you lucky!), but I’m reminded of my all-time favorite Steve Jobs clip. He gets at “taste” being a function of work, curiosity, and hard-won love of the excellent.

If a YouTube clip could be worn out like vinyl, I’d have done so long ago, given how many times I played it for teammates at Microsoft. Steve was right 30 years ago & he’s right now. Just buying some Aeron chairs ain’t gonna flip that switch…

Joy-scrolling 3D

3D, AI/ML

I love the art direction on this site, where the pace of animation is controlled by your scrolling:

Meanwhile the “Scroll World” Claude skill promises to interview you (!), then whip something up with the help of generative text-to-video tech (gotta get Omni in there!).

 

How it works is intriguing enough to quote at length from the GitHub page:

—–

It leans on Higgsfield for the art: cohesive isometric diorama scenes (GPT Image 2 — via Higgsfield, or the Codex CLI on a ChatGPT subscription) and the camera flights themselves (Seedance or Kling image-to-video — only models that can frame-lock a seam), scrubbed by scroll position — the same technique behind Apple’s scroll-through product pages. The camera genuinely moves; scroll only drives time. It’s framework-agnostic: you get the Higgsfield pipeline, the prompt templates, and a portable vanilla-JS scrub engine that drops into plain HTML, Next.js, Vue, or a Python-served page — nothing assumes a stack.

When invoked, the skill:

  1. Interviews you — the subject/industry + pitch, a brand kit (import from a URL, hand it over, or have it proposed), art direction, the ordered scenes the camera visits, whether you want the mobile version (a second chain rendered natively in 9:16 portrait — composed for phones, not a crop of the landscape film), and the budget — render tiers and stills source shown with estimated credit costs, approved before anything generates.
  2. Generates the assets — one still per scene, one “dive-in” camera clip per scene, and the connector clips that join consecutive scenes, generated from the actual rendered frames of their neighbours so every seam is frame-identical. Mobile opt-in renders a parallel portrait chain the same way, frame-locked against its own 9:16 renders.
  3. Wires it up — a config-driven scroll engine that plays the whole chain as one flight, serving the portrait clips and posters automatically on phones.

Keeping It Real: How I wished we could’ve made Photoshop feel

Design, User Interface

jnack.com/BlowingYourMindClearOutYourAss—that’s the URL I picked, back circa 2005 (when men were men & we had to self-host all our videos!), to express my admiration for Nelson Chu’s Moxi watercolor app. Harnessing graphics processors to create realtime natural-media simulations has been a passion of his for the better part of 30 years.

We hosted Nelson as a summer intern on Photoshop, but we could never quite manage to marry this tech to the, ah, somewhat vintage underpinnings of PS. Later he launched a refined version as Expresii:


It remains, to my eye, just incredibly cool—never mind that its target audience will seemingly forever be limited to those with serious painting ambitions and abilities.

I thought of all this upon seeing the procedural Damage Control. Here too I dreamed of offering godlike command of realistic materials & motion:

All this stuff has remained so niche, but I think a day is coming—very soon, I hope—when realtime world models (think Google Genie, which is the realtime 3D cousin of our new Gemini Omni) make this kind of grounded manipulation absolutely ubiquitous. We shall see!

Quick tutorial: Create with Omni inside Adobe Boards

AI/ML, Google Omni

Companies are imaginary. Creativity is real.

I love seeing my old friend & Adobe design partner Dave (mentioned innumerable times here over the years) showing off the expressive power of the collaboration so many Adobe & Google friends have been nurturing over the last several months. We have the first fruits showing now in Firefly Boards (try it now!), and there’s so much more we have in mind.

I’ve never cared much about the company name in my email address. All that stuff is always just a means to an end—a way of aligning incentives so we can help people make the world more fun and beautiful. I feel so grateful to have found a spot to stand among friends & continue this work—and we’re just getting started.

“All of this has happened before, and all of this will happen again”

AI/ML, Nano Banana

…So says my friend Chris Perry, who welcomed me to Google 12 years ago and who was essential in shipping the first feature I worked on there—face painting for the 2014 World Cup:

Smash cut to 2026: Chris has just left Big G to start his own company, but we’re still inviting people to paint their faces—and to do so much more—for the World Cup. Opening Gemini today, I saw this smorgasbord of Nano Banana-powered templates:

Finn & Henry (pictured up top) are now far too old and, critically, too cool to abide my applying any patriotic AI to them—but you can give it a try with pics of you & yours. 🙂

“Loser,” baby

Design

“When it’s great, there’s no debate”—ah, what a crock of crap that is.

In this fun behind-the-scenes video, Beck explains how his still-bizarre iconic rap/sitar combo came to be, and how it sat nearly forgotten for years (including by him) before having its breakout moment.

Talk about conviction & commitment from the ol’ perdedor.

Remix your photos using Gemini Omni, right inside Google Photos

AI/ML, Google Omni

The fun has begun:

Located in the Create tab — your central hub for creativity in Google Photos — Video Remix helps you make inspired content in seconds. Instantly apply cinematic relighting to spruce up a dark clip, swap out a plain background for something fun, or add artistic treatments, such as watercolor, raw sketchbook and oil painting effects.

Video Remix starts rolling out today to eligible Google AI Plus, Pro and Ultra subscribers in select countries.

Use Google video models right within Premiere Pro!

AI/ML, Google Omni, Google Veo

I love seeing a plan come together. 😀 Check out this new Premiere Pro integration with Google Veo:

The Google Omni Flash model isn’t there yet, but we’ll work on connecting the dots. As Mark Twain might’ve said, “Some Adobe menus are so long, they have perspective,” and I’d love to get back to contributing to that phenomenon. 😉

In the meantime, my old partner Dave Werner is cooking with Omni inside Firefly Boards—where you can try it yourself:

[Via Bill Hensler]

Fun with Omni: Changing cams, plus Wolverine

AI/ML, Google Omni

Karen X. Cheng shows a subtle but powerful model capability:

 
 
 
 
 
View this post on Instagram
 
 
 
 
 
 
 
 
 
 
 

A post shared by Karen X (@karenxcheng)

Meanwhile Christian Cantrell is looking sharp, is not downright superheroic:

Come build with Gemini Omni Flash!

AI/ML, Google Omni

I’m thrilled to say that the first big launch of my Chapter 2 at Google is here! You can now build on Gemini Omni Flash in Google Enterprise Agent Platform (aka Vertex); see docs.

TBH I was so busy helping get the release out the door, and then taking some much needed rest over the Fourth of July break, that I’ve hardly had a chance to post useful info. I’ll fix that soon! In the meantime, here’s our little intro sizzle reel:

Of beat labs & photo shoots

AI/ML, Photography

It’s always cool to see how creators are embracing new tools:

Quick tour: Creating Flow tools with natural language

AI/ML, Google Flow

My teammate Anika & I got to meet the other day with a really big creative brand the other day (more details to share soon, I hope), and they got excited about delivering super focused, relevant experiences for their customers by building on the Flow agent & apps. Here’s Anika offering a concise tour of how to create, share, and remix the latter:

Behind the scenes: How Skydio builds drones

Design

“Everyone loves love,” as they say. I’ve noted many times just how much I enjoy people enjoying their work—and that pride & purpose clearly come through in this brief glimpse into the making of Skydio drones.

Skydio makes more drones than any other company in America, and it builds all of them inside one factory in Hayward, California. In this episode we go onto the floor with co-founder and CEO Adam Bry to see exactly how the Skydio X10 comes together, from a pile of thousands of parts to a finished autonomous drone that thinks more like a flying robot than a traditional quadcopter.

You will see the steps most companies never show. Skydio waterproofs the critical electronics with a nanocoating process so the X10 can fly in the rain, fuses the drone arms together using high frequency ultrasonic welding, and hand solders the motor wires onto the power board. Inside the chassis sit an NVIDIA CPU and GPU plus a Qualcomm chip running the camera feeds, all stabilized by a custom gimbal that keeps the camera locked while the drone fights wind in the air. Then comes the part that matters most. Every single drone gets pushed through a brutal burn-in stress test, flown by hand, and run through a calibration robot before it is ever allowed to ship.

“Google Just Turned Street View Into a Video Game”

3D, AI/ML

As Bilawal puts it,

At Google I/O 2026, DeepMind shipped Maps Imagery Grounding for Genie 3 — their real-time world model can now generate interactive 3D worlds conditioned to any of the 280 billion Street View images Google has captured over 20 years. Pick a location on Google Maps, choose a style, drop in a character, and walk around.

Check out his accessible & illuminating tour of the new tech:

Omni Teapot

3D, AI/ML, Google Omni

My 16yo is lowkey impressed that at Adobe I got to work with Utah Teapot creator Martin Newell. At this point, anything that impresses a teen is very welcome. 🙂

I wonder what he’d think of Gemini Omni turning real teapots into geometry just by saying the word:

Speedy document scanning via Drive

Mobile

Approximately 2000 years ago (give or take a couple orders of magnitude), we shipped a cool Crop & Straighten feature in Photoshop. It enabled putting a bunch of images into a flatbed scanner (talk about words I haven’t typed in decades) and automatically turn them into individual images (“Lift & Separate,” as PM Karen Gauthier cheekily dubbed it).

Along those lines, but with radically more smarts & speed, check out what you can now do in the Google Drive app (who knew?):

Puppetry + AI FTW: Behind the Scenes with Timmy TPU

AI/ML, Design, Google Omni

I love the blend old-school puppetry, 3D animation, Gemini Omni, and the latest experimental video tools that went into creating TPU Training Day, the short film that debuted during Google I/O 2026.

I know you’ve heard it a million times, but it bears repeating: AI isn’t a substitute for human creativity, or in many cases even for traditional techniques. It’s just a whole new toolbox that can multiply our expressive powers.

And here’s the film itself:

Check out Google Flow Agent

AI/ML, Google Flow, Google Omni

Did I have “Google makes cool, extensible, AI-powered creative tools” on my 2026 Bingo card? I did not—and I’m happy to be wrong! Check this out:

According to the docs, you can use the Agent to:

  • Brainstorm and plan: Chat with the Agent to outline storyboards, develop visual mood boards, and turn high-level concepts into actionable prompts.
  • Generate new media: Ask the Agent to generate videos or images and select the best model to generate with.
  • Edit assets directly: Ask the Agent to edit selected media from your project.
  • Batch generate: Ask the Agent to create multiple variations of an asset at once.
  • Organize your assets: Ask the Agent to rename specific files, group selected media into a new Collection, or archive unused assets.
  • Add context & references: Drag media into the Agent prompt box from your device or project. You can also select multiple assets and let the agent know which media you are referring to.

3D typography using Omni + Flow

3D, AI/ML, Google Flow, Google Omni, Typography

Check out this cool little technique:

This is especially wild when you consider where typography stood just a couple of years ago—for which I’ll forever be kinda nostalgic. 🙂

A beautiful moment of expressivity unlocked

AI/ML, Shit That Actually Matters

Despite—or maybe because—of my line of work, I have some genuinely mixed emotions about AI. Is it about empowerment, devaluation, theft, magic? Yes. It is all, as my wife would say of me, A Lot™.

Alongside whatever else it may be, however, the tech can be a genuine enabler of human expressivity. If you don’t believe me, just take 90 seconds to read & watch this heartfelt moment:

Vibe-code your own VFX apps & more Google Flow Tools

AI/ML, Google Flow, Google Omni

Democratize all the apps!!

I think this new platform will be a major sleeper hit:

With Google Flow Tools, you can build creative workflows customized to fit your creative process. Explore a gallery of premade Tools built by creatives, remix existing ones to fit your needs, or create your own from scratch by just typing a description of what you want to create. You can shape and iterate on these Tools fluidly, adjusting them for individual projects, or singular clips and images. All users can explore Tools in Google Flow, and Google AI subscribers can create custom Tools from scratch or remix existing ones.

Check out the ways some artists have been spinning up tools & putting them to work:

Google Earth + Omni = Drone magic

3D, AI/ML, Google Omni

My friend Bilawal, who used to work in Google’s Geo group (Earth, Maps, and more), has created an eye-popping faux-drone video using Omni Flash:

Here’s another exploration, inspired by Bilawal’s:

A soldier’s sketches of World War II

Illustration

Before commencing his long & distinguished career as an architect, 19yo Victor Lundy captured life at an American GI.

He drew out his experiences from training at Fort Jackson (May 1944) to his journey across the Atlantic and then his time in France. In total, he produced a visual diary with 158 pencil sketches brings to life the wartime experience. Lundy applied his drawing skills to what was around him—training at Fort Jackson, South Carolina; forced marches; men at rest; the PX and tents; New York Harbor; aboard ship in the Atlantic crossing; Cherbourg Harbor; and French villages. Many vivid portraits of fellow soldiers and frontline danger also fill the pages. The sketches cover May to November 1944 when Lundy was wounded, with some gaps where notebooks were lost.

The eight surviving sketchbooks are spiral bound and 3 x 5 inches—small enough to fit in a breast pocket. Lundy used black Hardtmuth leads (a drawing pencil) and sketched quickly. “For me, drawing is sort of synonymous with thinking.”

He later donated his sketches to the Library of Congress. On this Memorial Day, it’s well worth taking some time to dwell with them.

Awesome examples of Omni video transformation

AI/ML, Google Omni

This is such a wild, game-changing feature:

I think Carlos gets it exactly right: “I think many are focusing on the wrong aspect of the Gemini Omni model when comparing it to Seedance 2.0, since conceptually they are entirely different things. This is a model for editing videos (like Nano Banana) like we’ve never had before!“

“Nano Banana for video” is here!

AI/ML, Google Omni, Nano Banana

I’m so pleased to be playing a very small role in bringing breakthrough video transformation to the world. Check out the new Gemini Omni:

The team writes,

We’re introducing Gemini Omni, where Gemini’s ability to reason meets the ability to create. Omni is our new model that can create anything from any input — starting with video. With Omni, you can combine images, audio, video and text as input and generate high-quality videos grounded in Gemini’s real-world knowledge. You can also easily edit your videos through conversation.

Today, we’re rolling out the first model in the Omni family: Gemini Omni Flash, to the Gemini app, Google Flow and YouTube Shorts. In time we will support output modalities like image and audio.

Conversational video editing is the real breakthrough:

Check it out & let us know what you think!

Putting in the mental reps

AI/ML, Idle Philosophizing

I keep finding myself thinking of this observation from Paul Graham:

“In preindustrial times most people’s jobs made them strong. Now if you want to be strong, you work out. So there are still strong people, but only those who choose to be. It will be the same with writing. There will still be smart people, but only those who choose to be.“

To reiterate from a previous post, quoting Keep the Robots Out of the Gym:

Think very carefully about where you get help from AI.

I think of it as Job vs. Gym.

  • If we’re working a manual labor job, it’s fine to have AI lift heavy things for us because the actual goal is to move the thing, not to lift it.
  • This is the exact opposite of going to the gym, where the goal is to lift the weight, not to move it.

He argues for identifying gym tasks (e.g. critical thinking, problem solving), and for those use just your brain (with minimal AI assistance, if any).

My primary metric for this is whether or not I am getting sharper at the skills that are closest to my identity.

Try personalized image creation via Gemini

AI/ML, Google Photos, Nano Banana

As I often said back in the day, Google’s longstanding mission is to “organize the world’s information and make it useful.” A lot of that information is photographic, and a lot of that information is private; hence the value and power of Google Photos. It knows (with your blessings) who’s who, what places are important, and so on.

Now Nano Banana can leverage that info to make fun and beautiful things on your behalf.

Since you can already organize and label groups of people and pets in your library, those labels provide the context that Gemini needs to make your images feel truly yours…

With those labels in place, you can simply ask Gemini to “create a claymation image of me and my family enjoying our favorite activity” and Gemini can generate that specific image for you automatically. You can also experiment with different styles like watercolors, charcoal sketches or oil paintings. You can turn a quick idea into a custom creation, saving you the trouble of searching for, downloading and re-uploading files just to see a concept come to life.

3D pets, now & then

3D, User Interface

Check out this charming & revealing image->3D creation from Gábor Pribék:

Folks in the replies fondly remembered back to the Cat Explorer demo for Leap Motion (rest in power):

Google Earth + Nano Banana? Go Go Godzilla!

3D, AI/ML, Nano Banana

I love this kind of simple, scrappy creativity,:

Here’s the Chrome extension:

  • Capture any Google Earth 3D view
  • Transform with AI (Nano Banana Pro) into cinematic shots
  • Generate videos (Veo 3.1) with customizable duration and audio

GenFill + Vividon = Magic

AI/ML, Photography, Relighting

It’s insane what we can do now—from object removal to lighting changes—that was simply out of the question even a year ago.

Check out this little progression of edits, starting with the newly enhanced Generative Fill in the Photoshop beta, followed by a couple of steps of Remove, followed by a pass with Vividon & a few tweaks in Camera Raw (running inside PS):

Nutty & I’m here for it. Per PetaPixel,

Co-founder and Chief Innovation Officer Marcus Kurn adds that the ability to deliver two or three lighting variations alongside every final image is a real differentiator: “once you start delivering two or three lighting variations with every final image, your clients will never want to go back.”

Vividon relighting comes to Photoshop

AI/ML, Relighting

“No prompting, no friction. Just incredible results.”

As I mentioned back in January, Vividon offers new generative relighting tech that promises amazing realism & identity preservation:

Vividon places every relight on its own Photoshop layer. Adjust opacity, change blend modes, paint in or out exactly what you want, or remove it entirely. Your original always stays untouched.

Check out a 10s demo below, and visit their site for a more interactive preview:

And here’s a full 2-minute tour: