Category Archives: Photography

Photoshop’s new Smart Portrait is pretty amazing

My longstanding dream (dating back to the Bush Administration!) to have face relighting in Photoshop has finally come true—and then some. In case you missed it last week, check out Conan O’Brien meeting machine learning via Photoshop:

On PetaPixel, Allen Murabayashi from PhotoShelter shows what it can do on a portrait of Joe Biden—presenting this power as a potential cautionary tale:

Here’s a more in-depth look (starting around 1:46) at controlling the feature, courtesy of NVIDIA, whose StyleGAN tech powers the feature:

I love the fact that the Neural Filters plug-in provides a playground within Photoshop for integrating experimental new tech. Who knows what else might spring from Adobe-NVIDIA collaboration—maybe scribbling to create a realistic landscape, or even swapping expressions among pets (!?):

Photoshop’s Sky Replacement feature was well worth the wait

Although I haven’t yet gotten to use it extensively, I’m really enjoying the newly arrived Sky Replacement feature in Photoshop. Check out a quick before/after on a tiny planet image:

Eye-popping portraits emerge as paint cascades down the human face

Man, these are stunning—and they’re all done in camera:

First coated in black, the anonymous subjects in Tim Tadder’s portraits are cloaked with hypnotic swirls and thick drips of bright paint. To create the mesmerizing images, the Encinitas, California-based photographer and artist pours a mix of colors over his sitters and snaps a precisely-timed shot to capture each drop as it runs down their necks or splashes from their chins.

You can find more of the artist’s work on Behance and Instagram.

Photographic downfall: “Tsunami from Heaven”

This is lovely—especially from a safe, dry distance:

PetaPixel writes,

A couple of years ago, adventure photographer and Visit Austria creator Peter Maier captured a stunning rainstorm timelapse titled ‘Tsunami from Heaven’… It was captured from the Alpengasthof Bergfried hotel in Carinthia, Austria, and shows a sudden cloudburst (AKA microburst or downburst) soaking an area around Lake Millstatt

Google & researchers demo AI-powered shadow removal

Speaking of Google photography research (see previous post about portrait relighting), I’ve been meaning to point to the team’s collaboration with MIT & Berkeley. As PetaPixel writes,

The tech itself relies on not one, but two neural networks: one to remove “foreign” shadows that are cast by unwanted objects like a hat or a hand held up to block the sun in your eyes, and the other to soften natural facial shadows and add “a synthetic fill light” to improve the lighting ratio once the unwanted shadows have been removed.

Here’s a nice summary from Two-Minute Papers:

https://youtu.be/qeZMKgKJLX4

Interactive Portrait Light comes to Google Photos on Pixel; editor gets upgraded

I have been waiting, I kid you not, since the Bush Administration to have an easy way to adjust lighting on faces. I just didn’t expect it to appear on my telephone before it showed up in Photoshop, but ¯\_(ツ)_/¯. Anyway, check out what you can now do on Pixel 4 & 5 devices:

This feature arrives, as PetaPixel notes, as one of several new Suggestions:

Nestled into a new ‘Suggestions’ tab that shows up first in the Photos editor, the options displayed there “[use] machine learning to give you suggestions that are tailored to the specific photo you’re editing.” For now, this only includes three options—Color Pop, Black & White, and Enhance—but more suggestions will be added “in the coming months” to deal specifically with portraits, landscapes, sunsets, and beyond.

Lastly, the photo editor overall has gotten its first major reorganization since we launched it in 2015:

Facebook improves rights management for photographers

Seems like a win:

With the newly launched “Rights Manager for Images,” Facebook is offering creators and publishers access to content-matching technology similar to what it introduced in 2016 to combat stolen videos. The new feature, which is available in Facebook’s Creator Studio, will allow rights owners to assert control over their intellectual property across Facebook and Instagram, including when the image is embedded on an external website.

Photography: Insects lift off at 3,200fps

Hats off—and wings up—to Prof. Adrian Smith & team from NC State:

[They] utilized a black light to attract unusual insects, like a plume moth, eastern firefly, and a rosy maple moth that, as Smith notes, resembles “a flying muppet.” He then recorded the creatures’ flight maneuvers at 3,200 fps to capture their unique wing movements, which he explains during each step. 

Let your freaky proboscises fly:

[Via]

Canon enables easy WiFi backup to Google Photos

“Eh, who’s gonna care about that—10 million people? Thbbbt!” — an ex-Adobe colleague at Apple in 2011 when I asked for better camera->device->cloud integration.

I’ve remarked before on my saltiness at our whole industry’s rather, er, sedate pace in enabling slicker integration between dedicated cameras & cloud backup/editing, so I’m really happy to see Canon & Google collaborating to automate camera->cloud transfer:

The team writes,

With the latest version of the image.canon app (available on Android or iOS) and a compatible Canon camera, you can choose to automatically transfer original quality photos to Google Photos, eliminating the hassle of using your computer or phone to back them up.

In addition to a compatible Canon camera and the image.canon app, you’ll also need a Google One membership to use this feature. To help get started, Canon users will get one month of Google One free, providing access to up to 100 GB of cloud storage, as well as other member benefits, such as premium support from Google experts and family sharing.

Colorized 1902 footage of a German “flying train”

I’m not sure what’s most bonkers: the existence of this vehicle at the turn of the last century; its continued existence & operation ~120 years and two world wars later; or the advances in machine learning that allow this level of film restoration & enhancement:

Denis Shiryaev of Neural Love then took the original footage and used a neural network to upscale it to 4K. He also colorized it, stabilized it, slowed it down to better represent real-time, and boosted the frame rate to 60fps.

Check out the results:

[Via]

Google Images is testing a “Licensable” badge to help photographers

I have no inside info on this one, but it sounds like a positive development. PetaPixel writes,

Google Images is continuing to make changes that benefit photographers. The image search engine is testing a new “Licensable” badge that aims to help photographers sell their photos through search results. […]

By specifying licensing information for the photos on your website, Google will automatically add a new “Licensable” badge to the photo’s thumbnail whenever it shows up in Google Images results. The badge tells viewers that license information is available for the photo.

Check out this post from PhotoShelter’s founder, who seems enthusiastic, for many details.

TP superstar, that is what you are…

Fond memories of my childhood attempts to string up bed sheets to make ski slopes for my Lego guys came rushing back as I saw the miniature work of Tatsua Tanaka. As PetaPixel writes,

Tatsuya Tanaka is a master of turning everyday objects into miniature worlds that seem larger than life. He’s been doing it daily for almost a decade, and in the midst of the COVID pandemic, he’s started to integrate some all-too-familiar objects into his work.

We first featured Tanaka’s impressive dioramas six years ago, and believe it or not, he hasn’t stopped. Every day since April 2011 he’s created a new miniature world by pairing high-quality human figurines with everyday objects arranged into fun and creative scenes.

Boris FX comes to Photoshop & Lightroom

The tools for drawing out lighting strikes & lens flares look really fun. Of the whole suite PetaPixel writes,

Optics is described as “the definitive digital toolbox for photos,” but what it offers is maybe better described as a comprehensive mishmash of filters, presets, lighting effects and lens flares… with some masking technology thrown in for good measure. It’s honestly hard to tell what Optics is primarily meant to do, because it does so much.

Here, check it out:

If you’re curious and want to try out Optics, you can learn more about the plugin and/or download a free trial on the Boris FX website. And if you actually want to buy a copy for yourself, you can purchase a permanent license for $149, an annual subscription for $99, or a monthly subscription for $9.

On YouTube the company notes, “25% off permanent licenses and subscription options. Use coupon code: optics25.”

Amazing editing in Nike’s new ad

Masterful match-cuts; moving message.

Muse writes,

The W+K team—working with Pulse Films director Oscar Hudson, Joint editors Peter Wiedensmith and Jessica Baclesse, and the visual effects team at A52—researched 4,000 sports action sequences and chose 72 of them to combine into 36 split-screen moments, where the action on both sides appears to meld into one.

Nike’s not alone in leaning into juxtaposition in a time of ‘rona: check out this fun, cheeky campaign for German rail travel, built in part using an algorithm that searches for visual similarities:

[Via Peyman Milanfar & Mogan Shieh]

Cinematography: “Predator” scene breakdown

I really enjoy being taken inside the craft of visual storytelling, so I dug this step-by-step narrative of the techniques used in & around Carl Weathers’ character’s death in Predator.

It’s especially interesting to contrast the sophistication on display with the cornball simplicity of Commando, a prototypical Ahnuld joint made just two years earlier. Now that my boys are getting just old enough to watch these flicks, we’re going back through the canon, making the quality uptick here all the more striking.

Now, lemme know if someone has documented the inside story of Bill Duke’s inspired “I’m gonna have me some fun” freak-out. Meanwhile, here he is representin’ on our fam’s last Yosemite trip.

Spinning back up

The fam & have safely returned to scintillating (🙄😌) San Jose, tired & happy from our two-week sojourn around the American Southwest. I hope to get back to sharing interesting bits here soon. Meanwhile, here’s a fun little bullet time vid I made in Arches National Park using my indispensible Insta360 One X:

 

 
 
 
 
 
View this post on Instagram
 
 
 
 
 
 
 
 
 

 

Chillin’ like an arch villain

A post shared by John Nack (@jnack) on

A one-man aerial Street View

I’m wildly impressed & inspired by what a single (albeit highly dedicated) person and his flying camera can do. PetaPixel writes,

Reuben Pillay is a drone enthusiast living on Mauritius, the island nation 1,200 miles southeast off the African continent. He has spent over a year and a half working single-handedly on a project called ReubsVision — it’s essentially like an aerial Google Street View of the island’s entire coastline (and more).

So, Pillay spent 18 months traveling all over the 790-square-mile island with his DJI Phantom 4 Pro camera drone… Pillay has since created over 220 ultra-high-resolution 360° photos that cover the entire Mauritius coastline.

Road tripping with Night Sight

When Google debuted Night Sight mode on the Pixel 3, I was blown away at how well it worked compared to my iPhone X & even my DSLR. In the time since then, Apple has greatly stepped up its game, but I still find Night Sight (now on Pixel 4) to be unmatched for low-light imaging.

Having test-driven Pixel 3 at light artist Bruce Munro’s installation in Saratoga (gallery), I was excited to visit his new work, Sensorio, in Paso Robles. Happily both the installation and the Pixel 4 dazzled. You can check out some results here:

Camera Raw gets a facelift

To my slight chagrin—having been a naysayer about turning Camera Raw into a filter one can use in Photoshop, on the grounds that doing so would be a crutch at a time when Adobe should do the hard work of revamping a motley set of disparate, 30-year-old adjustment dialogs—I find myself hitting Shift-Cmd-A all the damn time. Thus I’m glad to see the UI freshened up & tools made easier to access:

As for getting the rest of the adjustments-house in order, I wasn’t wrong, but ACR-in-PS gives me fewer reasons to care. On we go!

Photography: “Black Ice”

Constraint -> Creativity. Christopher Dormoy writes,

Having to stay home does not mean less creation. It is time to observe and experience elements and details of our daily life that we find at home.

I wanted to play with ice, flower and ink and see what kind of universe I can created with the macro and motion timelapse technique. I spent many hours to observe and experiment the ice and how it react with liquids like ink but also, oil, paint and soap. Some effects are hypnotic and surprising.

“Stare. It is the way to educate your eye, and more. Stare, pry, listen, eavesdrop. Die knowing something. You are not here long.” ― Walker Evans.

[Via]

The Nik Collection returns, adds new features

I’m very pleased to see that after happily finding a new post-Google home with DxO, the Nik Collection has hit version 3.0, offering non-destructive editing, perspective correction, and more.

Among the notable changes:

By taking advantage of the TIFF MULTIPAGE file format, the plugin suite is able to combine “the input image, the saved Nik editing parameters, and the output file” into a single file. DxO claims this as a “first” for a suite of creative photo plugins, resulting in “unparalleled versatility.”

As for pricing & availability:

The Nik Collection 3 was launched early this morning and is available to purchase right away for a “special introductory price” of $100 for new users, or $60 for upgrades. Come July 1st, the collection will go back up to its MSRP of $150 for new users or $80 for upgrades.

You can download the trial version here.

Spinning my world

As society whirls around us, I take a certain kind of comfort in seeing the planet keep whirling as well.

Colossal writes,

With a camera peering out over the landscape of Tivoli, Namibia, Bartosz Wojczyński focused on the sky. The Polish photographer created a hypnotic timelapse spanning 24 hours that has a focal point in the atmosphere rather than on the land. Each minute, he snapped a frame that subsequently was looped 60 times to create the final 24-minute version that’s a mesmerizing look at Earth’s cycles.

Photography: “Night Light”

Arthur Cauty has created an interesting “exercise in light painting and parallax displacement to create the illusion of 3D (or 2.5D) and motion in a series of still photographs captured after nightfall.”

This film is comprised entirely of still images. All motion achieved in post production. The only time lapse shots are the star trails. All other shots are typically comprised of between 3 and 5 exposures of the same subject, but with different lighting in each, then blended together or transitioned between to give the effect of seamless motion.

Fly inside a Monarch swarm in tiny drone disguised as a hummingbird

Days of Miracles and Wonder, part 3,293… 😳🚁🦋

Kottke writes,

For an upcoming episode of a show called Spy in the Wild, PBS’s Nature used a tiny drone disguised as a hummingbird to capture footage of a swarm of half a billion monarch butterflies as they overwinter in Mexico.

And of course I can’t let butterfly footage go by without gratuitously showing one of my favorite kid videos ever, captured of my then- (and now-) mysterious son Henry at age 2:

[Via]

A lovely “Social Distance”

I imagine you’re as fatigued by all this stuff as I am—but honestly this piece is really touching & beautifully composed.

Spanning more than 30 countries, the film includes a breadth of perspectives, from a 93-year old Malayan grandmother to a 19-year old Slovenian man, and includes an original score that was remotely performed by musicians from around the world.

[Via]

Free Lightroom online seminar, Friday at noon Pacific

Join my old friends & colleagues Phil Clevenger & Rick Miller tomorrow for what promises to be an informative online class/discussion. Topics include:

  • Quick history of the Lightroom UI and its influence on modern software design
  • The importance of choosing the right color space when editing your photos.
  • Creating custom camera profiles for your DSLR, cellphone, and drone cameras to achieve the best color fidelity.
  • The RAW advantage: recovering data from overexposed/underexposed images.
  • Using the Map module and GPS coordinates for location scouting.
  • Soft Proofing your photos to determine the most appropriate print color settings
  • Questions & Answers

UntitledImage

About your hosts:
Phil Clevenger:
Senior Director, Experience Design, Adobe Experience Cloud. Original UI designer for Adobe Lightroom and author on two patents for UI innovations in the Lightroom 1.0 interface.

Rick Miller:
Former Sr. Solutions Engineer/color management expert at Adobe Systems (Rick’s name appeared on the credit screens for Photoshop and Premiere Pro), Professional photographer, and currently a professor at USC. Rick previously taught at the Art Center College of Design in Pasadena, Cal Poly Pomona University, and assisted the LAPD’s Scientific Investigation Division in the forensic application of Photoshop.

Free streaming classes on photography, 3D

It’s really cool to see companies stepping up to help creative people make the most of our forced downtime. PetaPixel writes,

If you’re a photographer stuck at home due to the coronavirus pandemic, Professional Photographers of America (PPA) has got your back. The trade association has made all of its 1,100+ online photography classes free for the next two weeks. […]

You can spend some of your lockdown days learning everything from how to make money in wedding photography to developing a target audience to printing in house.

UntitledImage

Meanwhile Unity is opening up their Learn Premium curricula:

During the COVID-19 crisis, we’re committed to supporting the community with complimentary access to Unity Learn Premium for three months (March 19 through June 20). Get exclusive access to Unity experts, live interactive sessions, on-demand learning resources, and more.

UntitledImage

“NeRF” promises amazing 3D capture

“This is certainly the coolest thing I’ve ever worked on, and it might be one of the coolest things I’ve ever seen.”

My Google Research colleague Jon Barron routinely makes amazing stuff, so when he gets a little breathless about a project, you know it’s something special. I’ll pass the mic to him to explain their new work around capturing multiple photos, then synthesizing a 3D model:

I’ve been collaborating with Berkeley for the last few months and we seem to have cracked neural rendering. You just train a boring (non-convolutional) neural network with five inputs (xyz position and viewing angle) and four outputs (RGB+alpha), combine it with the fundamentals of volume rendering, and get an absurdly simple algorithm that beats the state of the art in neural rendering / view synthesis by *miles*.

You can change the camera angle, change the lighting, insert objects, extract depth maps — pretty much anything you would do with a CGI model, and the renderings are basically photorealistic. It’s so simple that you can implement the entire algorithm in a few dozen lines of TensorFlow.

Check it out in action:

[YouTube]

“Virus” tintype animation

TBH the last thing I want is for coronavirus talk to infect (ahem) my escapist art-posting, but I’ve gotta give Markus Hofstätter props for the sheer effort he put into making this 7-frame animation with archaic tintype printing (or as my wife asked, lacking all context, “Why did that dude put a picture into a panini press?”). You can watch his process from the beginning (and check out PetaPixel for the full story), or just jump to the finished animation at the end:

UntitledImage

[YouTube]

Google AI helps upscale “Lunar Rover Grand Prix” to 4K and 60fps

So cool! I’d never actually watched these Apollo 16 clips on their own, unedited & with original dialog intact.

PetaPixel writes,

For this particular project, Shiryaev used the stabilized version of the footage that NASA itself released in July of 2019 as a baseline. He then fed it through the same AI software that he’s been using to upscale all of the videos he’s released: Google’s DAIN interpolate frames and achieve 60fps, and Topaz Labs’ Gigapixel AI to upscale each frame and achieve 4K resolution. 

More about the mission from NASA:

[YouTube 1 & 2]

Quick Comparison: Pixel 4 vs. iPhone 11 at Night

[Please note: I don’t work on the Pixel team, and these opinions are just those of a guy with a couple of phones in hand, literally shooting in the dark.]

In Yosemite Valley on Friday night, I did some quick & unscientific but illuminating (oh jeez) tests shooting with a Pixel 4 & iPhone 11 Pro Max. I’d had fleeting notions of trying some proper astrophotography (side note: see these great tips from Pixel engineer & ILM vet Florian Kainz), but between the moon & the clouds, I couldn’t see a ton of stars. Therefore I mostly held up both phones, pressed the shutter button, and held my breath.

Check out the results in this album. You can see which camera produced which images by tapping each image, then tapping the little comment icon. I haven’t applied any adjustments.

Overall I’m amazed at what both devices can produce, but overall I preferred the Pixel’s interpretations. They were darker, but truer to what my eyes perceived, and very unlike the otherworldly, day-for-night iPhone renderings (which persisted despite a few attempts I made to set focus, then drag down the exposure before shooting).

Check out the results, judge for yourself, and let me know what you think.

UntitledImage

Oh, and for a much more eye-popping Pixel 4 result, check out this post from Adobe’s Russell Brown: