What if speech impediments were no impediment to interacting with devices & making oneself understood? Google researchers (the crew behind the amazing Live Transcribe) have been working with folks affected by ALS, deafness, & other conditions to make their speech & even voice utterances work well with computers & other humans. Take a look:
Given my experience with my deaf son, who uses cochlear implants, lip-reading, and sign language to communicate with others, I can tell you that these apps—unlike certain misguided Microsoft accessibility efforts, like Cortana screeching during Windows Setup—address real-world problems that impact many, many people. And that they are, thus, both well-intentioned and truly useful. Bravo, Google.
We found that in general the new GPU backend performs 2–7x faster than the floating point CPU implementation for a wide range of diverse deep neural network models.
A preview release is available now, with a full open source release planned for the near future.
I often note that I came here five (five!) years ago to “Teach Google Photoshop,” and delivering tech like this is a key part of that mission: enable machines to perceive the world, and eventually to see like artists & be your brilliant artistic Assistant. We have so, so far to go, and the road ahead can be far from clear—but it sure is exciting.
“Please, please don’t come to Google and waste your time.”
I tell this to promising interview candidates. That is, I hope they come here, but it’s waaaaay too easy to fall into a velvet fog: you get free food, good money, something for your parents to brag about… but you wake up one day and realize that you’re polishing some goddamn stupid widget 9 levels deep in who-knows-what system, and you think, “Is this why I was put on earth?” This doesn’t have to happen, and indeed people often do amazing things instead—but it’s anything but guaranteed.
I always think of the amazing monologue in Walk The Line (starts around 1:30 in the clip below). If you had one song to sing before you’re dirt, are you telling me this would be it?
Wanna feel like walking directly into the ocean? Try painstakingly isolating an object in frame after frame of video. Learning how to do this in the 90’s (using stone knives & bear skins, naturally), I just as quickly learned that I never wanted to do it again. Thankfully tools like Rotobrush have come to After Effects, but like Quick Select in Photoshop, it was always pretty naive—never knowing what it was looking at.
Upon joining Google in 2014, I saw some amazing early demos of smarter techniques to isolate objects in video. While trying (unsuccessfully) to bring the tech to Google Photos, I kept hucking research paper links over the fence to my Adobe pals saying, “Just in case you’re not already looking into this—please get on it!” I always figured they were.
Smash cut to 2018. I finally get to work with those folks I met in 2014, bringing fast segmentation to Pixel 3 (powering selfie stickers, accelerating Portrait Mode) and beyond. Meanwhile Adobe is publishing their own research and showing how it might come soon (🤞) to After Effects. Check out this rad demo:
Meanwhile, if you want to try some of this hotness today, check out Select Subject—which is likely already in your copy of Photoshop!
“Like a meeting room that simply seeks to prolong the meeting”—so says writer Zeynep Tufekci of Facebook, YouTube, and other sites that seek to maximize their command of your attention. In this conversation with Sam Harris she explains, among other things…
how machine learning draws us towards the edges of discourse (because that’s simply what we’re most likely to click)
how political campaigns can (and now do) target specific people (e.g. black men in Philadelphia in 2016) in order to depress their votes
how marketers could detect a manic-depressive person’s manic upswing & comp him airline tickets to Vegas, knowing that he’s most vulnerable to blowing all his money
…and more. It’s fascinating, dark stuff that should give pause to all of us—especially those of us who merrily work to extract more & more insights into individuals, in order to better shape their behavior (for good, we swear…).
Sam Harris speaks with Zeynep Tufekci about “surveillance capitalism,” the Trump campaign’s use of Facebook, AI-enabled marketing, the health of the press, Wikileaks, ransomware attacks, and other topics.
“Take a human desire,” says Twitter co-founder Evan Williams, “preferably one that has been around for a really long time…Identify that desire and use modern technology to take out steps.”
It’s interesting to think about this as Instagram’s identity has evolved in a “lol nothing matters” Snapchat world. (I initially typed “Snapshat”; Freudian?). Founder Kevin Systrom used to like to describe the product as “a visual walkie talkie,” but plainly that wasn’t true. As their head of product Kevin Weil said, “It became a place where people kept raising the bar on themselves in terms of the quality of what they had to achieve to post. We didn’t want that.” If you haven’t yet, listen to the This American Life episode about teenage girls’ Instagram anxiety referenced in “The Instagram lobster trap.”
Anyway, Instagram has found that lowering the bar—creating an impermanent, low-stress complement to one’s highlight reel—is key. They need bottom-up activity to make things work:
“Your connections with your friends and your family are the thing that make Instagram work. All the data supports that if you follow more friends and engage with your friends, your activity goes through the roof. If you just follow more celebrity content or more interest-based content, that doesn’t move the needle at all.” – Kevin Systrom, Instagram co-founder
There are millions of people who will post beautiful pictures of coffee or 1960s office blocks, or like a photo by a celebrity, but there are billions who’ll share a snapshot of their lunch, beer, dog or child. Instagram is moving to capture that in the same way Messenger and WhatsApp captured chat.
“How come the Mac group produced Mac and the people at IBM produced the PCjr? We think the Mac will sell zillions, but we didn’t build Mac for anybody else. We built it for ourselves. We were the group of people who were going to judge whether it was great or not. We weren’t going to go out and do market research. We just wanted to build the best thing we could build.” — Steve Jobs, 1985
I know, I know: “You are not the user,” and “The truth is outside the building.” But as I counseled teammates today, if [productivity product X] isn’t addressing your personal, specific, Googler needs, figure out why & fix it. Pick a personal destination that’ll make you happier & more productive at work, then laser-burn your way to it.
Tap and hold the bookmark icon underneath any post to save it directly to a collection. You can create and name a new collection when you save a post, or you can add it to one you’ve already created.
Instagram continues to redefine creativity—away from strictly posting a few best shots, and towards:
tossed-off ephemera (stories) and
curation (a la Pinterest—drag the shiny-shiny back to decorate your cave).
This is going to be a license to print money: Let Kylie Jenner (or mouth-breathing celebretroid of one’s choice) create collections of merchandise that hang off the main profile & enable instant purchasing. Hopefully it’ll also benefit individual photographers, by offering a crazy-simple way to buy prints. Stay tuned.