Category Archives: Mobile

Google introduces Flutter, a cross-platform UX library

Check it out:

As Ars Technica explains,

Flutter apps don’t directly compile to native Android and iOS apps; they run on the Flutter rendering engine (written in C++) and Flutter Framework (written in Dart, just like Flutter apps), both of which get bundled up with every app, and then the SDK spits out a package that’s ready to go on each platform. You get your app, a new engine to run the Flutter code on, and enough native code to get the Flutter platform running on Android and iOS.

Also, I’m totally creating a band called Stateful Hot Reload. 🙂

NewImage

[YouTube]

Microsoft’s 3D Soundscape app helps blind users navigate the world

Augment all the humans! Check out this new perceptual enhancement:

The app, Soundscape, calls out roads and landmarks as they’re passed, and lets users set audio beacons at familiar destinations. If at any time you’re unsure of where you are, or which direction to head in, you can simply hold the phone flat in your hand and use the buttons on the bottom of the screen to locate nearby roads and familiar destinations.

NewImage

[YouTube]

Audi’s AR app lets you draw a racetrack in your living room

This app (sadly unavailable in the US, it seems) looks really creative & fun:

“To achieve a seamless transition from the TV ad to Augmented Reality we use computer vision to detect the quattro coaster TV ad. Then, we sync and position the augmented content on the screen. What’s interesting is that the car remains in the room even after the ad has ended. [more]

Here’s what it looks like in action:

NewImage

NewImage

[YouTube] [Vimeo]

Motion Stills gains a fun new AR mode on Android

Hooray! My first real project to ship since joining my new team is here:

Today, we are excited to announce the new Augmented Reality (AR) mode in Motion Stills for Android. With the new AR mode, a user simply touches the viewfinder to place fun, virtual 3D objects on static or moving horizontal surfaces (e.g. tables, floors, or hands), allowing them to seamlessly interact with a dynamic real-world environment. You can also record and share the clips as GIFs and videos. 

NewImage

For the nerdier among us, we’ve put together a Research blog post about The Instant Motion Tracking Behind Motion Stills AR, and on CNET Stephen Shankland gives a nice overview (and has been tweeting out some fun animations):

The Motion Stills app can put AR stickers into any Android device with a gyroscope, which is nothing special these days.

I’ve long been a longtime fan of Motion Stills, posting about it for years. I’m so glad to get to work with these guys now. There’s more good stuff to come, so please us know what you think!

(BTW, the 3D models are among the many thousands you can download for free from poly.google.com.)

Try three new experimental photo apps from Google

I’m excited for my teammates & their new launches. The team writes,

  • Storyboard (Android) transforms your videos into single-page comic layouts, entirely on device. Simply shoot a video and load it in Storyboard. The app automatically selects interesting video frames, lays them out, and applies one of six visual styles.
  • Selfissimo! (iOS, Android) is an automated selfie photographer that snaps a stylish black and white photo each time you pose. Tap the screen to start a photoshoot. The app encourages you to pose and captures a photo whenever you stop moving.
  • Scrubbies (iOS) lets you easily manipulate the speed and direction of video playback to produce delightful video loops… Shoot a video in the app and then remix it by scratching it like a DJ. Scrubbing with one finger plays the video. Scrubbing with two fingers captures the playback so you can save or share it.

Please take ‘em for a spin, then tell us what you think using the in-app feedback links. 

NewImage

My new team’s new page: Check out Google Machine Perception

“So, what would you say you… do here?” Well, I get to hang around these folks and try to variously augment your reality:

Research in Machine Perception tackles the hard problems of understanding images, sounds, music and video, as well as providing more powerful tools for image capture, compression, processing, creative expression, and augmented reality.

Our technology powers products across Alphabet, including image understanding in Search and Google Photos, camera enhancements for the Pixel Phone, handwriting interfaces for Android, optical character recognition for Google Drive, video understanding and summarization for YouTube, Google Cloud, Google Photos and Nest, as well as mobile apps including Motion Stills, PhotoScan and Allo.

We actively contribute to the open source and research communities. Our pioneering deep learning advances, such as Inception and Batch Normalization, are available in TensorFlow. Further, we have released several large-scale datasets for machine learning, including: AudioSet (audio event detection); AVA (human action understanding in video); Open Images (image classification and object detection); and YouTube-8M (video labeling).


NewImage

[Via Peyman Milanfar]

New for kids: Google Science Journal

I’m eager to try this out with our lads:

We’ve redesigned Science Journal as a digital science notebook, and it’s available today on Android and iOS.

With this new version of Science Journal, each experiment is a blank page that you can fill with notes and photos as you observe the world around you. Over time, we’ll be adding new note-taking tools… We’ve added three new sensors for you to play with along with the ability to take a ”snapshot” of your sensor data at a single moment in time.

NewImage

[Via]