{"id":8079,"date":"2019-01-16T11:07:24","date_gmt":"2019-01-16T19:07:24","guid":{"rendered":"http:\/\/jnack.com\/blog\/?p=8079"},"modified":"2019-01-16T11:56:45","modified_gmt":"2019-01-16T19:56:45","slug":"accelerate-machine-learning-through-new-tensorflow-lite-gpu","status":"publish","type":"post","link":"http:\/\/jnack.com\/blog\/2019\/01\/16\/accelerate-machine-learning-through-new-tensorflow-lite-gpu\/","title":{"rendered":"Accelerate machine learning through new TensorFlow Lite GPU"},"content":{"rendered":"<p>I\u2019m thrilled to say that the witchcraft my team has built &amp; used to deliver ML &amp; AR hotness on Pixel 3, YouTube, and beyond is <a href=\"https:\/\/medium.com\/tensorflow\/tensorflow-lite-now-faster-with-mobile-gpus-developer-preview-e15797e6dee7?linkId=62443226\">now available to iOS &amp; Android developers<\/a>:<\/p>\n<blockquote><p>For Portrait mode on Pixel 3, Tensorflow Lite GPU inference accelerates the&nbsp;<a href=\"https:\/\/ai.googleblog.com\/2017\/10\/portrait-mode-on-pixel-2-and-pixel-2-xl.html\">foreground-background segmentation model<\/a>&nbsp;by&nbsp;<strong>over 4x<\/strong>&nbsp;and the&nbsp;<a href=\"https:\/\/ai.googleblog.com\/2018\/11\/learning-to-predict-depth-on-pixel-3.html\">new depth estimation model<\/a>&nbsp;by&nbsp;over 10x&nbsp;vs. CPU inference with floating point precision. In&nbsp;<a href=\"https:\/\/youtube-creators.googleblog.com\/2018\/11\/introducing-more-ways-to-share-your.html\">YouTube Stories<\/a>&nbsp;and&nbsp;<a href=\"https:\/\/www.blog.google\/products\/google-ar-vr\/see-your-world-differently-playground-and-google-lens-pixel-3\/\">Playground Stickers<\/a>&nbsp;our&nbsp;real-time video segmentation model is sped up by 5\u201310x across a variety of phones.<\/p>\n<p>We found that in general the new GPU backend&nbsp;performs <strong>2\u20137x faster<\/strong>&nbsp;than the floating point CPU implementation for a wide range of diverse deep neural network models.<\/p><\/blockquote>\n<p>A preview release is available now, with a full open source release planned for the near future.<\/p>\n<p>I often note that I came here five <em>(five!)<\/em> years ago to \u201cTeach Google Photoshop,\u201d and delivering tech like this is a key part of that mission: enable machines to perceive the world, and eventually to see like artists &amp; be your brilliant artistic Assistant. We have so, so far to go, and the road ahead can be far from clear\u2014but it sure is exciting.<\/p>\n<p><img decoding=\"async\" src=\"https:\/\/cdn-images-1.medium.com\/max\/1600\/0*Bz70Bl42gW3PFnCV\"><\/p>\n","protected":false},"excerpt":{"rendered":"<p>I\u2019m thrilled to say that the witchcraft my team has built &amp; used to deliver ML &amp; AR hotness on Pixel 3, YouTube, and beyond is now available to iOS &amp; Android developers: For Portrait mode on Pixel 3, Tensorflow Lite GPU inference accelerates the&nbsp;foreground-background segmentation model&nbsp;by&nbsp;over 4x&nbsp;and the&nbsp;new depth estimation model&nbsp;by&nbsp;over 10x&nbsp;vs. CPU inference [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[14],"tags":[],"_links":{"self":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/8079"}],"collection":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/comments?post=8079"}],"version-history":[{"count":2,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/8079\/revisions"}],"predecessor-version":[{"id":8081,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/8079\/revisions\/8081"}],"wp:attachment":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/media?parent=8079"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/categories?post=8079"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/tags?post=8079"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}