{"id":4284,"date":"2016-08-09T22:26:58","date_gmt":"2016-08-10T05:26:58","guid":{"rendered":"http:\/\/jnack.com\/blog\/?p=4284"},"modified":"2016-08-09T22:26:58","modified_gmt":"2016-08-10T05:26:58","slug":"music-video-as-moving-painting","status":"publish","type":"post","link":"http:\/\/jnack.com\/blog\/2016\/08\/09\/music-video-as-moving-painting\/","title":{"rendered":"Music video as moving painting"},"content":{"rendered":"<p>Back in 2014, right after we\u2019d both joined Google, my friend Alex Powell (who used to lead animation tools at DreamWorks) and I did a lot of exploration of what it would mean to turn photos and videos into paintings. Some of that work paid off later in work like <a href=\"http:\/\/jnack.com\/blog\/2014\/10\/27\/come-get-a-halloween-makeover-from-google\/\">Halloweenify<\/a>\u00a0face painting.<\/p>\n<p>Now it\u2019s exciting to see how the industry has evolved, using machine learning to style images as paintings. Evidently the band Drive Like Maria is veeeery patient and dedicated to getting this result. PetaPixel <a href=\"http:\/\/petapixel.com\/2016\/08\/09\/music-video-transformed-moving-painting-one-frame-time\/\">writes<\/a>,<\/p>\n<blockquote>\n<p>\u201cWe figured that if we\u2019d process 600 pictures each (Bert, Bjorn, and myself) it would take about 5 hours per person to process everything at 30 seconds per picture,\u201d the band\u2019s guitarist Nitzan Hoffmann told us. \u201cBy the time we started processing the Android version of Prisma was also available so we could use iPhones and Android phones at the same time.\u201d<\/p>\n<p>Despite some issues transferring JPEGs to and from the phones while keeping them in some kind of order, they eventually managed to convert every frame\u2014all 1,828 of them\u2014into a \u201cpainting\u201d by hand before plugging them back into Premier Pro. A little bit of fiddling later, they had their music video!<\/p>\n<\/blockquote>\n<p>Check it out:<\/p>\n<p><iframe loading=\"lazy\" width=\"604\" height=\"340\" src=\"https:\/\/www.youtube.com\/embed\/XIfNcsnjXQw?feature=oembed\" frameborder=\"0\" allow=\"autoplay; encrypted-media\" allowfullscreen><\/iframe> \u2028<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" title=\"NewImage.png\" src=\"http:\/\/jnack.com\/blog\/wp-content\/uploads\/2016\/08\/INewImage-8.png\" alt=\"NewImage\" width=\"598\" height=\"314\" border=\"0\" \/><\/p>\n<p>[<a href=\"https:\/\/youtu.be\/XIfNcsnjXQw\">YouTube<\/a>]<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Back in 2014, right after we\u2019d both joined Google, my friend Alex Powell (who used to lead animation tools at DreamWorks) and I did a lot of exploration of what it would mean to turn photos and videos into paintings. Some of that work paid off later in work like Halloweenify\u00a0face painting. Now it\u2019s exciting [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[2],"tags":[],"_links":{"self":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/4284"}],"collection":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/comments?post=4284"}],"version-history":[{"count":1,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/4284\/revisions"}],"predecessor-version":[{"id":4285,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/4284\/revisions\/4285"}],"wp:attachment":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/media?parent=4284"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/categories?post=4284"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/tags?post=4284"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}