{"id":14782,"date":"2021-05-16T16:50:28","date_gmt":"2021-05-16T23:50:28","guid":{"rendered":"http:\/\/jnack.com\/blog\/?p=14782"},"modified":"2021-05-16T16:54:51","modified_gmt":"2021-05-16T23:54:51","slug":"syncopated-ai-nightmare-fuel","status":"publish","type":"post","link":"http:\/\/jnack.com\/blog\/2021\/05\/16\/syncopated-ai-nightmare-fuel\/","title":{"rendered":"Syncopated AI nightmare fuel"},"content":{"rendered":"\n<p>I&#8217;ve obviously been talking a ton about the crazy-powerful, sometimes eerie StyleGAN2 technology. Here&#8217;s a case of  generative artist <a href=\"http:\/\/quasimondo.com\/\">Mario Klingemann<\/a> wiring visuals to characteristics of music:<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-4-3 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"StyleGAN2 - mapping music to facial expressions in real time\" width=\"604\" height=\"453\" src=\"https:\/\/www.youtube.com\/embed\/A6bo_mIOto0?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>Watch it at 1\/4 speed if you <em>really<\/em> want to freak yourself out.<\/p>\n\n\n\n<p>Beats-to-visuals gives me an excuse to dig up &amp; reshare Michel Gondry&#8217;s brilliant old Chemical Brothers video that associated elements like bridges, posts, and train cars with the various instruments at play:<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"The Chemical Brothers - Star Guitar (Official Music Video)\" width=\"604\" height=\"340\" src=\"https:\/\/www.youtube.com\/embed\/0S43IwBF0uM?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>Back to Mario: he&#8217;s also been making <a href=\"https:\/\/twitter.com\/quasimondo\/status\/1388525432992059396\/photo\/1\">weirdly bleak image descriptions<\/a> using CLIP (the same model we&#8217;ve explored using to generate faces via text). I congratulated him on making a robot sound like&nbsp;Werner&nbsp;Herzog.&nbsp;&#x1f643;<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><a href=\"http:\/\/jnack.com\/blog\/wp-content\/uploads\/2021\/05\/Mario-Werner.jpg\"><img decoding=\"async\" loading=\"lazy\" width=\"1024\" height=\"528\" src=\"http:\/\/jnack.com\/blog\/wp-content\/uploads\/2021\/05\/Mario-Werner-1024x528.jpg\" alt=\"\" class=\"wp-image-14805\" srcset=\"http:\/\/jnack.com\/blog\/wp-content\/uploads\/2021\/05\/Mario-Werner-1024x528.jpg 1024w, http:\/\/jnack.com\/blog\/wp-content\/uploads\/2021\/05\/Mario-Werner-300x155.jpg 300w, http:\/\/jnack.com\/blog\/wp-content\/uploads\/2021\/05\/Mario-Werner-768x396.jpg 768w, http:\/\/jnack.com\/blog\/wp-content\/uploads\/2021\/05\/Mario-Werner-1536x793.jpg 1536w, http:\/\/jnack.com\/blog\/wp-content\/uploads\/2021\/05\/Mario-Werner.jpg 1833w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/a><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>I&#8217;ve obviously been talking a ton about the crazy-powerful, sometimes eerie StyleGAN2 technology. Here&#8217;s a case of generative artist Mario Klingemann wiring visuals to characteristics of music: Watch it at 1\/4 speed if you really want to freak yourself out. Beats-to-visuals gives me an excuse to dig up &amp; reshare Michel Gondry&#8217;s brilliant old Chemical [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[66,2],"tags":[],"_links":{"self":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/14782"}],"collection":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/comments?post=14782"}],"version-history":[{"count":7,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/14782\/revisions"}],"predecessor-version":[{"id":14812,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/14782\/revisions\/14812"}],"wp:attachment":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/media?parent=14782"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/categories?post=14782"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/tags?post=14782"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}