{"id":18606,"date":"2021-10-22T09:41:55","date_gmt":"2021-10-22T16:41:55","guid":{"rendered":"http:\/\/jnack.com\/blog\/?p=18606"},"modified":"2021-10-22T09:41:57","modified_gmt":"2021-10-22T16:41:57","slug":"dogs-cats-morphing-together-mass-hysteria","status":"publish","type":"post","link":"http:\/\/jnack.com\/blog\/2021\/10\/22\/dogs-cats-morphing-together-mass-hysteria\/","title":{"rendered":"&#8220;Dogs &#038; cats morphing together\u2014mass hysteria!&#8221;"},"content":{"rendered":"\n<p><em>It&#8217;s that thing where you wake up, see some exciting research, tab over to Slack to share it with your team\u2014and then notice that the work is from your teammates.<\/em> &#x1f61d;<\/p>\n\n\n\n<p>Check out <a href=\"https:\/\/arxiv.org\/abs\/2110.11323\">StyleAlign<\/a> from my teammate Eli Shechtman &amp; collaborators. Among other things, they&#8217;ve discovered interesting, useful correspondences in ML models for very different kinds of objects:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote\"><p>We find that the child model&#8217;s latent spaces are semantically aligned with those of the parent, inheriting incredibly rich semantics, even for distant data domains such as human faces and churches. Second, equipped with this better understanding, we leverage aligned models to solve a diverse set of tasks. In addition to image translation, we demonstrate fully automatic cross-domain image morphing<\/p><\/blockquote>\n\n\n\n<p>Here&#8217;s a little taste of what it enables:<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"StyleAlign: Analysis and Applications of Aligned StyleGAN Models\" width=\"604\" height=\"340\" src=\"https:\/\/www.youtube.com\/embed\/gjjo11IncP4?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>And to save you the trouble of looking up the afore-referenced Ghostbusters line, here ya go. &#x1f47b;<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Ghostbusters - Mass Hysteria\" width=\"604\" height=\"340\" src=\"https:\/\/www.youtube.com\/embed\/-9NMt42il4Q?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>It&#8217;s that thing where you wake up, see some exciting research, tab over to Slack to share it with your team\u2014and then notice that the work is from your teammates. &#x1f61d; Check out StyleAlign from my teammate Eli Shechtman &amp; collaborators. Among other things, they&#8217;ve discovered interesting, useful correspondences in ML models for very different [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[66],"tags":[],"_links":{"self":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/18606"}],"collection":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/comments?post=18606"}],"version-history":[{"count":1,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/18606\/revisions"}],"predecessor-version":[{"id":18607,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/18606\/revisions\/18607"}],"wp:attachment":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/media?parent=18606"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/categories?post=18606"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/tags?post=18606"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}