{"id":22014,"date":"2024-07-06T11:11:32","date_gmt":"2024-07-06T18:11:32","guid":{"rendered":"http:\/\/jnack.com\/blog\/?p=22014"},"modified":"2024-07-06T11:11:32","modified_gmt":"2024-07-06T18:11:32","slug":"magic-insert-promises-stylistically-harmonized-compositing","status":"publish","type":"post","link":"http:\/\/jnack.com\/blog\/2024\/07\/06\/magic-insert-promises-stylistically-harmonized-compositing\/","title":{"rendered":"Magic Insert promises stylistically harmonized compositing"},"content":{"rendered":"\n<p><a href=\"https:\/\/magicinsert.github.io\/\">New tech from my old Google teammates<\/a> makes some exciting claims:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote\">\n<p>Using Magic Insert we are, for the first time, able to drag-and-drop a subject from an image with an arbitrary style onto another target image with a vastly different style and achieve a style-aware and realistic insertion of the subject into the target image.<\/p>\n<\/blockquote>\n\n\n\n<p><\/p>\n\n\n<blockquote class=\"twitter-tweet\">\n<p dir=\"ltr\" lang=\"en\">Here is a demo that you can access on the desktop version of the website. We&#8217;re excited by the options Magic Insert opens up for artistic creation, content creation and for the overall expansion of GenAI controllability. <a href=\"https:\/\/t.co\/HhbfrEfXZH\">pic.twitter.com\/HhbfrEfXZH<\/a><\/p>\n<p>\u2014 Nataniel Ruiz (@natanielruizg) <a href=\"https:\/\/twitter.com\/natanielruizg\/status\/1808524803223015580?ref_src=twsrc%5Etfw\">July 3, 2024<\/a><\/p>\n<\/blockquote>\n<p><script async=\"\" src=\"https:\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><\/p>\n\n\n<p>Of course, much of the challenge here\u2014where art meets science\u2014is around identity preservation: to what extent can &amp; should the output resemble the input? Here it&#8217;s subject to some interpretation. In other applications one wants an exact copy of a given person or thing, but optionally transformed in just certain ways (e.g. pose &amp; lighting).<\/p>\n\n\n\n<p>When we launched Firefly last year, we showed off some of Adobe&#8217;s then-new <a href=\"https:\/\/research.adobe.com\/publication\/objectstitch-generative-object-compositing\/\">ObjectStitch<\/a> tech for making realistic composites. It didn&#8217;t ship while I was there due to challenges around identity preservation. As far as I know those challenges remain only partially solved, so I&#8217;ll continue holding out hope\u2014as I have for probably 30 years now!\u2014for future tech breakthroughs that get us all the way across that line.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><a href=\"http:\/\/jnack.com\/blog\/wp-content\/uploads\/2024\/07\/Magic-Insert.jpeg\"><img decoding=\"async\" loading=\"lazy\" width=\"1024\" height=\"455\" src=\"http:\/\/jnack.com\/blog\/wp-content\/uploads\/2024\/07\/Magic-Insert-1024x455.jpeg\" alt=\"\" class=\"wp-image-22017\" srcset=\"http:\/\/jnack.com\/blog\/wp-content\/uploads\/2024\/07\/Magic-Insert-1024x455.jpeg 1024w, http:\/\/jnack.com\/blog\/wp-content\/uploads\/2024\/07\/Magic-Insert-300x133.jpeg 300w, http:\/\/jnack.com\/blog\/wp-content\/uploads\/2024\/07\/Magic-Insert-768x341.jpeg 768w, http:\/\/jnack.com\/blog\/wp-content\/uploads\/2024\/07\/Magic-Insert-1536x682.jpeg 1536w, http:\/\/jnack.com\/blog\/wp-content\/uploads\/2024\/07\/Magic-Insert-2048x909.jpeg 2048w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/a><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><a href=\"http:\/\/jnack.com\/blog\/wp-content\/uploads\/2024\/07\/Magic-Insert-2.jpeg\"><img decoding=\"async\" loading=\"lazy\" width=\"1024\" height=\"620\" src=\"http:\/\/jnack.com\/blog\/wp-content\/uploads\/2024\/07\/Magic-Insert-2-1024x620.jpeg\" alt=\"\" class=\"wp-image-22018\" srcset=\"http:\/\/jnack.com\/blog\/wp-content\/uploads\/2024\/07\/Magic-Insert-2-1024x620.jpeg 1024w, http:\/\/jnack.com\/blog\/wp-content\/uploads\/2024\/07\/Magic-Insert-2-300x182.jpeg 300w, http:\/\/jnack.com\/blog\/wp-content\/uploads\/2024\/07\/Magic-Insert-2-768x465.jpeg 768w, http:\/\/jnack.com\/blog\/wp-content\/uploads\/2024\/07\/Magic-Insert-2.jpeg 1200w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/a><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>New tech from my old Google teammates makes some exciting claims: Using Magic Insert we are, for the first time, able to drag-and-drop a subject from an image with an arbitrary style onto another target image with a vastly different style and achieve a style-aware and realistic insertion of the subject into the target image. [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"","sticky":false,"template":"","format":"standard","meta":[],"categories":[66],"tags":[],"_links":{"self":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/22014"}],"collection":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/comments?post=22014"}],"version-history":[{"count":5,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/22014\/revisions"}],"predecessor-version":[{"id":22023,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/22014\/revisions\/22023"}],"wp:attachment":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/media?parent=22014"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/categories?post=22014"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/tags?post=22014"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}