{"id":20138,"date":"2022-10-18T07:54:00","date_gmt":"2022-10-18T14:54:00","guid":{"rendered":"http:\/\/jnack.com\/blog\/?p=20138"},"modified":"2022-10-18T09:14:55","modified_gmt":"2022-10-18T16:14:55","slug":"imagic-text-based-editing-of-photos","status":"publish","type":"post","link":"https:\/\/jnack.com\/blog\/2022\/10\/18\/imagic-text-based-editing-of-photos\/","title":{"rendered":"&#8220;Imagic&#8221;: Text-based editing of photos"},"content":{"rendered":"\n<p>It seems almost too good to be true, but Google Researchers &amp; their university collaborators have unveiled <a href=\"https:\/\/arxiv.org\/abs\/2210.09276\">a way to edit images using just text<\/a>:<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><a href=\"http:\/\/jnack.com\/blog\/wp-content\/uploads\/2022\/10\/i1.jpg\"><img decoding=\"async\" loading=\"lazy\" width=\"447\" height=\"554\" src=\"http:\/\/jnack.com\/blog\/wp-content\/uploads\/2022\/10\/i1.jpg\" alt=\"\" class=\"wp-image-20139\" srcset=\"https:\/\/jnack.com\/blog\/wp-content\/uploads\/2022\/10\/i1.jpg 447w, https:\/\/jnack.com\/blog\/wp-content\/uploads\/2022\/10\/i1-242x300.jpg 242w\" sizes=\"(max-width: 447px) 100vw, 447px\" \/><\/a><\/figure>\n\n\n\n<blockquote class=\"wp-block-quote\"><p>In this paper we demonstrate, for the very first time, the ability to apply complex (e.g., non-rigid) text-guided semantic edits to a single real image. For example, we can change the posture and composition of one or multiple objects inside an image, while preserving its original characteristics. Our method can make a standing dog sit down or jump, cause a bird to spread its wings, etc. &#8212; each within its single high-resolution natural image provided by the user.<\/p><\/blockquote>\n\n\n\n<figure class=\"wp-block-image size-full\"><a href=\"http:\/\/jnack.com\/blog\/wp-content\/uploads\/2022\/10\/i2.jpg\"><img decoding=\"async\" loading=\"lazy\" width=\"433\" height=\"573\" src=\"http:\/\/jnack.com\/blog\/wp-content\/uploads\/2022\/10\/i2.jpg\" alt=\"\" class=\"wp-image-20140\" srcset=\"https:\/\/jnack.com\/blog\/wp-content\/uploads\/2022\/10\/i2.jpg 433w, https:\/\/jnack.com\/blog\/wp-content\/uploads\/2022\/10\/i2-227x300.jpg 227w\" sizes=\"(max-width: 433px) 100vw, 433px\" \/><\/a><\/figure>\n\n\n\n<blockquote class=\"wp-block-quote\"><p>Contrary to previous work, our proposed method requires only a single input image and a target text (the desired edit). It operates on real images, and does not require any additional inputs (such as image masks or additional views of the object).<\/p><\/blockquote>\n\n\n\n<figure class=\"wp-block-image size-full\"><a href=\"http:\/\/jnack.com\/blog\/wp-content\/uploads\/2022\/10\/i3.jpg\"><img decoding=\"async\" loading=\"lazy\" width=\"451\" height=\"581\" src=\"http:\/\/jnack.com\/blog\/wp-content\/uploads\/2022\/10\/i3.jpg\" alt=\"\" class=\"wp-image-20141\" srcset=\"https:\/\/jnack.com\/blog\/wp-content\/uploads\/2022\/10\/i3.jpg 451w, https:\/\/jnack.com\/blog\/wp-content\/uploads\/2022\/10\/i3-233x300.jpg 233w\" sizes=\"(max-width: 451px) 100vw, 451px\" \/><\/a><\/figure>\n\n\n\n<p>I can&#8217;t wait to see it in action!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>It seems almost too good to be true, but Google Researchers &amp; their university collaborators have unveiled a way to edit images using just text: In this paper we demonstrate, for the very first time, the ability to apply complex (e.g., non-rigid) text-guided semantic edits to a single real image. For example, we can change [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[66,3],"tags":[],"_links":{"self":[{"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/20138"}],"collection":[{"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/comments?post=20138"}],"version-history":[{"count":3,"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/20138\/revisions"}],"predecessor-version":[{"id":20147,"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/20138\/revisions\/20147"}],"wp:attachment":[{"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/media?parent=20138"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/categories?post=20138"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/tags?post=20138"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}