{"id":20664,"date":"2023-03-09T09:00:55","date_gmt":"2023-03-09T17:00:55","guid":{"rendered":"http:\/\/jnack.com\/blog\/?p=20664"},"modified":"2023-03-09T09:24:45","modified_gmt":"2023-03-09T17:24:45","slug":"stable-diffusion-can-draw-the-contents-of-your-brain","status":"publish","type":"post","link":"https:\/\/jnack.com\/blog\/2023\/03\/09\/stable-diffusion-can-draw-the-contents-of-your-brain\/","title":{"rendered":"Stable Diffusion can draw the contents of your brain"},"content":{"rendered":"\n<p><em>&#8220;It&#8217;s all in your head.&#8221; \u2014 Gorillaz<\/em><\/p>\n\n\n\n<p>I&#8217;ve spent the last ~year talking about my brain being &#8220;DALL\u2022E-pilled,&#8221; where I&#8217;ve started seeing just about everything (e.g. a <a href=\"https:\/\/twitter.com\/jnack\/status\/1633606830093107200?s=20\">weird truck<\/a>) as some kind of AI manifestation. But that&#8217;s nothing compared to using generative imaging models to literally <a href=\"https:\/\/www.pcgamer.com\/researchers-translate-brain-waves-into-scarily-accurate-images-using-stable-diffusion-ai\/\">see your thoughts<\/a>:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote\">\n<blockquote class=\"wp-block-quote\">\n<p>Researchers Yu Takagi and Shinji Nishimoto, from the Graduate School of Frontier Biosciences at Osaka University, recently wrote a paper outlining how it&#8217;s possible to\u00a0<a rel=\"noreferrer noopener\" href=\"https:\/\/www.biorxiv.org\/content\/10.1101\/2022.11.18.517004v2.full.pdf#page=9&amp;zoom=100,66,178\" target=\"_blank\">reconstruct high res images<\/a> (PDF) using latent diffusion models, by reading human brain activity gained from functional Magnetic Resonance Imaging (fMRI), &#8220;without the need for training or fine-tuning of complex deep generative models&#8221; (via\u00a0<a rel=\"noreferrer noopener\" href=\"https:\/\/www.vice.com\/en\/article\/wxje8n\/researchers-use-ai-to-generate-images-based-on-peoples-brain-activity?utm_source=tldrnewsletter\" target=\"_blank\">Vice<\/a>).<\/p>\n<\/blockquote>\n\n\n\n<figure class=\"wp-block-image size-large\"><a href=\"http:\/\/jnack.com\/blog\/wp-content\/uploads\/2023\/03\/HEED.webp\"><img decoding=\"async\" loading=\"lazy\" width=\"1024\" height=\"576\" src=\"http:\/\/jnack.com\/blog\/wp-content\/uploads\/2023\/03\/HEED-1024x576.webp\" alt=\"\" class=\"wp-image-20669\" srcset=\"https:\/\/jnack.com\/blog\/wp-content\/uploads\/2023\/03\/HEED-1024x576.webp 1024w, https:\/\/jnack.com\/blog\/wp-content\/uploads\/2023\/03\/HEED-300x169.webp 300w, https:\/\/jnack.com\/blog\/wp-content\/uploads\/2023\/03\/HEED-768x432.webp 768w, https:\/\/jnack.com\/blog\/wp-content\/uploads\/2023\/03\/HEED-1536x864.webp 1536w, https:\/\/jnack.com\/blog\/wp-content\/uploads\/2023\/03\/HEED.webp 1920w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/a><\/figure>\n<\/blockquote>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;It&#8217;s all in your head.&#8221; \u2014 Gorillaz I&#8217;ve spent the last ~year talking about my brain being &#8220;DALL\u2022E-pilled,&#8221; where I&#8217;ve started seeing just about everything (e.g. a weird truck) as some kind of AI manifestation. But that&#8217;s nothing compared to using generative imaging models to literally see your thoughts:<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[66],"tags":[],"_links":{"self":[{"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/20664"}],"collection":[{"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/comments?post=20664"}],"version-history":[{"count":5,"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/20664\/revisions"}],"predecessor-version":[{"id":20672,"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/20664\/revisions\/20672"}],"wp:attachment":[{"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/media?parent=20664"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/categories?post=20664"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/tags?post=20664"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}