{"id":20294,"date":"2022-11-20T20:27:46","date_gmt":"2022-11-21T04:27:46","guid":{"rendered":"http:\/\/jnack.com\/blog\/?p=20294"},"modified":"2023-02-13T09:44:11","modified_gmt":"2023-02-13T17:44:11","slug":"neural-jnack-has-entered-the-chat-%f0%9f%a4%96","status":"publish","type":"post","link":"http:\/\/jnack.com\/blog\/2022\/11\/20\/neural-jnack-has-entered-the-chat-%f0%9f%a4%96\/","title":{"rendered":"Neural JNack has entered the chat&#8230; &#x1f916;"},"content":{"rendered":"\n<p><a href=\"http:\/\/jnack.com\/blog\/2021\/02\/10\/3d-dronie\/\">Last year<\/a> my friend Bilawal Singh Sidhu, a PM driving 3D experiences for Google Maps\/Earth, created an amazing 3D render (also available in <a href=\"https:\/\/skfb.ly\/oAyvH\">galactic core form<\/a>) of me sitting atop the Trona Pinnacles. At that time he used &#8220;traditional&#8221; photogrammetry techniques (kind of a funny thing to say about an emerging field that remains new to the world), and this year he tried processing the same footage (comprised of a couple simple orbits from my drone) using new Neural Radiance Field (&#8220;NeRF&#8221;) tech:<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-rich is-provider-twitter wp-block-embed-twitter\"><div class=\"wp-block-embed__wrapper\">\n<blockquote class=\"twitter-tweet\" data-width=\"550\" data-dnt=\"true\"><p lang=\"en\" dir=\"ltr\">When you can&#39;t decide between <a href=\"https:\/\/twitter.com\/hashtag\/NeRF?src=hash&amp;ref_src=twsrc%5Etfw\">#NeRF<\/a> or <a href=\"https:\/\/twitter.com\/hashtag\/Photogrammetry?src=hash&amp;ref_src=twsrc%5Etfw\">#Photogrammetry<\/a> &#8211; just do both! Here&#39;s a <a href=\"https:\/\/twitter.com\/jnack?ref_src=twsrc%5Etfw\">@jnack<\/a> dronie trained with <a href=\"https:\/\/twitter.com\/LumaLabsAI?ref_src=twsrc%5Etfw\">@LumaLabsAI<\/a>. Compare it to the photogrammetry model generated with <a href=\"https:\/\/twitter.com\/RealityCapture_?ref_src=twsrc%5Etfw\">@RealityCapture_<\/a> here: <a href=\"https:\/\/t.co\/XyL2n6yERa\">https:\/\/t.co\/XyL2n6yERa<\/a> <a href=\"https:\/\/t.co\/kSlXYpxNcK\">pic.twitter.com\/kSlXYpxNcK<\/a><\/p>&mdash; Bilawal &quot;Billyfx&quot; Sidhu (@bilawalsidhu) <a href=\"https:\/\/twitter.com\/bilawalsidhu\/status\/1594117492661579778?ref_src=twsrc%5Etfw\">November 19, 2022<\/a><\/blockquote><script async src=\"https:\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script>\n<\/div><\/figure>\n\n\n<p>For comparison, here&#8217;s the 3D model generated via the photogrammetry approach:<\/p>\n<div class=\"sketchfab-embed-wrapper\"><iframe loading=\"lazy\" title=\"A 3D model\" src=\"https:\/\/sketchfab.com\/models\/b4a060f5b7dc4177b61cc277ed14f977\/embed?autospin=0.2&amp;autostart=0&amp;ui_controls=1&amp;ui_infos=1&amp;ui_inspector=1&amp;ui_stop=1&amp;ui_watermark=1&amp;ui_watermark_link=1\" width=\"640\" height=\"480\" frameborder=\"0\"><\/iframe>\n<p>\u00a0<\/p>\n<p style=\"font-size: 13px; font-weight: normal; margin: 5px; color: #4a4a4a;\"><a style=\"font-weight: bold; color: #1caad9;\" href=\"https:\/\/sketchfab.com\/3d-models\/nack-dronie-bundled-textured-b4a060f5b7dc4177b61cc277ed14f977?utm_medium=embed&amp;utm_source=website&amp;utm_campaign=share-popup\" target=\"_blank\" rel=\"noopener\">Nack Dronie Bundled Textured<\/a><br \/>by <a style=\"font-weight: bold; color: #1caad9;\" href=\"https:\/\/sketchfab.com\/bilawal?utm_medium=embed&amp;utm_source=website&amp;utm_campaign=share-popup\" target=\"_blank\" rel=\"noopener\">bilawal<\/a><br \/>on <a style=\"font-weight: bold; color: #1caad9;\" href=\"https:\/\/sketchfab.com?utm_medium=embed&amp;utm_source=website&amp;utm_campaign=share-popup\" target=\"_blank\" rel=\"noopener\">Sketchfab<\/a><\/p>\n<\/div>\n\n\n<p>The file is big enough that I&#8217;ve had some trouble loading it on my iPhone. If that affects you as well, check out this quick screen recording:<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Pinnacles 3D\" width=\"604\" height=\"340\" src=\"https:\/\/www.youtube.com\/embed\/8XKS8PBVylk?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>Last year my friend Bilawal Singh Sidhu, a PM driving 3D experiences for Google Maps\/Earth, created an amazing 3D render (also available in galactic core form) of me sitting atop the Trona Pinnacles. At that time he used &#8220;traditional&#8221; photogrammetry techniques (kind of a funny thing to say about an emerging field that remains new [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[18,66,70],"tags":[],"_links":{"self":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/20294"}],"collection":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/comments?post=20294"}],"version-history":[{"count":2,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/20294\/revisions"}],"predecessor-version":[{"id":20297,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/20294\/revisions\/20297"}],"wp:attachment":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/media?parent=20294"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/categories?post=20294"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/tags?post=20294"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}