{"id":23175,"date":"2025-09-29T10:45:22","date_gmt":"2025-09-29T17:45:22","guid":{"rendered":"http:\/\/jnack.com\/blog\/?p=23175"},"modified":"2025-09-29T10:45:22","modified_gmt":"2025-09-29T17:45:22","slug":"how-to-change-your-eval-ways-baby","status":"publish","type":"post","link":"https:\/\/jnack.com\/blog\/2025\/09\/29\/how-to-change-your-eval-ways-baby\/","title":{"rendered":"How to change your eval ways (baby)"},"content":{"rendered":"\n<p>As much as one can be said to enjoy thinking through the details of how to evaluate AI (and it actually <em>can<\/em> be kinda fun!), I enjoyed this in-depth guide from Hamel Husain &amp; Shreya Shankar.<\/p>\n\n\n\n<p>All year I&#8217;ve been focusing pretty intently on how to tease out the details of what makes image creation &amp; editing models &#8220;good&#8221; (e.g. spelling, human realism, prompt alignment, detail preservation, and more). This talk pops up a level, focusing more on holistic analysis of end-to-end experiences. If you&#8217;re doing that kind of work, or even if you just want to better understand the kind of thing that&#8217;s super interesting to hiring managers now, I think you&#8217;ll find watching this to be time well spent.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Why AI evals are the hottest new skill for product builders | Hamel Husain &amp; Shreya Shankar\" width=\"604\" height=\"340\" src=\"https:\/\/www.youtube.com\/embed\/BsWxPI9UM4c?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>As much as one can be said to enjoy thinking through the details of how to evaluate AI (and it actually can be kinda fun!), I enjoyed this in-depth guide from Hamel Husain &amp; Shreya Shankar. All year I&#8217;ve been focusing pretty intently on how to tease out the details of what makes image creation [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"","sticky":false,"template":"","format":"standard","meta":[],"categories":[66],"tags":[],"_links":{"self":[{"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/23175"}],"collection":[{"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/comments?post=23175"}],"version-history":[{"count":1,"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/23175\/revisions"}],"predecessor-version":[{"id":23176,"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/23175\/revisions\/23176"}],"wp:attachment":[{"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/media?parent=23175"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/categories?post=23175"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/tags?post=23175"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}