{"id":14832,"date":"2021-05-19T08:03:00","date_gmt":"2021-05-19T15:03:00","guid":{"rendered":"http:\/\/jnack.com\/blog\/?p=14832"},"modified":"2021-05-17T20:31:22","modified_gmt":"2021-05-18T03:31:22","slug":"using-ai-to-enhance-film-dubbing","status":"publish","type":"post","link":"https:\/\/jnack.com\/blog\/2021\/05\/19\/using-ai-to-enhance-film-dubbing\/","title":{"rendered":"Using AI to enhance film dubbing"},"content":{"rendered":"\n<p>I&#8217;ve always had a soft spot for incredibly crappy film dubbing\u2014especially this Bill Murray SNL classic that I hadn&#8217;t seen in 30 years but remember like it was yesterday&#8230;<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-vimeo wp-block-embed-vimeo wp-embed-aspect-4-3 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Il Returno De Hercules\" src=\"https:\/\/player.vimeo.com\/video\/286799235?dnt=1&amp;app_id=122963\" width=\"400\" height=\"300\" frameborder=\"0\" allow=\"autoplay; fullscreen; picture-in-picture\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>&#8230;and not to mention Police Academy (&#8220;Damn you, wanna fight? Fight <em>me!!<\/em>&#8220;):<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Police Academy 2 (1985) - He Thinks He&#039;s Bruce Lee Scene (6\/9) | Movieclips\" width=\"604\" height=\"340\" src=\"https:\/\/www.youtube.com\/embed\/hH0av1iDYVI?start=60&#038;feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>Not every example is so charming, however and now a company called <a href=\"https:\/\/www.flawlessai.com\/\">Flawless<\/a> plans to use neural networks to <a href=\"http:\/\/jnack.com\/blog\/wp-admin\/post.php?post=14832&amp;action=edit\">fit actors&#8217; mouth movements to dialogue<\/a>:<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-vimeo wp-block-embed-vimeo wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Flawless Demo - www.flawlessai.com\" src=\"https:\/\/player.vimeo.com\/video\/544363296?dnt=1&amp;app_id=122963\" width=\"604\" height=\"340\" frameborder=\"0\" allow=\"autoplay; fullscreen; picture-in-picture\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<blockquote class=\"wp-block-quote\"><p>\u201cThe extraction of facial data\u201d \u2014 a time-consuming computational process \u2014 \u201cruns parallel with the production itself.\u201d The technology strips actors\u2019 faces off, converting their visages into a 3D model, according to Lynes. \u201cThis creates millions of 3D models, which the AI uses as reference points,\u201d he says.<\/p><p>\u201cAnd then, using an existing foreign-language recording of the dialogue, it studies the actor and generates a new 3D model per frame,\u201d he adds. Finally, the imagery is converted back to 2D. Digital effects artists can then manually fix anything that seems off.<\/p><\/blockquote>\n","protected":false},"excerpt":{"rendered":"<p>I&#8217;ve always had a soft spot for incredibly crappy film dubbing\u2014especially this Bill Murray SNL classic that I hadn&#8217;t seen in 30 years but remember like it was yesterday&#8230; &#8230;and not to mention Police Academy (&#8220;Damn you, wanna fight? Fight me!!&#8220;): Not every example is so charming, however and now a company called Flawless plans [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[66],"tags":[],"_links":{"self":[{"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/14832"}],"collection":[{"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/comments?post=14832"}],"version-history":[{"count":2,"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/14832\/revisions"}],"predecessor-version":[{"id":14835,"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/14832\/revisions\/14835"}],"wp:attachment":[{"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/media?parent=14832"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/categories?post=14832"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/tags?post=14832"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}