{"id":13986,"date":"2020-12-11T10:49:59","date_gmt":"2020-12-11T18:49:59","guid":{"rendered":"http:\/\/jnack.com\/blog\/?p=13986"},"modified":"2021-04-07T07:53:53","modified_gmt":"2021-04-07T14:53:53","slug":"google-gives-apps-simultaneous-on-device-face-hand-and-pose-prediction","status":"publish","type":"post","link":"http:\/\/jnack.com\/blog\/2020\/12\/11\/google-gives-apps-simultaneous-on-device-face-hand-and-pose-prediction\/","title":{"rendered":"Google gives apps simultaneous on-device face, hand and pose prediction"},"content":{"rendered":"\n<p>From sign language to sports training to AR effects, tracking the human body unlocks some amazing possibilities, and my Google Research teammates are delivering great new tools:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote\"><p>We are excited to announce\u00a0<a href=\"https:\/\/solutions.mediapipe.dev\/holistic\">MediaPipe Holistic<\/a>, [&#8230;] a new pipeline with optimized\u00a0<a href=\"https:\/\/ai.googleblog.com\/2020\/08\/on-device-real-time-body-pose-tracking.html\">pose<\/a>,\u00a0<a href=\"https:\/\/ai.googleblog.com\/2019\/03\/real-time-ar-self-expression-with.html\">face<\/a>\u00a0and\u00a0<a href=\"https:\/\/ai.googleblog.com\/2019\/08\/on-device-real-time-hand-tracking-with.html\">hand<\/a>\u00a0components that each run in real-time, with minimum memory transfer between their inference backends, and added support for interchangeability of the three components, depending on the quality\/speed tradeoffs.<\/p><p>When including all three components, MediaPipe Holistic provides a <strong>unified topology for a groundbreaking 540+ keypoints (33 pose, 21 per-hand and 468 facial landmarks)<\/strong> and achieves near real-time performance on mobile devices.\u00a0<a href=\"https:\/\/solutions.mediapipe.dev\/holistic\">MediaPipe Holistic<\/a>\u00a0is being released as part of\u00a0<a href=\"http:\/\/mediapipe.dev\/\">MediaPipe<\/a>\u00a0and is available on-device for mobile (Android, iOS) and desktop. We are also introducing MediaPipe\u2019s new ready-to-use APIs for research (<a href=\"https:\/\/mediapipe.page.link\/holistic_py_colab\">Python<\/a>) and web (<a href=\"https:\/\/mediapipe.page.link\/holistic_codepen\">JavaScript<\/a>) to ease access to the technology.<\/p><\/blockquote>\n\n\n\n<p><a href=\"https:\/\/ai.googleblog.com\/2020\/12\/mediapipe-holistic-simultaneous-face.html\">Check out the rest of the post<\/a> for details, and let us know what you create!<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/1.bp.blogspot.com\/--1ZnjtlslG8\/X9FxnMTXUEI\/AAAAAAAAG4I\/ENi4DjhCUrEXOUzYtKXs1Wn0vpU_Kv2eACLcBGAsYHQ\/s16000\/image1.gif\" alt=\"\"\/><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>From sign language to sports training to AR effects, tracking the human body unlocks some amazing possibilities, and my Google Research teammates are delivering great new tools: We are excited to announce\u00a0MediaPipe Holistic, [&#8230;] a new pipeline with optimized\u00a0pose,\u00a0face\u00a0and\u00a0hand\u00a0components that each run in real-time, with minimum memory transfer between their inference backends, and added support [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[13,17],"tags":[],"_links":{"self":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/13986"}],"collection":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/comments?post=13986"}],"version-history":[{"count":5,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/13986\/revisions"}],"predecessor-version":[{"id":14554,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/posts\/13986\/revisions\/14554"}],"wp:attachment":[{"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/media?parent=13986"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/categories?post=13986"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/jnack.com\/blog\/wp-json\/wp\/v2\/tags?post=13986"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}