Highlighting use of RealSense with the face tracking software FaceRig

• Ahughes

  • February 11, 2021 18:33

  Please can someone tell me how this was working as it’s unsupported on any current version

  0

  Comment actions Permalink
• MartyG

  • February 11, 2021 19:29
  • Edited

  Hi Ahughes  FaceRig and the free RealSense-specific version IRFaceRig pre-date the launch of the RealSense 400 Series cameras at the end of 2017.  It can be used with the original-generation RealSense F200 and SR300 models, either by:

  (a) using IRFaceRig and its RealSense compatibility, or

  (b) by using FaceRig (which works with ordinary webcams) and installing an add-on to provide RealSense support to FaceRig.. 

  When the program requirements mention the RealSense SDK, I believe that it is referring to the old 2016 RealSense SDK for Windows. 

  https://software.intel.com/content/www/us/en/develop/articles/realsense-sdk-windows-eol.html

  The D435 may have been being used as an ordinary webcam in the YouTube video, as FaceRig and not IRFaceRig is the software used in that video.

   

  FaceRig has recently been superseded in November 2020 by a new product called Animaze by FaceRig

  https://store.steampowered.com/app/1364390/Animaze_by_FaceRig/

  0

  Comment actions Permalink
• Ahughes

  • February 12, 2021 04:57

  So basically there’s nothing special here , facerig works with ANY web camera, it’s using none of the real sense functions like tongue and gesture control for the hands

  0

  Comment actions Permalink
• Ahughes

  • February 12, 2021 04:58

  Also Animaze doesn’t support realsense or any gesture control devices , nore is it one the roadmap apparently

  0

  Comment actions Permalink
• Ahughes

  • February 12, 2021 04:59

  Well all I can say is I wasted £200 on a camera that no programs seem to support :-(

  0

  Comment actions Permalink
• MartyG

  • February 12, 2021 07:53

  RealSense does have strong software support, though avatar facial morphing with a webcam has become sophisticated enough that dedicated face landmark tracking with a RealSense camera is no longer necessary.

  If you do wish to take advantage of your 400 Series camera though, a commercial software called Nuitrack SDK that has body and face tracking capability is compatible with this camera range.

  https://youtube.com/watch?v=GOsr8mVU0uI

  Nuitrack have recently launched an advanced new version of their SDK called Nuitrack AI

  https://youtube.com/watch?v=S8dkf2MEZeM

  For the purposes of controlling an avatar with a depth camera such as RealSense, typically the game creation engine Unity is involved, like in the control of Unity avatars in the Nuitrack avatar animation video above.  Several years ago I created my own RealSense-powered full-body face and body tracking system in Unity.

  https://youtube.com/watch?v=HspFO87NHeY

  Intel also released an advanced level video seminar about training a data-set for tracking body joints with RealSrnse.

  https://youtube.com/watch?v=VSHDyUXSNqY

  If your needs are a pre-built avatar that responds precisely to the face then Animaze by FaceRig is likely to be good enough if you consider your RealSense camera to be a high definition, high quality webcam.

  0

  Comment actions Permalink

Please sign in to leave a comment.