1 Reply Latest reply on Jan 21, 2017 4:14 PM by MartyG

    Foot, toe and knee tracking with the RealSense camera


      Hi everyone,


      I was going through my old RealSense tech demo videos and found one from late 2014 that showcased how the RealSense camera can control an avatar with the hand tracking function using feet and toes.  This is because the camera treats the base of the foot like a palm and the toes like fingers.  In the video, you can see the avatar's fingers wiggling in response to the wiggling of the real-life toes.


      This method also works for controlling an object with leg movements, as the camera treats the knee as a large hand palm.  The approach never got used outside of experiments though because by its very nature it was impractical, as the user would have to remove their pants / trousers for knee tracking or their shoes and socks for foot tracking.   It may have more specific applications as a means of object control for physically disabled users though.  


      I have cut out the toe control section from my tech video though and posted it as a standalone video, just so other developers can see it in action.


      RealSense and Foot Tracking - YouTube