Human motion capture for robotics
Hi guys, for my bachelor thesis I am looking for a way to capture arm movements of a patient and send the data to a robot in real time. This robot should then perform passive movement exercises together with the patient. I think that this would be possible with a "RealSense". Is it also possible to program something like this quickly and easily with "Intel RealSense SDK 2.0"?
Unfortunately, I'm not very good at programming and have had no experience with machine learning so far. Besides, a lot of time will be spent on communication, robot programming and the right end effector alone. Thank you very much for your help!
Best,
Manuel
-
Hi Manuel Hermanns If you are aiming for your robot to be humanoid then a good starting point for your research may be an article at the link below about a humanoid robot that uses RealSense technology to enable it to mimic the body poses of an observed human.
https://annadumitriu.co.uk/portfolio/cyberspecies-proximity/
-
Hi MartyG, thank you very much for your answer. However, the robot should not be human-like or humanoid. For example, the robot should only be able to lift one arm of a human. For this, I need the exact position of the human arm, which I would like to determine with RealSense technology and transmit the data to the robot in real time. Do you know a good starting point for my research?
-
If you need quick results without programming knowledge then the RealSense-compatible commercial skeleton tracking tool Nuitrack SDK may suit your requirements.
Nuitrack SDK can track the joint positions of a human body, including the arm positions from hand to shoulder. It has built-in support for use with the Unity game creation engine to further aid the creation of a tracking application without the need for programming knowledge.
If you would prefer to develop your own Nuitrack-powered application instead of using Unity then Nuitrack SDK supports that too.
https://github.com/3DiVi/nuitrack-sdk/blob/master/doc/Samples.md
Alternatively, if you require a fully open-source approach to your project then using RealSense with the OpenPose tool could be another way to achieve your goal. The RealSense2OpenPose3D project illustrates an approach for doing so.
https://github.com/foxtierney/RealSense2OpenPose3D
At a more advanced level, Intel have a YouTube guide to using a RealSense camera to train a dataset to use with machine learning to track the arm positions.
Please sign in to leave a comment.
Comments
3 comments