Intel RealSense D415 Usage Question
Can the D415 be used as a form of motion detection? I was thinking of a project where the D415 would have to track small movements of an object at certain points (for example, a plant in a slight breeze) over a certain period of time. Would this camera have the necessary functionality to accomplish this? Thanks in advance!
-
Hi Glaceonw The D415 can track motion at human walking pace, so it should be able to cope fine with a plant in a slight breeze. For fast motion (including a vehicle travelling at full speed), the D435 or D435i model is best suited because it has a faster shutter. For your application, the D415 should be able to handle it though.
The D415 also has a smaller size of Field Of View (FOV) then the D435 models, so if you anticipate tracking a wide area of flowers instead of a small area, or one flower, then the D435 / D435i will be better suited.
The Chief Technical Officer of the RealSense Group at Intel has said that the 400 Series cameras can reliably track the motion of objects that contain at least 9 pixels.
-
Thanks for the response. One more question (on a similar note), I was looking at the Skeleton Tracking SDK, and I was wondering if something similar could be implemented. For example, I would mark (either digitally of physically) several points on the object and have the D415 track/record the movement of those points over a given period of time. Do you think that the D415 would be suitable for that?
-
Given the small size of parts on a flower, it may be impractical to apply physical marker tags that are large enough for the camera to recognise. If the different areas have differing colours then it may be possible to track based on the percentage of a certain color on an idea of the image.
It is also possible to create markerless detection and tracking of specific parts based on visual characteristics. This is commonly seen in robot arms with a RealSense camera attached and typically involves an element of artificial intelligence.
Another approach is to train a computer model to recognise multiple joint areas that you define yourself, similar to the Cubemos Skeleton Tracking SDK. Intel published an advanced presentation on doing this with RealSense.
-
The flower was merely an example- I was just curious tracking physical markers would be possible to do. So in the case of a human moving (while staying in the field of view of the d415), using colored markers would be more viable, correct?
I will look into the other options that you mentioned above. Thanks! -
For larger objects, you could apply a type of image tag called Aruco tags to the object and track their "pose" (their position and angle).
https://docs.opencv.org/trunk/d5/dae/tutorial_aruco_detection.html
Here is an example system for doing so with RealSense:
https://github.com/Roboy/roboy_realsense
Another example of using tags with RealSense is the robot 'roboat' boats that navigate to dock using tags on the dock in combination with RealSense cameras on the bottom of the boat.
Please sign in to leave a comment.
Comments
5 comments