localization using D455
I have recently purchased the D455 camera and would like to use it to localize my quadcopter—specifically, to determine its (x, y, z) position. If full localization is not feasible, I would at least like to estimate the velocity components (vx, vy, vz). Could someone please help me with this?
-
Hi Allusrikanth87349 The D455's IMU motion-tracking hardware component contains an accelerometer that can provide x, y and z velocity values. This information can be accessed using programming code such as C++ or Python.
The pre-made RealSense Viewer software tool can also display the XYZ acceleration values by enabling its Motion Module that contains data streams for the accelerometer and also the rotation angle gyro.
RealSense 400 Series camera models do not have built-in support for navigation localization They can be used with third-party SLAM navigation software tools though (such as ORB_SLAM).
-
Thank you for the detailed response, MartyG. I have a follow-up question. As per my understanding, the accelerometer provides acceleration values along the x, y, and z axes. To estimate velocity (vx, vy, vz), is it necessary to integrate these acceleration values over time? If so, how can we mitigate common issues such as drift or noise accumulation during integration? I would appreciate any guidance or recommended practices for obtaining reliable velocity estimates using the D455’s IMU data.
-
The IMU measures acceleration in the unit meters per second squared (m/s²) and gyroscopic angular velocity is measured in the unit radians per second (rad/s). So the acceleration already takes account of distance travelled over time without having to make manual adjustments.
IMU data tends to be 'noisy', but there is a 'motion correction' function to "fix" the raw IMU data to make it more accurate. This feature can be enabled with programming code, and is enabled by default in the RealSense Viewer tool's Motion Module controls.
When using the camera with SLAM navigation tools, if those tools support a feature called relocalization then it can be used to correct drift that has developed over time during travel.
-
Thank you so much for your explanation, MartyG. Your clarification about the IMU and motion module was really helpful.
Since the D455 doesn't provide built-in SLAM or localization, could you please suggest the best SLAM methods (like ORB-SLAM or others) that are known to work well with the D455? Also, if you could point me toward any reliable resources, tutorials, or sample projects related to integrating the D455 with SLAM systems, that would be really appreciated. I noticed there aren't many comprehensive guides out there for D455 and SLAM integration, so any pointers would help a lot.
Thanks again for your support!
-
Some RealSense users have also successfully used Isaac ROS Visual SLAM, a tutorial for which is here:
Please sign in to leave a comment.
Comments
6 comments