rs.align fails to align depth and color streams
Hello,
I'm running this script from the realsense example to align depth to the color stream and it seems like the results don't line up.
In my main code, i do the same aligning in cpp and run aruco detection. When i plot the detected RGB corners onto the align depth frame, they dont line up. 
I'd appreciate some help to understand what exactly is going on.
Here is the bag file captured from the realsense-viewer: https://www.dropbox.com/scl/fi/y0kgfarvl1qb6i6wz9l75/20250407_153713.bag?rlkey=vfqk0h4c9cbd3vq21ywyz1mel&st=uo5oc25j&dl=0
-
Hi Jashmehta In the image where you plot the RGB corners, they appeared to be being overlaid on an unaligned image that only has depth information and no RGB. The plotted corners being offset in that case would be understandable, as the RGB sensor is physically offset horizontally from the position of the left IR sensor that provides the depth image (i.e the viewpoint of the RGB sensor sees is slightly off to the side of the left IR sensor's viewpoint, like two separate eyes that each have their own view if you close one of the eyes).
When depth-color alignment is performed, the depth coordinates are mapped onto the positions of the RGB color coordinates so that they match up and are overlaid on one another.
Please sign in to leave a comment.
Comments
3 comments