D415 Depth frames streaming
Hi,
I have D415 camera and now I have achieved streaming of RGB frames using OpenCv and Gstreamer backend plus MediaMtx RTSP server.
How can I stream also depth frames? Is there any standard on deph frames information. What's the best format for streaming depth frames iver RTSP. Maybe simply using colored images? How colored algorythm works? It's possible to determine raw distance from colored images to get real distance if needed in clients consumming colored frames?
With regards,
-
Hi Juan Diezyanguas As you are using GStreamer as your backend, you could consider using the GStreamer plugin for RealSense at the link below to stream depth frames if you are not using the plugin already.
https://github.com/WKDSMRT/realsense-gstreamer
You may have tried the plugin already as I referenced it on one of your previous cases on this support forum.
https://support.intelrealsense.com/hc/en-us/community/posts/26680361898131/comments/26705746413459
Because the Linux version of the RealSense SDK uses the V4L2 backend as its default backend, if the SDK is built from source code in 'native' mode (a kernel-patched build where RSUSB = false) then its raw streams can be accessed by standard Linux tools, though they will not be colored as nicely as the streams in the RealSense SDK.
Intel have a white-paper guide about converting depth data into image files and then converting the image file back into depth data. This guide was an experimental proof of concept and Intel do not recommend using it (the conversion from image back to depth data is difficult to implement), but you are welcome to read the information.
Intel's ethernet networking tool rs-server uses the RTSP protocol, though RealSense users have found that they could only access the RTSP feed through the RealSense SDK and not with other streaming tools that are compatible with RTSP.
-
Hi MartyG
I'm not using raspberry or rs-server. I'm using a C# app connected directly reading directly from USB interface of RealSense camera using RealSense Api.
With rgb frames I'm doing some processing like motion detect using OpenCv and after that I'm writing frames using OpenCv VideoWriter with Gstreamer to stream frames with MediaMtx server.
I'm working on this way because I can modify rgb frames before stream it and also with MediaMtx server I can stream to multiple clients. I have better camer control than using rs-server.
I'll take a look at Gstreamer plugin but I have first to build it from source since it seem that it's not available for download.
With regards,
Please sign in to leave a comment.
Comments
4 comments