View my account

Use with a Stereo Display (aka 3D monitor) ?

Follow
Bogdan Cociu

Hi,

I was wondering whether anyone has attempted to get a depth stream from a RealSense camera displayed on a 3D Monitor, and if so could you share your workflow please?

I'm looking for something akin to what the RealSense Viewer can output (or e.g. a rendered point cloud), but with two separate images suitable for a stereoscopic display. Any information on suitable libraries to use for this would be greatly appreciated, our end goal is to modify this depth stream before displaying it.

We are using a D435i if that makes any difference.

Thanks,

Bogdan.

0

Comments

4 comments

Date Votes
  • MartyG
    • Edited

    If you can use Windows 10, apparently it has a "3D Display Mode", though I have never used it myself.

    https://silicophilic.com/enable-disable-3d-display-mode/

    I asked Intel myself in April 2019 about the possibility of generating a 3D anaglyph stream image with a single camera, instead of showing the overall screen display in 3D like in the Windows 3D mode above.  The problem though was that one camera cannot produce two colored streams.  A member of the Intel team explained why it wasn't possible.

    https://github.com/IntelRealSense/librealsense/issues/3754 

    0
    Comment actions Permalink
  • Bogdan Cociu

    Thanks @MartyG. I suppose the other way of going about this is to create a point cloud and then render that for a stereo display? OpenGL or Unity come to mind for doing this, but has anyone done this successfully before?

    0
    Comment actions Permalink
  • MartyG
    • Edited

    I have not heard of a case of RealSense feed being displayed on a 3D monitor.  RealSense has been projected into VR headsets before, where the computer generates a left and right image and then projects it into the screen inside the headset. 

    I actually received an Intel promotional email yesterday that had a case-study of a person who developed a Unity-based app that "uses a custom algorithm to stream and render in real-time a high resolution RGB+depth video from the depth camera" and displays it in a VR headset.

    https://www.intelrealsense.com/co-presence-in-vr-wake-project 

    There was also an unofficial Unity wrapper for RealSense SDK 2.0 developed in 2018 that allowed a RealSense point cloud to be viewed in an HTC Vive VR headset through a program called 'ViveViewer'.

    https://github.com/ajingu/RealSense 

    Also, a process was recently developed to allow a point cloud to be viewed in Unity with a RealSense D435i camera and a wireless Oculus Quest headset.

    https://github.com/IntelRealSense/librealsense/issues/4155 

    0
    Comment actions Permalink
  • Bogdan Cociu

    Thanks for this! It makes me think it should be reasonable to put something together in Unity.

    0
    Comment actions Permalink

Please sign in to leave a comment.

Didn't find what you were looking for?

New post