Need HELP!!!
Dear Sir/Ma'am,
My team has brought intel D435 depth camera for incorporate with YASKAWA make robot (GP12).
We do not have any idea how this camera works and how we can get the coordinates from camera. We have downloaded the software such as intel depth and viewer tool and also SDK. I would like to request everyone to please assist us for operating and getting coordinate from the camera.
Regards,
Harsh Shah,
Robotics engineer,
Armstrong machine builders pvt ltd.
-
The YouTube video in the link below by Solomon Vision Robotics has a demonstration of using a D435 and a Yaskawa robot arm for the application of bin-picking.
https://www.youtube.com/watch?v=NdEA-esYW9I
The RealSense SDK can be interfaced with the Robot Operating System (ROS) software. Do you have any experience with ROS please?
-
Dear Sir,
We (Armstrong) is working in intralogistics solution we have the full proof pick and place application available for industry. We have worked with YASKAWA and FUJI robots having high payload such as 200KG. I checked out the video link which you have shared, I would like to understand how you have integrated the camera with the robot and what type of coding have been used, which platform you have used for coding.
Regards,
Harsh Shah,
Robotics engineer,
Armstrong machine builders pvt ltd.
-
The particular example in the video was set up by the company Solomon and not Intel, so I do not have details of their setup. There are plenty of other people who have also used the 400 Series cameras with robotic arms in general though.
I researched your question carefully. If your application involves pick and place of multiple objects then it is likely to involve training the robot to recognise objects. There are many approaches to robotics though, so the best way forward may be to begin with an introductory level article and work out a plan for how to proceed through a series of questions and answers. I appreciate your patience.
-
Dear Sir,
Thank you for the quick reply and interest. The robot side teaching and coding is not a major problem for us. The problem which concerns me is how I can get the coordinates of an object using D435 camera. What kind of coding does it require, can I get some sample code for the same and the software that is provided by intel such as intel depth and viewer tool how it can be utilized. I would like to know if there is some video or tutorial available.
Regards,
Harsh Shah,
Robotics engineer,
Armstrong machine builders pvt ltd.
-
Apologies for the delay in responding, as I was doing further research for your needs. Intel robot tutorials are usually for mobile robots, so there is not an official Intel tutorial for robot arms.
I also searched YouTube deeply for tutorials. Most people demonstrate their robot arms in action with RealSense but do not provide a tutorial for how they did it.
If you need to get the coordinates of objects, it sounds as though getting the "pose" of objects (their position and rotation) should be your focus. I wonder if a program for RealSense D435 and ROS called Deep Object Pose Estimation (DOPE) may meet your needs.
Please sign in to leave a comment.
Comments
6 comments