Robot generated VR for scene modelling

Accurate spatial mapping enables robots to find objects in the workspace and is essential for automated handling. The 3D models obtained can inform both the robot and the operator about handling options. Cloud point generation provides the location of objects and this is complemented by recognition within a set of objects. The models are converted into a VR model that includes real-time modelling of the robot arm and the glovebox frame as well. The VR models can be used by the robot for planning suitable attitudes of the gripper and arm to handle objects for activities such as repositioning, drilling cutting, dusting etc.

Technical Specifications:

UR5e and UR10 robots with two and three fingered grippers, 3500 Cuda cores embedded PC for deep learning, cloud point generation and real-time VR generation,rem ote operator desk with 22” monitors displaying a VR model and live video of the complete inside of the glovebox.

Intelligent Robot control using sEnglish scripts

Operator reconfigurable system

To reduce operator stress and increase productivity, natural language sEnglish texts are used to provide an operational framework for nuclear material handling in robotic glove boxes. This framework includes.

1. Scripting of procedures and VR-based dialogues to introduce objects to the robot.
2. Operator editable material handling script-templates for typical tasks to be executed in the glovebox.
3. Operator reconfigurable sensors and tools of the robots.
4. Use of multiple robot arms for material holding and working with tools for cutting, drilling, dusting etc.
5. Automated recording of operational steps and traceability of a robot’s decision making for transparency and logging. Relative to teleoperation, these technologies can speed up productivity up to 10 times.

Technical Specifications:

UR5e and UR10 robots with two and three fingered grippers, 3500 Cuda cores embedded PC for deep learning, cloud point generation and real-time VR generation, remote operator desk with 22” monitors displaying a VR model and live video of the complete inside of the glovebox.