In this project we developed a system to remote control a humanoid Nao robot using a VR headset. The setup was delivered with all software and hardware required to use the system. Professional choreographer Robin Jonsson will be using this system in his upcoming show.

The video feed is sent from the cameras on the robot to the VR headset for the operator to see. The head, arms and fingers are controlled with precision by the human operator using trackers attached to the body.

The operator interface is coded in the Unity3D game engine. Joint angles for the robot is calculated using inverse kinematics and optimized though Scipy. The system is built on top of the powerful ROS2 (Robot Operating System) and deployed in a Docker container.

Categories: Project