We would like to utilize the Leap Motion technology to assist astronauts using robots without controls. Different hand signals would control different ranges of movement. This would include the motion; the movement of the Robot to where it needs to go, and the action; what the robot does when it gets there.

This project is solving the WebRover1 challenge.


Our project can help astronauts do a multitude of tasks. We want to make a robot efficient enough to be faster and better than the astronaut at a particular task, independent of environmental issues. We can do this through different robots with different purposes, all controlled with Leap Motion Technology. Our project consists of this Leap Motion Technology and how it can be used to control a robot.

Our application consists of three steps -Leap motion device captures the hand gestures and provide the data through Java APIs provided in the Leap Motion SDK. -The Java program to control the robot analyses the data from Leap motion and process the same. This program interpret different hand/finger locations and the gestures' data and generate commands readable by the NXT controller of the robot. -The commands for the Robot are communicated to the NXT through blue tooth interface. -The NXT reads the data from the blue tooth interface and pass the signals to different dc motors/servo motors in the Robot.

Project Information

License: GNU Affero General Public License 3.0 (AGPL-3.0)"

Source Code/Project URL:


Gesture Robot Powerpoint -


  • Nidhin Madhu
  • Shruti Satrawada