Humanoid Robot Navigation Teleoperation Using NAO and Kinect (Video)

We've been following Taylor Veltrop's work integrating the Kinect with humanoid robots utilizing the Willow Garage ROS system closely, and we weren't surprised when he mentioned last night that he had just finished a new “killer video.”

You may be aware that Taylor was one of the lucky, and extremely capable, developers that were selected to participate in the NAO Developer Program via Robots Dreams. So, it was natural for Taylor to implement his Kinect based master/slave control system with the NAO robot.

But he wasn't satisfied with just to get the basic remote control functions working, he also added a great deal of autonomous operation, to the point that his NAO can act as a remote avatar capable of maneuvering around the room, picking up items from a table, and transferring them to another table across the room. Very, very cool.

How did he accomplish it? Here's the background and details, plus some mind blowing demos like slicing a banana, cutting an onion, playing chess, hammering nails, and getting a tissue out of the box:

You might also enjoy:

  1. Using the Kinect with Willow Garage ROS as a Master/Slave Robot Control (Video)
  2. Taylor Veltrop: Willow Garage ROS + XBox Kinect = Robot Master/Slave Control (Video)
  3. Kinect Controlled Humanoids Start to Swarm (Video)
  4. Hobby Humanoid Robots Turn Autonomous (Video)
  5. Kondo Set to Celebrate the 5th KHR Humanoid Robot Anniversary
Share and Enjoy:
  • Facebook
  • Twitter
  • Reddit
  • email
  • LinkedIn
  • Slashdot
  • StumbleUpon
  • Google Bookmarks
  • Digg
  • del.icio.us

4 comments

  1. Excellent work here. Way to go. Very impressed with the progress.

  2. Matt Bauer

    Very, very, very cool!

  3. incredible!

  4. Very interesting and incredible!

    Would be cool if there was a added head mounted display for the operator. This would help with situational awareness from the robot’s pov especially when cutting the banana.

    Anyway, what a great opportunity, keep up the good work!

Leave a Reply