Visual coordination task for human-robot collaboration

Maram Khatib, Khaled Al Khudir, Alessandro De Luca

Research output: Chapter in Book/Report/Conference proceedingChapterpeer-review

7 Citations (Scopus)
25 Downloads (Pure)


In the framework of Human-Robot Collaboration, a robot and a human operator may need to move in close coordination within the same workspace. A contactless coordinated motion can be achieved using vision, mounting a camera either on the robot end-effector or on the human. We consider here one instance of such a visual coordination task, with the robot end-effector that should maintain a prescribed position with respect to a moving RGB-D camera while pointing at it. For the 3D localization of the moving camera, we compare three different techniques and introduce some improvements to the best solution found for our application. For the motion tracking problem, we introduce a relaxed version of the pointing part of the task. This allows to take advantage of the redundancy of the robot, distributing the control effort over the available degrees of freedom. The effectiveness of the proposed approach is shown by V-REP simulations and experiments with the 7-dof KUKA LWR manipulator.
Original languageEnglish
Title of host publication2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Pages3762 - 3768
Number of pages7
ISBN (Electronic)978-1-5386-2682-5
Publication statusPublished - 14 Dec 2017
Externally publishedYes
EventIEEE/RSJ International Conference on Intelligent Robots and Systems - Vancouver, Canada
Duration: 24 Sep 201728 Sep 2017

Publication series

ISSN (Electronic)2153-0866


ConferenceIEEE/RSJ International Conference on Intelligent Robots and Systems
Abbreviated titleIROS 2017
Internet address


  • robotics
  • visual sensors
  • human-robot interaction
  • motion control


Dive into the research topics of 'Visual coordination task for human-robot collaboration'. Together they form a unique fingerprint.

Cite this