WorldCIST'14 - The 2014 World Conference on Information Systems and Technologies

Full Program »

Robot control and online programming by human gestures using a kinect motion sensor

Monitoring and controlling of robots are key competences
for robot producers and many research and development projects are carried out to increase robot performance and add some new function- ality. The paper presents a concept and implementation of online pro- gramming, controlling and monitoring an industrial robot using a kinetic motion sensor (Kinect) as a part of a human-machine interface (HMI). Presented innovative solution is based on human gestures. A commu- nication interface for the analysis of gestures performed by the robot operator was created using NI LabVIEW applications. Communication between the kinetic motion sensor and the robot was carried out through a programmable logic controller (PLC) Siemens S7-300 inside a
exible manufacturing system. The connection between the logic controller and the robot controller R30iA was realized in the Pro bus DP network. The connection between the controller and NI LabVIEW application has been
established using the MPI protocol. A hardware communication protocol used by a PLC was converted into the OPC protocol. The Natural User Interface (NUI) was used to communicate the kinetic motion sensor with
LabVIEW in Windows environment.


Slawomir Zolkiewski    
Silesian University of Technology

Dominik Pioskowik    
Silesian University of Technology


Powered by OpenConf®
Copyright ©2002-2013 Zakon Group LLC