Skip to main content
CISTI'2017 - 12ª Conferência Ibérica de Sistemas e Tecnologias de Informação

Full Program »

Recognition of hand configuration: a critical factor in automatic sign language translation

Identifying hand configuration is a critical feature of sign language translation. In this paper, we describe our approach to recognize hand configurations in real time with the purpose of providing accurate predictions to be used in automatic sign language translation. To capture the hand configuration we rely on data gloves with 14 sensors that measure finger joints bending. These inputs are sampled at a frequency of 100Hz and fed to a classifier that predicts the current hand configuration. The classification model is created from an annotated sample of hand configurations previously acquired. We expect this approach to be accurate and robust in the sense that the performance of the classification model should not vary significantly when the classifier is being used by one or another user. The results from our experimental evaluation show that there is a very high accuracy, meaning that data gloves are a good approach to capture the descriptive features of hand configurations. However, the robustness of such an approach is not as good as desirable since the accuracy of the classifier depends on the user, i.e., the accuracy is high when the classifier is used by a user who trained it but decreases in other cases.

Author(s):

Nuno Escudeiro    
INESC TEC, LIAAD - Laboratory of Artificial Intelligence and Decision Support
Portugal

Paula Escudeiro    
GILT – Games, Interaction and Learning Technologies, Instituto Politécnico do Porto
Portugal

Fernando Soares    
GILT – Games, Interaction and Learning Technologies, Instituto Politécnico do Porto
Portugal

Orfeas Litos    
National Technical University of Athens
Greece

Marcelo Norberto    
GILT – Games, Interaction and Learning Technologies, Instituto Politécnico do Porto
Portugal

Jorge Lopes    
GILT – Games, Interaction and Learning Technologies, Instituto Politécnico do Porto
Portugal

 

Powered by OpenConf®
Copyright ©2002-2016 Zakon Group LLC