Loading...
Publication
Multi-scale cortical keypoints for realtime hand tracking and gesture recognition
| Name: | Description: | Size: | Format: | |
|---|---|---|---|---|
| 4.45 MB | Adobe PDF |
Advisor(s)
Abstract(s)
Human-robot interaction is an interdisciplinary
research area which aims at integrating human factors, cognitive
psychology and robot technology. The ultimate goal is
the development of social robots. These robots are expected to
work in human environments, and to understand behavior of
persons through gestures and body movements. In this paper
we present a biological and realtime framework for detecting
and tracking hands. This framework is based on keypoints
extracted from cortical V1 end-stopped cells. Detected keypoints
and the cells’ responses are used to classify the junction type.
By combining annotated keypoints in a hierarchical, multi-scale
tree structure, moving and deformable hands can be segregated,
their movements can be obtained, and they can be tracked over
time. By using hand templates with keypoints at only two scales,
a hand’s gestures can be recognized.
Description
Keywords
Visão humana
Citation
Miguel Farrajota; Mario Saleiro; K. Tersic; Rodrigues, J.M.F.; du Buf, J.M.H. Multi-scale cortical keypoints for realtime hand tracking and gesture recognition, Trabalho apresentado em 1st Int. Workshop on Cognitive Assistive Systems, In Proc 1st Int. Workshop on Cognitive Assistive Systems: Closing the Action-Perception Loop (ISBN 978-972-8822-26-2) in conjunction with IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, Vilamoura, Portugal, 2012