Geste | EPFL Graph Search

Un geste est un manuel ou corporel qui permet d'illustrer les mots du langage, de les compléter ou de les appuyer. Le geste peut aussi être utilisé pour remplacer la parole. On distingue différentes catégories de gestes : certains apportent une information sur le message (par exemple en l'illustrant, en soulignant un point-clef). D'autres apportent plutôt des indices sur les intentions ou émotions du locuteur (par exemple s'il est embarrassé). Les gestes forment une partie importante du langage corporel. Le geste est l'un des éléments de base du mime (théâtre du geste). L'analyse des gestes considérés comme moyens délibérés et organisés d'expression en tant que communication non verbale, est une discipline appelée gestique ou gestuologie. Notes et références Bibliographie

Marcel Jousse, L'Anthropologie du Geste, Gallimard, 1974.
Collectif (dir. Jacques Lecoq), Théâtre du Geste, mimes et acteurs, Bordas, Paris, 1987.
Michel Gendrier, Gestes et mouve

Level up the interaction space with Cellulo robots

Lucas Burget

Cellulo, as tabletop tangible robots, are a great tool for interactive learning and upper limb rehabilita-tion. For the moment, the main way of interaction is to take them in hand and move them in the plane.Thus, due to the laws of physics, the different gestures induced are mainly constrained to be in 2D andthe workspace is bounded by the length of the arm. More precisely, for upper limb rehabilitation, itlimits the solicitation of certain arm joints, for instance the shoulder absduction/adduction. In orderto overcome these limitations, the idea was to use two wristbands with sensors to consider the armsof the user as a remote control. For the rehabilitation part, this would allow the patient to train thejoints of his arm with greater amplitude. But more generally, this new mean of interaction with theCellulo allows more possibility in the creation of activities.This semester project studied two different aspects: pointing direction and gesture recognition. Thefirst could be used by the game Master to change the behavior of some robots in order to adapt to thesituation. And the second could be destined to control a swarm of robots. The governing principle ofthis semester project was to implement systems as light and easy to use as possible.

2019

Demo: Pointing Gestures for Proximity Interaction

We demonstrate a system to control robots in the users proximity with pointing gestures-a natural device that people use all the time to communicate with each other. Our setup consists of a miniature quadrotor Crazyflie 2.0, a wearable inertial measurement unit MetaWearR+ mounted on the user's wrist, and a laptop as the ground control station. The video of this demo is available at https://youtu.be/yafy-HZMk_U [1].

2019

Two-Handed Gestures for Human-Computer Interaction

Agnès Just

The present thesis is concerned with the development and evaluation (in terms of accuracy and utility) of systems using hand postures and hand gestures for enhanced Human-Computer Interaction (HCI). In our case, these systems are based on vision techniques, thus only requiring cameras, and no other specific sensors or devices. When dealing with hand movements, it is necessary to distinguish two aspects of these hand movements: the \textit{static} aspect and the \textit{dynamic} aspect. The static aspect is characterized by a pose or configuration of the hand in an image and is related to the Hand Posture Recognition (HPR) problem. The dynamic aspect is defined either by the trajectory of the hand, or by a series of hand postures in a sequence of images. This second aspect is related to the Hand Gesture Recognition (HGR) task. Given the recognized lack of common evaluation databases in the HGR field, a first contribution of this thesis was the collection and public distribution of two databases, containing both one- and two-handed gestures, which part of the results reported here will be based upon. On these databases, we compare two state-of-the-art models for the task of HGR. As a second contribution, we propose a HPR technique based on a new feature extraction. This method has the advantage of being faster than conventional methods while yielding good performances. In addition, we provide comparison results of this method with other state-of-the-art technique. Finally, the most important contribution of this thesis lies in the thorough study of the state-of-the-art not only in HGR and HPR but also more generally in the field of HCI. The first chapter of the thesis provides an extended study of the state-of-the-art. The second chapter of this thesis contributes to HPR. We propose to apply for HPR a technique employed with success for face detection. This method is based on the Modified Census Transform (MCT) to extract relevant features in images. We evaluate this technique on an existing benchmark database and provide comparison results with other state-of-the-art approaches. The third chapter is related to HGR. In this chapter we describe the first recorded database, containing both one- and two-handed gestures in the 3D space. We propose to compare two models used with success in HGR, namely Hidden Markov Models (HMM) and Input-Output Hidden Markov Model (IOHMM). The fourth chapter is also focused on HGR but more precisely on two-handed gesture recognition. For that purpose, a second database has been recorded using two cameras. The goal of these gestures is to manipulate virtual objects on a screen. We propose to investigate on this second database the state-of-the-art sequence processing techniques we used in the previous chapter. We then discuss the results obtained using different features, and using images of one or two cameras. In conclusion, we propose a method for HPR based on new feature extraction. For HGR, we provide two databases and comparison results of two major sequence processing techniques. Finally, we present a complete survey on recent state-of-the-art techniques for both HPR and HGR. We also present some possible applications of these techniques, applied to two-handed gesture interaction. We hope this research will open new directions in the field of hand posture and gesture recognition.

École Polytechnique Fédérale de Lausanne2006

Two-Handed Gestures for Human-Computer Interaction

Agnès Just

École Polytechnique Fédérale de Lausanne2006