Live participant's action recognition for virtual reality interactions

Ronan Boulic, Daniel Thalmann
1997
Conference paper

Abstract

The recognition of daily human activities is a decisive interface component for more intuitive virtual reality (VR) interactions. In this paper, we describe a hierarchical model of body actions based on fine-grained action primitives. The associated recognition algorithm allows on-the-fly identification of simultaneous actions. Measurements highlight robustness to participants' variability and high detection rates when using the full potential of the action model. An example illustrates an interaction with a virtual character driven by the participant's action recognition

Official source

https://infoscience.epfl.ch/record/98846?ln=en

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Related concepts

Related publications

Conferring human action recognition skills to life-like agents

Ronan Boulic, Daniel Thalmann

Most of today's virtual environments are populated with some kind of autonomous life-like agents. Such agents follow a preprogrammed sequence of behaviours that excludes the user as a participating entity in the virtual society. In order to make inhabited virtual reality an attractive place for information exchange and social interaction, we need to equip the autonomous agents with some perception and interpretation skills. We present one skill: human action recognition. By opposition to human-computer interfaces that focus on speech or hand gestures, we propose a full-body integration of the user. We present a model of human actions along with a real time recognition system. To cover the bilateral aspect in human-computer interfaces, we also discuss some action response issues. In particular, we describe a motion management library that solves animation continuity and mixing problems. Finally, we illustrate our system with two examples and discuss what we have learned

1999

Hand Posture Classification and Recognition using the Modified Census Transform

Agnès Just, Sébastien Marcel, Yann Rodriguez

Developing new techniques for human-computer interaction is very challenging. Vision-based techniques have the advantage of being unobtrusive and hands are a natural device that can be used for more intuitive interfaces. But in order to use hands for interaction, it is necessary to be able to recognize them in images. In this paper, we propose to apply to the hand posture classification and recognition tasks an approach that has been successfully used for face detection~\cite{Froba04}. The features are based on the Modified Census Transform and are illumination invariant. For the classification and recognition processes, a simple linear classifier is trained, using a set of feature lookup-tables. The database used for the experiments is a benchmark database in the field of posture recognition. Two protocols have been defined. We provide results following these two protocols for both the classification and recognition tasks. Results are very encouraging.

IDIAP2006

A multi-level model of human actions involving full body motion is proposed. Actions are considered as the combination of action primitives at different levels: motions of the center of mass, end effectors, and final postures of the virtual skeleton. The model is especially designed for fast action recognition from the input of the human motion at the joint level

1997