Crowds for interactive virtual environments

Crowds are part of our everyday experience; nevertheless, in virtual worlds they are still relatively rare. In this thesis we explore the challenges of bringing crowds into interactive virtual environments and the possible applications of real-time interactive crowds, for example, in the domains of virtual heritage and training systems. We address several topics including real-time generation of higher-level behaviors, lower-level motion control for many characters, management of variety, integration of crowds into virtual environments, interaction with virtual crowds and authoring of scenarios. In comparison with the other crowd modeling approaches, we focus on more complex behaviors of many agents in dynamic environments with possible user interaction. In our system a crowd is modeled as a collection of individuals which react to the environment, to other agents and to real human participants of the simulation and can have very different behaviors, both for one agent in different situations, and for many agents in the same situation. We emphasize the importance of variety as one of the most distinguishing features of the crowd simulations; we introduce the notion of levels-of-variety. We address as well the question of how to author crowd scenes in an efficient way. We introduce a novel approach to create complex scenes involving thousands of animated individuals in a simple and intuitive way. By employing a brush metaphor, analogous to the tools used in image manipulation programs, we can distribute, modify and control crowd members in real-time with immediate visual feedback. We demonstrate the validity of our behavior simulation approach with several case studies, where we use our crowd system to manage crowd behaviour in a virtual reality training system and virtual heritage reconstruction. The potential of our authoring approach is shown by authoring a scenario of a virtual audience in a theater and a scenario of a pedestrian crowd in a city.

Conferring human action recognition skills to life-like agents

Ronan Boulic, Daniel Thalmann

Most of today's virtual environments are populated with some kind of autonomous life-like agents. Such agents follow a preprogrammed sequence of behaviours that excludes the user as a participating entity in the virtual society. In order to make inhabited virtual reality an attractive place for information exchange and social interaction, we need to equip the autonomous agents with some perception and interpretation skills. We present one skill: human action recognition. By opposition to human-computer interfaces that focus on speech or hand gestures, we propose a full-body integration of the user. We present a model of human actions along with a real time recognition system. To cover the bilateral aspect in human-computer interfaces, we also discuss some action response issues. In particular, we describe a motion management library that solves animation continuity and mixing problems. Finally, we illustrate our system with two examples and discuss what we have learned

1999

Towards interactive real-time crowd behavior simulation

Daniel Thalmann, Branislav Ulicny

While virtual crowds are becoming common in non-real-time applications, the real-time domain is still relatively unexplored. In this paper we discuss the challenges involved in creating such simulations, especially the need to efficiently manage variety. We introduce the concept of levels of variety, then present our work on crowd behaviour simulation aimed at interactive real-time applications such as computer games or virtual environments. We define a modular behavioural architecture of a multi-agent system allowing autonomous and scripted behaviour of agents supporting variety. Finally we show applications of our system in a virtual reality training system and virtual heritage reconstruction

Blackwell Publishers for Eurographics Assoc2002

Collaboration with agents in VR environments

Jan Ciger

Virtual reality is gaining on importance in many fields – scientific simulation, training, therapy and also more and more in entertainment. All these applications require the human user to interact with virtual worlds inhabited by intelligent characters and to solve simulated or real problems. This thesis will present an integrated approach to simulated problem solving in virtual reality environments, with the emphasis on teamwork and the ability to control the simulations. A simulation framework satisfying these goals will be presented. A unified approach to the representation of semantic information in virtual environments based on predicate calculus will be introduced, including the representation of the world state, action semantics and basic axioms holding in the simulated world. Afterwards, the focus will be on the collaboration model based on task delegation and facilitator-centric architecture. A simple but efficient facilitator design will be presented. The issues of the collaborative problem solving will be examined. A new technique using propositional (STRIPS-like) planning with delegated actions and object-specific planning will be described. A control technique for virtual characters/objects will be detailed, enabling run-time exchange of control and control sharing over a virtual entity between multiple autonomous agents and/or human users. Finally, a set of case studies will be shown, illustrating the possible applications of the techniques developed and described in this dissertation.

EPFL2005