Automated body modeling from video sequences

Synthetic modeling of human bodies and the simulation of motion is a long-standing problem in animation and much work is involved before a near-realistic performance can be achieved. At present, it takes an experienced designer a very long time to build a complete and realistic model that closely resembles a specific person. Our ultimate goal is to automate the process and to produce realistic animation models given a set of video sequences. In this paper we show that, given video sequences of a person moving in front of the camera, we can recover shape information and joint locations. Both of which are essential to instantiate a complete and realistic model that closely resembles a specific person and without knowledge about the position of the articulations a character cannot be animated. This is achieved with minimal human intervention. The recovered shape and motion parameters can be used to reconstruct the original movement or to allow other animation models to mimic the subject's actions

3D modeling of the human upper limb including the biomechanics of joints, muscles and soft tissues

The challenge in virtual human modeling is to achieve the representation of the main human characteristics with as much realism as possible. Such achievements would allow the simulation and/or analysis of many virtual situations involving humans. Simulation is especially useful to derive information from the models so as to predict and/or reproduce the behaviors that would be observed in real situations. Computer methods in visualization and simulation have thus great potential for advances in medicine. The processes of strength generation and motion coordination are some of these phenomena for which there is still much remaining to be understood. The human shoulder is also probably the articulation of the human body which deserves more than any other to be named "terra incognita". Investigations towards the biomechanical modeling and simulation of the human upper limb are therefore presented in this study. It includes thorough investigation into the musculoskeletal anatomy and biomechanics of the human upper limb, into the biomechanical constitutive modeling of muscles and soft tissues, and into the nonlinear continuum mechanics and numerical methods, especially the incremental finite element methods, necessary for their simulation. On this basis, a 3-D biomechanical musculoskeletal human upper limb model has been designed using the Visible Human Data provided by the U.S. National Library of Medicine, and applied to the dynamic musculoskeletal simulation of the human upper limb. This research has been achieved in the context of the EU ESPRIT Project CHARM, whose objective has been to develop a comprehensive human animation resource database and a set of software tools allowing the modeling of the human complex musculoskeletal system and the simulation of its dynamics, including the finite element simulation of soft tissue deformation and muscular contraction. An investigation towards the application of this knowledge for the realistic modeling and animation of the upper limb in computer animation is then presented. The anatomical and biomechanical modeling of the scapulo-thoracic constraint and the shoulder joint sinus cones are proposed and applied to the realistic animation, using inverse kinematics, of a virtual skeleton and an anatomic musculoskeletal body model.

EPFL1999

3D modeling of the human upper limb including the biomechanics of joints, muscles and soft tissues

EPFL1999