Four-Arm Manipulation via Feet Interfaces

Walid Amanhoud, Aude Billard, Hannes Bleuler, Mohamed Bouri, Anaïs Betsabeh Haget, Jacob Hernandez Sanchez
AAAI, 2019
Article de conférence

Résumé

We seek to augment human manipulation by enabling humans to control two robotic arms in addition to their natural arms using their feet. Thereby, the hands are free to perform tasks of high dexterity, while the feet-controlled arms perform tasks requiring lower dexterity, such as supporting a load. The robotic arms are tele-operated through two foot interfaces that transmit translation and rotation to the end effector of the manipulator. Haptic feedback is provided for the human to perceive contact and change in load and to adapt the feet pressure accordingly. Existing foot interfaces have been used primarily for a single foot control and are limited in range of motion and number of degrees of freedom they can control. This paper presents foot-interfaces specifically made for bipedal control, with a workspace suitable for two feet operation and in five degrees of freedom each. This paper also presents a position-force teleoperation controller based on Impedance Control modulated through Dynamical Systems for trajectory generation. Finally, an initial validation of the platform is presented, whereby a user grasps an object with both feet and generates various disturbances while the object is supported by the feet.

Official source

https://infoscience.epfl.ch/record/272574?ln=fr

À propos de ce résultat

Cette page est générée automatiquement et peut contenir des informations qui ne sont pas correctes, complètes, à jour ou pertinentes par rapport à votre recherche. Il en va de même pour toutes les autres pages de ce site. Veillez à vérifier les informations auprès des sources officielles de l'EPFL.

Concepts associés

Chargement

Publications associées

Chargement

Humans have a great capacity to perform complex manipulations. However, there are many tasks for which two hands are not enough, such as in surgery. For such tasks, a dyad of people is required. However, when not used to work together, a dyad collaboration can be intermittent, slow and prone to misunderstandings if relied solely on verbal cues. The current PhD thesis report concerns the design and control of foot interfaces to enable solo four-handed manipulations. In the first part, we present the platform design in five DoF, with position mapping and haptic force feedback. We tackle the known issue of fatigue when using position mapping, by partially compensating for the dynamics of the leg. Finally, we perform a series of feasibility validations on bipedal teleoperation in 3 and 4 and 5 DoF. In the second part, a behavioural study investigates a symmetric bipedal holding and transport of an object while working on it with the hands. This study sheds light to the human capacity to use the redundancy given by augmentation with the feet, to assist the task of the hands. We investigate the effect of shared-control for lower limb teleoperation. Two modalities are used: 1. synergistic control of two robotic arms with one foot, 2. force assistance. We evaluate these strategies in terms of objective and subjective metrics, such as physical and cognitive workload and fluency.Aiming at enabling individualized foot dexterous control, in the third part of the thesis, we addressed the problem of bio-mechanical coupling of foot rotations. This is done by detecting intention to grasp, and selectively easing this action while haptically constraining the foot gestures for tool alignment. A user study was conducted to evaluate our proposed approach in a surgical laparoscopic gripper.In the fourth and final part, we focus on investigating more demanding tasks for the feet, as well as the coordinated control of four hands, during hybrid-robotic laparoscopic surgery. One foot controls a camera, while the other one performs a grasping task. Noteworthy is that all four-arms can be controlled simultaneously. For easing the solo surgical task, we design haptic assistance, for autonomous grasping operated by the foot. Finally, we perform a systematic behavioural study to understand the effect of our haptic-shared-control, along with an assistance modality for camera tool-tracking. We cover uni-pedal, bipedal and four-handed task scenarios. Our main conclusion is that foot gestures can be conditioned with haptic feedback, to effectively control multiple degrees of freedom of a supernumerary robotic arm. Thereby enabling four-arm simultaneous manipulations. This is done specifically by leveraging 1. a foot kinesthetic haptic platform that allows for the use of two feet, 2. leg compensation, and virtual assistive impedance, which are useful to increase comfort and alleviate fatigue. 3. Hybridization of control mappings for foot gestures, with limited range of motion and oblique axes of rotation, 4. Haptic shared-control strategies for prehensile force assistance, coordination assistance, and DoF-individuation assistance. We found that robotic assistance is highly appreciated, and has an important role in simplifying four-handed tasks. Indeed, these are instrumental considerations to enable a more fluent, less demanding, and more performant interaction, in tasks where the feet are supplementing the task of hands.

EPFL2022

Chargement

Human ability to coordinate one's actions with other individuals to perform a task together is fascinating. For example, we coordinate our action with others when we carry a heavy object or when we construct a piece of furniture. Capabilities such as (1) force/compliance adaptation, (2) intention recognition, and (3) action/motion prediction enables us to assist others and fulfill the task. For instance, by adapting the compliance, we not only reject undesirable perturbations that undermine the task but also incorporate others' motions into the interaction. Complying with partners' motions allows us to recognize their intention and consequently predict their actions. With the growth of factories involving humans and robots working side by side, designing controllers and algorithms with such capacities is a crucial step toward assistive robotics. The challenge, however, is to attain a unified control strategy with predictive/adaptive capacities at the task, motion, and force-level which ensures a stable and safe interaction. To this aim, this thesis proposes a state-dependent dynamical system-based approach for prediction and control in physical human-robot interactions. In the first part of this dissertation, we focus on the human capacity to predict their partners' motion. More specifically, we investigate mechanisms of spatio-temporal coordination between two partners. We employ a simple scenario called âthe mirror gameâ where two individuals (human, robot, or avatar) imitate each other's motions. Our empirical assessment reveal that the intention-based prediction of the leader's motions allows the follower to compensate for perception-action delays and to improve the tracking performance in terms of temporal coordination and confidence. In the second part of this dissertation, we propose an adaptive mechanism that enables the robot to recognize the intention of a human user. We utilize state-dependent dynamical systems for motion planning and impedance control to deliver safe and compliant human-robot interaction. We consider a series of tasks (possible human intentions) encoded by dynamical system. Applying a similarity metric between the real velocities (induced by the human) and desired velocities generated by the dynamical systems, the robot is thus able to recognize the human's intention and switch to the intended task. We provide a rigorous experimental and analytical evaluation of our method yielding an interaction behavior that is safe and intuitive for the human. Finally, we tackle the compliance adaptation capability. We propose an admittance controller that reacts only when human-intentional forces are detected. Intentional and accidental forces are distinguished by measuring the persistency of the external forces, through a computation of the autocorrelation/energy of the force patterns. The overall controller exhibits variable stiffness where high stiffness allows the robot to reject the external disturbances and execute the task autonomously whereas low stiffness enables the robot to comply with human intentional forces. We demonstrate that our control architecture is effective in delivering satisfactory tracking and compliant behavior through a series of robotic experimentations.

EPFL2019

Chargement

, , , ,

Many manipulation tasks require coordinated motions for arm and fingers. Complexity increases when the task requires to control for the force at contact against a non-flat surface; This becomes even more challenging when this contact is done on a human. All these challenges are regrouped when one, for instance, massages a human limb. When massaging, the robotic arm is required to continuously adapt its orientation and distance to the limb while the robot fingers exert desired patterns of forces and motion on the skin surface. To address these challenges, we adopt a Dynamical System (DS) approach that offers a unified motion-force control approach and enables to easily coordinate multiple degrees of freedom. As each human limb may slightly differ, we learn a model of the surface using support vector regression (SVR) which enable us to obtain a distance-to-surface mapping. The gradient of this mapping, along with the DS, generates the desired motions for the interaction with the surface. A DS-based impedance control for the robotic fingers allows to control separately for force along the normal direction of the surface while moving in the tangential plane. We validate our approach using the KUKA IIWA robotic arm and Allegro robotic hand for massaging a mannequin arm covered with a skin-like material.We show that our approach allows for 1) reactive motion planning to reach for an unknown surface, 2) following desired motion patterns on the surface, and 3) exerting desired interaction forces profiles. Our results show the effectiveness of our approach; especially the robustness toward uncertainties for shape and the given location of the surface.

2020

Chargement

EPFL2019

EPFL2022