Development and Comparison of Foot Interfaces for Controlling a Robotic Arm in Surgery

Currently available foot interfaces to command an external assistive robotic arm for laparoscopic surgery typically consist of a couple of push buttons placed on a planar platform. In this paper, we develop and compare two foot interfaces implementing isotonic vs. elastic isometric control strategies. A four DOF robotic arm is used as the slave robot to evaluate both interfaces and their corresponding control strategies. This robot is controlled by foot's translation/rotation in the isotonic interface and by force/torque in the elastic isometric interface. The isotonic interface is used for position control, and the isometric interface for rate control. An experimental study mimicking a laparoscopic surgery task was conducted to compare the performance with these two systems, in which the slave robot is used as an endoscope holder controlled by the foot in the specific interface. The subjects strongly preferred using the elastic isometric interface, which they found more intuitive and less tiring. The low physical burden of this interface allows the users to concentrate on the main task of manipulation. Also, they preferred the rate control as it provides them with a more accurate control on the slave robot.

Control and Learning of Compliant Manipulation Skills

Klas Jonas Alfred Kronander

Humans demonstrate an impressive capability to manipulate fragile objects without damaging them, graciously controlling the force and position of hands or tools. Traditionally, robotics has favored position control over force control to produce fast, accurate and repeatable motion. For extending the applicability of robotic manipulators outside the strictly controlled environments of industrial work cells, position control is inadequate. Tasks that involve contact with objects whose positions are not known with perfect certainty require a controller that regulates the relationship between positional deviations and forces on the robot. This problem is formalized in the impedance control framework, which focuses the robot control problem on the interaction between the robot and its environment. By adjusting the impedance parameters, the behavior of the robot can be adapted to the need of the task. However, it is often difficult to specify formally how the impedance should vary for best performance. Furthermore, fast it can be shown that careless variation of the impedance can lead to unstable regulation or tracking even in free motion. In the first part of the thesis, the problem of how to define a varying impedance for a task is addressed. A haptic human-robot interface that allows a human supervisor to teach impedance variations by physically interacting with the robot during task execution is introduced. It is shown that the interface can be used to enhance the performance in several manipulation tasks. Then, the problem of stable control with varying impedance is addressed. Along with a theoretical discussion on this topic, a sufficient condition for stable varying stiffness and damping is provided. In the second part of the thesis, we explore more complex manipulation scenarios via online generation of the robot trajectory. This is done along two axes 1) learning how to react to contact forces in insertion tasks which are crucial for assembly operations and 2) autonomous Dynamical Systems (DS) for motion representation with the capability to encode a family of trajectories rather than a fixed, time-dependent reference. A novel framework for task representation using DS is introduced, termed Locally Modulated Dynamical Systems (LMDS). LMDS differs from existing DS estimation algorithms in that it supports non-parametric and incremental learning all the while guaranteeing that the resulting DS is globally stable at an attractor point. To combine the advantages of DS motion generation with impedance control, a novel controller for tasks described by first order DS is proposed. The controller is passive, and has the properties of an impedance controller with the added flexibility of a DS motion representation instead of a time-indexed trajectory.

EPFL2015

Control of Contact Tasks in Autonomous and Human-Robot Collaborative Scenarios: A Dynamical System Approach

Walid Amanhoud

Robotic systems are more and more present in our daily life. Robots became indeed more economical, easy to program, safe and collaborative in their interaction with humans, versatile in performing different tasks and adaptive towards changes in the environment. Despite the recent advances in robotics, developingfully autonomous robots to achieve complex industrial or daily-life tasks is still very challenging. The human, due to his superior perception, understanding and reasoning skills, especially in uncertain environment, needs to be in the loop. Therefore, the ability of robots to collaborate with humans is of great interest inthe robotics community. Human-Robot Collaboration usually implies robots that share the control of the tasks with humans, providing adjustable autonomy level and mutual adaptation. A field that can particularly benefits from such collaboration is assistive robotics surgery. The introduction of shared autonomyin surgical tasks has several advantages. In particular, it can provide higher accuracy, flexibility, control and efficiency during the operation, over longer time periods, relieve the surgeon during repetitive tasks and reduce his mental workload. However, it is not very clear how to best use shared control to assist asurgeon during the operation. As part of a research project (the "Surgical project"), in this thesis we would like to propose solutions to that problem by building a teleoperated shared control architecture for a laparoscopic surgery scenario. While laparoscopic surgery usually involves one surgeon and two humanassistants to perform the surgery, the project aims to replace the assistants by two partially teleoperated robotic systems. The target shared control architecture would explore various strategies to ensure safety for both the patient and the surgeon, provide accuracy and stability in motion and force control of the toolsattached to the robots, reduce the mental workload of the surgeon and adapt the level of assistance based on well-identified criteria.The first year was mainly devoted to the control of motion and force for contact tasks which is of great importance in the context of the project. Robot force control is traditionally achieved either explicitly through hybrid position/force control or implicitly using impedance control. We propose an approach leveraging theproperties of dynamical systems (DS) for immediate re-planning and robustness to real-time perturbations by exploiting local modulation of the DS. Dynamical systems has been widely used as a tool to represent and generate motion in robotics application. Here the idea is to propose a DS formulation to generatecontact force in addition to motion. First implementation and experiments to evaluate the effectiveness of the strategy were conducted in practice with a 7-DOF robotic arm (KUKA LWR IV+).So far we focused on contact tasks that were performed autonomously by one or two robots. Future work will improve and use the proposed DS approach to consider contact tasks in shared control scenarios where one human and one or two robots need to collaborate to successfully achieve the tasks. Because of the nature of the surgical project we will use teleoperation systems to introduce the human in the loop. The developed teleoperated shared control architecture will be evaluated on laparoscopic surgery related tasks.

EPFL2021

Concept of Modular Kinematics to Design Ultra-high Precision Parallel Robots

Murielle Richard

Miniaturisation will be the key challenge for the next decade in numerous industrial fields, such as microelectronics, optics and biomedical engineering. Although most of their products already achieve footprints of some square millimeters, the trend towards the integration of a maximum number of elements in a minimal volume requires even more compact components. This tendency creates a growing need for industrial robots able to perform micromanipulation and microassembly tasks with a submicrometric precision. Nonetheless, the design of such machines is nowadays costly, both in time and money, mostly because of the twofold complexity of their development: first, from a kinematic standpoint, the use of a parallel structure consists in a particularly interesting approach to build ultra-high precision robots. However, the synthesis of such a kinematics proves especially challenging for machines presenting more than 3 degrees of freedom. Moreover, the resulting robots are scarcely flexible: if the industrial specifications are modified, which for example necessitates to add a degree of freedom or to change the position of a rotation centre, the design process has to be restarted, often from the very beginning. The second challenge consists in the mechanical design of flexure-based mechanisms: flexure hinges are joints which are based on the elasticity of the matter. They allow to perform motions which are without friction, backlash and wear; their use is thus mandatory to achieve the aimed submicrometric precision. Albeit the synthesis of planar and low-degree of freedom structures is now widely investigated, the development of a whole tridimensional flexure-based robot is still infrequent, especially in the industrial context. This thesis thus introduces a modular design methodology which significantly reduces the time-to-market of ultra-high precision robots. This procedure can be compared to a robotic Lego, where a finite number of conceptual building bricks allows to easily design and modify parallel robots. Furthermore, this work shows that the machines resulting from this approach present similar or even improved performances compared to robots developed more traditionally. The key aspect of this thesis consists in the concept of modular kinematics, which aims at facilitating the synthesis of parallel kinematics thanks to solution catalogues. At this step of the methodology, the conceptual building bricks and the kinematics are totally independent from any mechanical design: they can thus be used to synthesise a large variety of robots, from machine-tools to microscale robots. An exhaustive conceptual solution catalogue groups all kinematics generated by the combination of the building bricks. Then, a reduced solution catalogue for ultra-high precision is proposed: based on selection criteria linked with the design and machining of flexure-based mechanisms, it allows to reduce the total number of solutions and thus facilitates the practical use of the concept. The second part of this work details the mechanical design of the building bricks, whose main challenge consists in increasing the ratio between the working ranges of the mechanisms and their overall size. One or more flexure-based solutions have been developed for each motorised brick: a special emphasis is given to the original use of a Remote Centre of Motion, which allows to achieve high rotation angles while drastically reducing parasitic translations. The development of a standardised actuation sub-brick, common to all motorised bricks, introduces a new level of modularity, thus increasing even more the flexibility of the methodology. As for non-actuated bricks, original designs and uncommon uses of well-known mechanisms are proposed. A case study on a 5-degree of freedom robot, Legolas 5, finally illustrates the practical use of the methodology: first, the selection in the solution catalogue of a kinematics adapted to the specifications of the robot is detailed. Then, the development of the Legolas 5 prototype highlights the mechanical design of the necessary building bricks, as well as assembly subtleties, such as force alignment and gravity compensation, which allow to shrewdly design a high-performance robot. The measurements of this machine have shown motion resolution and repeatability of 50 nm in translation and 1.9 µrad in rotation (limited by the sensor resolution). This case study has generated the Legolas family, a new family of ultra-high precision parallel robots, which notably includes the orthogonal version of the Delta kinematics: using only 6 of the conceptual building bricks, one solution can be built for each of the 19 possible robot mobilities. The promising characterisation of the Legolas 5 tends to suggest that the robots from this family will be interesting candidates to fulfill the upcoming need for quickly designed and high-performance industrial ultra-high precision machines.

EPFL2012