Brain-coupled Interaction for Semi-autonomous Navigation of an Assistive Robot

This paper presents a novel semi-autonomous navigation strategy designed for low throughput interfaces. A mobile robot (e.g. intelligent wheelchair) proposes the most probable action, as analyzed from the environment, to a human user who can either accept or reject the proposition. In case of refusal, the robot will propose another action, until both entities agree on what needs to be done. In an unknown environment, the robotic system first extracts features so as to recognize places of interest where a human-robot interaction should take place (e.g. crossings). Based on the local topology, relevant actions are then proposed, the user providing answers by the mean of a button or a brain-computer interface (BCI). Our navigation strategy is successfully tested both in simulation and with a real robot, and a feasibility study for the use of a BCI confirms the potential of such interface.

Bayesian Controller for a Novel Semi-Autonomous Navigation Concept

Ricardo Andres Chavarriaga Lozano, Xavier Perrin, Roland Siegwart

This paper presents a novel concept of semi-autonomous navigation where a mobile robot evolves autonomously under the monitoring of a human user. The user provides corrective commands to the robot whenever he disagrees with the robot's navigational choices. These commands are not related to navigational values like directions or goals, but to the relevance of the robot's actions to the overall task. A binary error signal is used to correct the robot's decisions and to bring it to the desired goal location. This simple interface could easily be adapted to input systems designed for disabled people, offering them a convenient alternative to existing assistive systems. After a description of the whole concept, a special focus is given to the decisional process, which takes into account in a Bayesian way the environment perceived by the robot and the user generated signals in order to propose a navigational strategy to the human user. The strength and advantages of the proposed semi-autonomous concept are illustrated with two experiments. {\em Keywords}: Semi-autonomous navigation, error signal, probabilistic reasoning, human-machine interaction.

IDIAP2007

Shoaling with fish: using miniature robotic agents to close the interaction loop with groups of zebrafish Danio rerio

Frank Bonnet

Robotic animals are nowadays developed for various types of research, such as bio-inspired robotics, biomimetics and animal behavior studies. The miniaturization of technologies and the increase in performance of embedded systems allowed engineers to develop more powerful, sophisticated and miniature devices. The case of robotic fish is a typical example of such challenging design: the fish locomotion and body movements are difficult to reproduce and the device has to move autonomously underwater. More specifically, in the case of collective animal behavior research, the robotic device has to interact with animals by generating and exploiting signals relevant for social behavior. Once perceived by the animal society as conspecific, these robots can become powerful tools to study the animal behaviors, as they can at the same time monitor the changes in behavior and influence the collective choices of the animal society. In this work, we present novel robotized tools that can integrate shoals of fish in order to study their collective behaviors. This robotic platform is composed of two subsystems: a miniature wheeled mobile robot that can achieve dynamic movements and multi-robot long-duration experiments, and a robotic fish lure that is able to beat its tail to generate fish-like body movements. The two subsystems are coupled with magnets which allows the wheeled mobile robot to steer the robotic fish lure so that it reaches very high speeds and accelerations while achieving shoaling. An experimental setup to conduct studies on mixed societies of artificial and living fish was designed to facilitate the experiments for biologists. A software framework was also implemented to control the robots in a closed-loop using data extracted from visual tracking that retrieved the position of the robots and the fish. We selected the zebrafish Danio rerio as a model to perform experiments to qualify our system. We used the current state of the art on the zebrafish social behavior to define the specifications of the robots, and we performed stimuli analysis to improve their developments. Bio-inspired controllers were designed based on data extracted from experiments with zebrafish for the robots to mimic the zebrafish locomotion underwater. Experiments involving a robot with a shoal of fish in a constrained environment showed that the locomotion of the robot was one of the main factor to affect the collective behavior of zebrafish. We also shown that the body movements and the biomimetic appearance of the lure could increase its acceptance by fish. Finally, an experiment involving a mixed society of fish and robots qualified the robotic system to be integrated among a zebrafish shoal and to be able to influence the collective decisions of the fish. These results are very promising for the field of fish-robot interaction studies, as we showed the effect of the robots in long-duration experiments and repetitively, with the same order of response from the animals.

EPFL2017

Comprehensive Interactive Soft Interfaces for Wearable Tactile Feedback

Harshal Arun Sonar

As the field of robotics continues to grow outside the manufacturing environment into our daily lives, the interactions between humans and robots are increasingly becoming close and dynamic. This type of environment requires robots to be less rigid, multi-functional, safer, and compliant with human bodies. Such robotics interfaces are ideally suited for medical rehabilitation, elderly assistance to at-home entertainment devices. However, the traditional rigid robotic devices fail to address some of the design criteria posed for safety, compliance, and physical limitations on the mechanical design. In the case of wearable technologies, the robotic device additionally requires a lightweight, compliant, and safe interface to provide smooth communication and interaction with humans. The traditional robotic systems are fast, accurate, and can handle large torques. However, they are also, application-specific and not suitable as it is for the wearable scenario due to the contradictory design requirements. In the past decade, soft robotics has emerged as a novel approach to solve the complex problems faced by rigid robots using inherent softness and compliant material properties. The design for the future interactive wearable interfaces thus may lie in the intersection of developments in the fields of wearable technology and soft robotics.Designing a wearable interactive interface with soft materials for wearability, portability, cost-effectiveness, and modularity would be one of the ideal solutions to tackle the wearability challenge. It can be a cost-effective solution for at-home assistive rehabilitation or entertainment. It also allows developing novel methods of soft sensing, actuation, control strategies, and human in loop protocols to maximize the utility of inherent material properties and environment around the robotic device.In my Ph.D. research, I develop and create hardware and software towards an immersive interactive soft virtual-tactile environment focusing on the wearability, portability, easy customization, and modularity aspects. I developed a low profile soft pneumatic actuator-skin (SPA-skin) with distributed sensing and actuation capabilities for testing various levels of complex vibrotactile feedback: the multilayer composite of high-sensitivity PZT pressure sensors and vibratory SPA can produce up to 3 N output force at 0-100 Hz. This demonstrated that SPA-skin produces distinctive and dynamic haptic force feedback under modulated varying time, force, and spatial resolution. Furthermore, a complete framework for designing a tactile feedback skin for specific wearable applications is developed, starting from the material selection and actuator design, and concluding with the validation of the subjectâs perceived feedback. As soon as, the SPA-skin is required to be worn by humans, the complexity of the problem multiplies due to lack of proper grounding to ensure the blocked forces. The platform is further optimized for application space in fMRI compliant environment and a user study protocol for somatosensory thresholds is designed. The modulable and controllable nature of SPA-skinâs tactile feedback provides much-needed validation using BOLD signals from brain imaging. SPA-skin and findings presented herein, provide a foundational platform to further investigate the sensitivity of human skin and decipher mechanoreceptor reactions for a diverse range of human-robot interactions and wearable technology.