Interface utilisateur tangible

vignette|Reactable, un exemple d'interface utilisateur tangible Une interface utilisateur tangible est une interface utilisateur sur laquelle l'utilisateur interagit avec l'information numérique par le moyen de l'environnement physique. L'objectif de développement des interfaces utilisateur tangibles est d'encourager la collaboration, l'éducation et le design (conception) en donnant à l'information digitale une forme physique, profitant ainsi des capacités humaines de saisir et de manipuler des objets physiques et des matériaux. Caractéristiques Les principales caractéristiques des tables tangibles interactives peuvent être résumées comme suit : les représentations physiques sont couplées par calcul à des informations numériques sous-jacentes, ainsi que les représentations physiques incarnent des mécanismes de contrôle interactif. Encore, les représentations physiques sont couplées aux représentations numériques activement médiatisées et l'état physique des objets tangib

Supporting Reflection and Classroom Orchestration with Tangible Tabletops

Lenh Hung Son Do

Tangible tabletop systems have been extensively proven to be able to enhance participation and engagement as well as enable many exciting activities, particularly in the education domain. However, it remains unclear as to whether students really benefit from using them for tasks that require a high level of reflection. Moreover, most existing tangible tabletops are designed as stand-alone systems or devices. Increasingly, this design assumption is no longer sufficient, especially in realistic learning settings. Due to the technological evolution in schools, multiple activities, resources, and constraints in the classroom ecosystem are now involved in the learning process. The way teachers manage technology-enhanced classrooms and the involved activities and constraints in real-time, also known as classroom orchestration, is a crucial aspect for the materialization of reflection and learning. This thesis aims to explore how educational tangible tabletop systems affect reflection, how reflection and orchestration are related, and how we can support reflection and orchestration to improve learning. It presents the design, implementation, and evaluations of three tangible tabletop systems – the DockLamp, the TinkerLamp, and the TinkerLamp 2.0 – in different learning contexts. Our experience with these systems, both inside and outside of the laboratory, results in an insightful understanding of the impacts of tangible tabletops on learning and the conditions for their effective use as well as deployment. These findings can be beneficial to the researchers and designers of learning environments using tangible tabletop and similar interfaces.

EPFL2012

Tangible Interfaces for Learning

Sébastien Cuendet

There have been many claims that Tangible User Interfaces (TUIs) can have a positive impact on learning. Alleged benefits include increasing usability, improving engagement and collaboration of students, and providing a better perception of the task, especially spatial ones. However, there exists little empirical data to back up these claims. Moreover, for all their potential benefits for learning, TUIs are still scarcely used in schools. This thesis explores these two issues in the specific context of vocational education and training of carpenter apprentices. The learning objectives concern spatial skills and in particular, the mapping between 2D and 3D representations. We study (1) whether TUIs can support the training of spatial skills, and if so what features allow them to do so, and (2) what kinds of classroom pedagogical scenarios TUIs can support. We follow a design-based research approach and run empirical studies, mostly in classrooms. The contributions of this thesis touch on three research domains:

Spatial skills. Our results show that TUIs can help teach spatial skills to carpenter apprentices. The tangible nature of TUIs can help the learner relate multiple representations of an object, especially for difficult problems. It can also lower the barrier to entry into a learning domain for beginners.
Learning with TUIs. According to our results, TUIs can benefit learning, but the mere fact of using TUIs does not guarantee learning. Instead, special attention needs to be given to the design of the TUI. Small design variations, such as the physical correspondence between the tangible object and its virtual representations, or the type and timing of feedback given to the user, can have a significant impact on learning.
Classroom technologies and orchestration. We explore several classroom pedagogical scenarios that TUIs can support. The most promising one is to use a TUI as part of a hybrid classroom learning activity that includes both TUI and non TUI steps. Additionally, we devise two ways to promote the integration of TUIs in classroom. First, we introduce 5 design principles that reduce the classroom orchestration load. Second, we show how new web technologies can be used to deploy TUIs in schools at a lower cost.

EPFL2013

The Complementarity of Tangible and Paper Interfaces in Tabletop Environments for Collaborative Learning

Guillaume Zufferey

The current trend in Human-Computer Interaction aims at bridging the gap between the digital and the real world, exploring novel ways to engage users with computational devices. Computers take new forms that are better integrated into our environment and can be embedded in buildings, furniture or clothes. Novel forms of interfaces take advantage of people's intuitive knowledge of everyday objects to offer more direct and natural interactions. Tangible User Interfaces (TUIs) allow users to interact with digital objects through tangible artifacts, building on their rich physical affordances. Paper User Interfaces (PUIs) add digital capabilities to paper documents, synchronizing for instance their content with their digital counterpart. Unique properties of paper are also used to create engaging and intuitive interfaces to computer applications. This dissertation is interested in the complementarity of tangible and paper interfaces in tabletop environments. We introduce the concept of Tangible and Paper Environments (TaPEs) where Interactive Paper Forms (IPFs), a particular type of PUIs based on the paper form metaphor, are used as a complementary interface to a TUI. We evaluate the potential of IPFs to overcome two main shortcomings of TUIs, in terms of scalability and pedagogy. The scalability issue comes from the limited expressiveness of task-specific physical artifacts, which offer rich physical affordances but limit the complexity of applications that can be controlled by a TUI. The pedagogy issue is raised by the lack of consistent evidence regarding the use of physical manipulatives in educational settings, which is one of the main application domain of TUIs. IPFs overcome the scalability issue by offering a set of generic interaction elements that allow TaPEs to cope with applications of any complexity. In a pedagogical setting, IPFs present learners with abstract representation which facilitate understanding by the embodied and concrete representations offered by tangible artifacts. A TaPE, the Tinker Environment, has been developed with two logistics teachers in the context of the Swiss vocational training system. It consists of a warehouse physical small-scale model (TUI) and TinkerSheets, our implementation of IPFs. It aims at helping apprentices understand theoretical concepts presented at schools. We followed a Design-based Research (DBR) approach: ten studies were conducted during the development of the Tinker Environment in authentic classroom settings. Controlled experiments were conducted to address specific questions. v The general research questions concern the respective affordances of paper and tangible components of TaPEs. The analysis is not limited to usability aspects but also considers their impact on group problem-solving activities and their potential in terms of integration of the system in its context of use. A descriptive model is proposed, built around three interaction circles: individual (usability), group (collaboration) and context (integration). Results identify design guidelines that limit the impact of the less direct interaction modality offered by IPFs, allowing TaPEs to overcome the scalability issue while supporting rich interactions. At the group level, observations of groups of apprentices solving problems around the Tinker Environment show that the consistent physical interaction modality offered by TaPEs naturally supports collaborative interactions. Apprentices tend to take implicit roles based on their location around the system. Regarding the context circle, we observed that carefully designed IPFs play the role of bridges between offline and online activities and contribute to a tight integration of the system in a its context (i.e. a classroom). The specific research questions address the potential of the Tinker Environment in this pedagogical context and its appropriation by teachers. The observations conducted with the Tinker Environment show that the warehouse small-scale model reduces the complexity of problems and allows apprentices to engage in meaningful problem-solving activities. Controlled experiments comparing a TUI to a mulitouch interface demonstrate that tangible artifacts lead to a higher learning gain and an increased performance in a problem-solving activity. Collaboration quality and perceived playfulness are also improved. The teacher plays a central role in the use of the environment, guiding apprentices through activities and encouraging reflections during debriefing sessions. The design of IPFs, emphasizing either their interface or document nature, has a strong influence on their ability to support teachers. We finally discuss the two-way adaptation process that took place between teachers and the system during the development of the Tinker Environment.

EPFL2010