3D Tangibles Facilitate Joint Visual Attention in Dyads

Sébastien Cuendet, Pierre Dillenbourg, Kshitij Sharma, Guillaume Zufferey
2015
Article de conférence

Résumé

We report results from a dual eye-tracking study around a Tangible User Interface (TUI). Participants (N=54) worked in groups of two and solved optimization problems on the TinkerTable, a TUI designed for students in logistics. The TinkerTable features tangible shelves that students can manipulate to build and optimize the layout of a warehouse while the system provides feedback with a projector above the table. Using mobile eye-trackers, we examined participants’ visual coordination when solving those problems. We describe two contributions to the CSCL community: first, we propose a methodology for synchronizing two eye-tracking goggles and computing measures of joint visual attention (JVA) in a co-located setting. Second, we report preliminary findings suggesting that participants were more likely to have moments of joint attention when looking at 3D, realistic objects compared to 2D, abstract ones. JVA was also found to be a significant predictor of students’ learning gains and performance during the optimization tasks. We discuss implications of these findings for supporting interactions around a TUI.

Official source

https://infoscience.epfl.ch/record/223609?ln=fr

À propos de ce résultat

Cette page est générée automatiquement et peut contenir des informations qui ne sont pas correctes, complètes, à jour ou pertinentes par rapport à votre recherche. Il en va de même pour toutes les autres pages de ce site. Veillez à vérifier les informations auprès des sources officielles de l'EPFL.

Concepts associés

Chargement

Publications associées

Chargement

Leveraging mobile eye-trackers to capture joint visual attention in co-located collaborative learning groups

Sébastien Cuendet, Pierre Dillenbourg, Kshitij Sharma, Guillaume Zufferey

This paper describes a promising methodology for studying co-located groups: mobile eye-trackers. We provide a comprehensive description of our data collection and analysis processes so that other researchers can take advantage of this cutting-edge technology. Data were collected in a controlled experiment where 27 student dyads (N=54) interacted with a Tangible User Interface. They first had to define some design principles for optimizing a warehouse layout by analyzing a set of Contrasting Cases, and build a small-scale layout based on those principles. The contributions of this paper are that: 1) we replicated prior research showing that levels of Joint Visual Attention (JVA) are correlated with collaboration quality across all groups; 2) we then qualitatively analyzed two dyads with high levels of JVA and show that it can hide a free-rider effect (Salomon and Globerson 1989); 3) in conducting this analysis, we additionally developed a new visualization (augmented cross-recurrence graphs) that allows researchers to distinguish between high JVA groups that have balanced and unbalanced levels of participations; 4) finally, we generalized this effect to the entire sample and found a significant negative correlation between dyads' learning gains and unbalanced levels of participation (as computed from the eye-tracking data). We conclude by discussing implications for automatically analyzing students' interactions using dual eye-trackers.

SPRINGER2018

Chargement

Tangible interfaces: when physical-virtual coupling may be detrimental to learning

Sébastien Cuendet, Pierre Dillenbourg, Patrick Jermann

Tangible user interfaces (TUIs) have been the focus of much attention recently in the HCI and learning communities. Although TUIs seem to intuitively offer potential to increase the learning experience, there have been questions about whether they actually impact learning positively. TUIs offer new ways of interactions and it is essential to understand how the design choices made for these new interactions affect learning. One element that is key in the learning process is how and when feedback is provided. In this article, we focus on the effect of co-located immediate process-level feedback on learning. We report the results of a study in which 56 participants used a TUI to complete tasks related to the training of spatial skills. Half of the students accomplished the tasks with immediate and co-located feedback from the system, while the other half of the students did not receive any feedback. Results show that participants who did not receive feedback manipulated less, reflected more, and in the end learned more than those who received feedback.

2012

Chargement

, , ,

: Prior work has successfully described how low and high-performing dyads of students differ in terms of their visual synchronization (e.g., Barron, 2000; Jermann, Mullins, Nuessli & Dillenbourg, 2011). But there is far less work analyzing the diversity of ways that successful groups of students use to achieve visual coordination. The goal of this paper is to illustrate how well-coordinated groups establish and sustain joint visual attention by unpacking their different strategies and behaviors. Our data was collected in a dual eye-tracking setup where dyads of students (N=54) had to interact with a Tangible User Interface (TUI). We selected two groups of students displaying high levels of joint visual attention and compared them using cross-recurrence graphs displaying moments of joint attention from the eye-tracking data, speech data, and by qualitatively analyzing videos generated for that purpose. We found that greater insights can be found by augmenting cross-recurrence graphs with spatial and verbal data, and that high levels of joint visual attention can hide a free-rider effect (Salomon & Globerson, 1989). We conclude by discussing implications for automatically analyzing students’ interactions using dual eye-trackers.

2016

Chargement