Tracing Teacher Collaborative Learning and Innovation Adoption: a Case Study in an Inquiry Learning Platform

Social processes play an important role in teachers' ongoing professional learning: through interactions with peers and experts to solve problems or co-create materials, teachers internalize knowledge developed in their communities. However, these social processes and their influence on teachers' learning (i.e., adopting new practices) are notoriously hard to study, given their implicit and informal nature. In this paper, we apply the Knowledge Appropriation Model (KAM) to trace how different social processes relate with the implementation of pedagogical innovations in the classroom (as a marker of professional learning), through the analysis of more than 20,000 artifacts from Go-Lab, an online community to support inquiry-based learning. Our results not only show how different social processes like sharing or co-creation seem to be related to increased classroom implementation. Also, they provide insights on how we can use traces from digital co-creation platforms, to better understand the social dimension of professional learning.

Mapping biological ideas: Concept maps as knowledge integration tools for evolution education

Beat Adrian Schwendimann

Many students leave school with a fragmented understanding of biology that does not allow them to connect their ideas to their everyday lives (Wandersee, 1989; Mintzes, Wandersee, & Novak, 1998; Mintzes, Wandersee, & Novak, 2000a). Understanding evolution ideas is seen as central to building an integrated knowledge of biology (Blackwell, Powell, & Dukes, 2003; Thagard & Findlay, 2010). However, the theory of evolution has been found difficult to understand as it incorporates a wide range of ideas from different areas (Bahar et al., 1999; Tsui & Treagust, 2003) and multiple interacting levels (Wilensky & Resnick, 1999; Duncan & Reiser, 2007; Hmelo-Silver et al., 2007). Research suggests that learners can hold a rich repertoire of co-existing alternative ideas of evolution (for example, Bishop & Anderson, 1990; Demastes, Good, & Peebles, 1996; Evans, 2008), especially of human evolution (for example, Nelson, 1986; Sinatra et al., 2003; Poling & Evans, 2004). Evolution ideas are difficult to understand because they often contradict existing alternative ideas (Mayr, 1982; Wolpert, 1994; Evans, 2008). Research suggests that understanding human evolution is a key to evolution education (for example, Blackwell et al., 2003; Besterman & Baggott la Velle, 2007). This dissertation research investigates how different concept mapping forms embedded in a collaborative technology-enhanced learning environment can support students’ integration of evolution ideas using case studies of human evolution. Knowledge Integration (KI) (Linn et al., 2000; Linn et al., 2004) is used as the operational framework to explore concept maps as knowledge integration tools to elicit, add, critically distinguish, group, connect, and sort out alternative evolution ideas. Concept maps are a form of node-link diagram for organizing and representing connections between ideas as a semantic network (Novak & Gowin, 1984). This dissertation research describes the iterative development of a novel biology-specific form of concept map, called Knowledge Integration Map (KIM), which aims to help learners connect ideas across levels (for example, genotype and phenotype levels) towards an integrated understanding of evolution. Using a design-based research approach (Brown, 1992; Cobb et al., 2003), three iterative studies were implemented in ethnically and economically diverse public high schools classrooms using the web-based inquiry science environment (WISE) (Linn et al., 2003; Linn et al., 2004). Study 1 investigates concept maps as generative assessment tools. Study 1A compares the concept map generation and critique process of biology novices and experts. Findings suggest that concept maps are sensitive to different levels of knowledge integration but require scaffolding and revision. Study 1B investigates the implementation of concept maps as summative assessment tools in a WISE evolution module. Results indicate that concept maps can reveal connections between students’ alternative ideas of evolution. Study 2 introduces KIMs as embedded collaborative learning tools. After generating KIMs, student dyads revise KIMs through two different critique activities (comparison against an expert or peer generated KIM). Findings indicate that different critique activities can promote the use of different criteria for critique. Results suggest that the combination of generating and critiquing KIMs can support integrating evolution ideas but can be time-consuming. As time in biology classrooms is limited, study 3 distinguishes the learning effects from either generating or critiquing KIMs as more time efficient embedded learning tools. Findings suggest that critiquing KIMs can be more time efficient than generating KIMs. Using KIMs that include common alternative ideas for critique activities can create genuine opportunities for students to critically reflect on new and existing ideas. Critiquing KIMs can encourage knowledge integration by fostering self-monitoring of students’ learning progress, identifying knowledge gaps, and distinguishing alternative evolution ideas. This dissertation research demonstrates that science instruction of complex topics, such as human evolution, can succeed through a combination of scaffolded inquiry activities using dynamic visualizations, explanation activities, and collaborative KIM activities. This research contributes to educational research and practice by describing ways to make KIMs effective and time efficient learning tools for evolution education. Supporting students’ building of a more coherent understanding of core ideas of biology can foster their life-long interest and learning of science.

University of California, Berkeley2011

Gaze Analysis methods for Learning Analytics

Kshitij Sharma

Eye-tracking had been shown to be predictive of expertise, task-based success, task-difficulty, and the strategies involved in problem solving, both in the individual and collaborative settings. In learning analytics, eye-tracking could be used as a powerful tool, not only to differentiate between the levels of expertise and task-outcome, but also to give constructive feedback to the users. In this dissertation, we show how eye-tracking could prove to be useful to understand the cognitive processes underlying dyadic interaction; in two contexts: pair program comprehension and learning with a Massive Open Online Course (MOOC). The first context is a typical collaborative work scenario, while the second is a special case of dyadic interaction namely the teacher-student pair. We also demonstrate, using one example experiment, how the findings about the relation between the learning outcome in MOOCs and the students' gaze patterns can be leveraged to design a feedback tool to improve the students' learning outcome and their attention levels while learning through a MOOC video. We also show that the gaze can also be used as a cue to resolve the teachers' verbal references in a MOOC video; and this way we can improve the learning experiences of the MOOC students. This thesis is comprised of five studies. The first study, contextualised within a collaborative setting, where the collaborating partners tried to understand the given program. In this study, we examine the relationship among the gaze patterns of the partners, their dialogues and the levels of understanding that the pair attained at the end of the task. The next four studies are contextualised within the MOOC environment. The first MOOC study explores the relationship between the students' performance and their attention level. The second MOOC study, which is a dual eye-tracking study, examines the relation between the individual and collaborative gaze patterns and their relation with the learning outcome. This study also explores the idea of activating students' knowledge, prior to receiving any learning material, and the effect of different ways to activate the students' knowledge on their gaze patterns and their learning outcomes. The third MOOC study, during which we designed a feedback tool based on the results of the first two MOOC studies, demonstrates that the variables we proposed to measure the students' attention, could be leveraged upon to provide feedback about their gaze patterns. We also show that using this feedback tool improves the students' learning outcome and their attention levels. The fourth and final MOOC study shows that augmenting a MOOC video with the teacher's gaze information helps improving the learning experiences of the students. When the teacher's gaze is displayed the perceived difficulty of the content decreases significantly as compared to the moments when there is no gaze augmentation. In a nutshell, through this dissertation, we show that the gaze can be used to understand, support and improve the dyadic interaction, in order to increase the chances of achieving a higher level of task-based success.

EPFL2015

Instruction, Student Engagement and Learning Outcomes: A Case Study Using Anonymous Social Media in a Face-to-face Classroom

Denis Gillet, Adrian Christian Holzer, Maria Jesus Rodriguez Triana

With the wide availability of mobile devices and the growing interest in social media, numerous applications have emerged to support student engagement in the classroom. There is conflicting evidence, however, on whether the engagement benefits of such applications outweigh their potential cost as a source of disaffection. To investigate these issues, this paper presents a case study on the usage of a social media app (SpeakUp) during a semester-long face-to-face university course, and its relations with the context and the learning outcomes. In this mixed-methods study, we gathered data from multiple sources (video recordings of the lessons, SpeakUp logs and messages, student questionnaires and course assessments) in order to extract self-reported and observable behavioral and emotional indicators. Our findings reveal that simple measures of behavioral engagement were insufficient to predict academic performance. Nevertheless, our models significantly improved using relatively simple and unobtrusive indicators of both behavioral and emotional engagement and disaffection. This study also points out that the mere introduction of social media in educational settings does not guarantee a positive impact on learning. To promote an effective use of social media in the classroom (raising engagement while avoiding disaffection), teachers need to design the learning activities aligning the use of social media with the learning goals.