The Impact of a Multi-user Virtual Environment on Teacher Instructional Time, Voluntary Student Writing Practice, and Student Writing Achievement

Thesis (PhD) - Indiana University, School of Education, 2006Two major obstacles to using PBL methods in K-12 classrooms are the time it takes to design the rich learning environment and the time required for students to interact at their own pace with ill-structured problems. The focus of this study was to determine whether game-design design principles can be used to both compliment a digital PBL environment and improve student learning. Further, this study sought to determine whether such a design could allow teachers to act as a challenger of poorly developed knowledge constructs instead of as a font of directional and procedural knowledge for students To answer these questions a digital learning environment was designed that used embedded scaffolds, nested goals, clue trails, narrative context, and explicit rules to improve student writing. This unit was part of a larger multi-user virtual environment, but was designed to be a self-contained unit that leveraged advanced technologies to establish an immersive experience for learning writing skills. The unit was designed to be two-times per week for four weeks in total length which included student training on the active role of a reporter who investigated mysteries taking place in a virtual town. The learner then composed feature stories relating their understanding of the mystery. A comparison class was recruited and the teacher was observed teaching the same content and skill standards but through more didactic methods of instruction. The results of this study showed that the treatment condition had decreases in teacher time spent answering procedural and directional questions, increases in the amount of voluntary student writing activity, and improvements in standardized achievement scores on prompts that consisted of writing tasks similar to those that students participated in during the treatment. Students engaged fully with the learning environment although several tensions emerged. These included tensions between student perceptions of teacher rules versus system rules, student play versus completion of learning tasks, and whether they should learn through the system by reading versus being told what to do. Student disabilities were also encountered during the study which placed the system under a different kind of test than it was designed for, though it successfully engaged these students as well. A final tension arose in the result of the research methods themselves, bringing home the point that a need to capture data may interfere with the learner's experience, possibly reducing or improving the impact of the treatment itself

Computer Programming Effects in Elementary: Perceptions and Career Aspirations in STEM

The development of elementary-aged students’ STEM and computer science (CS) literacy is critical in this evolving technological landscape, thus, promoting success for college, career, and STEM/CS professional paths. Research has suggested that elementary- aged students need developmentally appropriate STEM integrated opportunities in the classroom; however, little is known about the potential impact of CS programming and how these opportunities engender positive perceptions, foster confidence, and promote perseverance to nurture students’ early career aspirations related to STEM/CS. The main purpose of this mixed-method study was to examine elementary-aged students’ (N = 132) perceptions of STEM, career choices, and effects from pre- to post-test intervention of CS lessons (N = 183) over a three-month period. Findings included positive and significant changes from students’ pre- to post-tests as well as augmented themes from 52 student interviews to represent increased enjoyment of CS lessons, early exposure, and its benefits for learning to future careers

Learning to Code: Effects of Programming Modality in a Game-based Learning Environment

As new introductory block-based coding applications for young students to learn basic computer science concepts, such as, loops and conditionals, continue to increase in popularity, it is necessary to consider the best method of teaching students these skills. Many of these products continue to exhibit programmatic misconceptions of these concepts and many students struggle with how to apply what they learn to a text-based format due to the difficulties with learning the syntactic structure not present in block-based programming languages. If the goal of teaching young students how to program is meant to develop a set of skills they may apply when learning more complex programming languages, then discerning how they are introduced to those practices is imperative. However, few studies have examined how the specific modality in which students are taught to program effects how they learn and what skills they develop. More specifically, research has yet to effectively investigate modality in the context of an educational coding game where the modality feature is controlled, and content is consistent throughout game-play. This is mainly due to the lack of available games with this feature designed into the application. This dissertation explores whether programming modality effects how well students can learn and transfer computer science concepts and practices from an educational programming game. I proposed that by being guided from a blocks-based to text-based programming language would instill a deeper understanding of basic computer science concepts and would support learning and improve transfer and performance on new challenging tasks. Two experimental studies facilitated game-play sessions on the developed application for this project. The first study was a 2x2 between subjects design comparing educational module (game versus basic) and programming modality (guided versus free choice). The findings from Study 1 informed the final version design for the module used in the second study where only the game module was used in order to focus the comparison between programming modality. Findings showed that students who coded using the game module performed better on a learning test. Study 2 results showed that students who are transitioned from blocks-based to text-based programming language learn basic computer science concepts with greater success than those with the free choice modality. A comparative study was conducted using quantitative data from learning measures and qualitative video data from the interviews during the challenge task of the second study. This study examined how students at the extreme levels of performance utilized the toggle switch feature during game-play and how the absence of the feature impacted how they completed the challenge task. This analysis showed two different methods of toggle switch usage being implemented by a high and low performing student. The high performing student utilized the resources more often during the challenge tasks in lieu of leveraging the toggle switch and were still able to submit high level code. Results suggest that a free choice student who uses the feature as a tool to check their prewritten code rather than a as short cut for piecing code together as blocks and submitting the text upon the final attempt. This practice leads to a shallower understanding of the basic concepts and make it extremely difficult to expand and apply that knowledge to a more difficult task. This dissertation includes five chapters: an introduction and theoretical framework, a game design framework and implementation description, two experimental investigations, and a quantitative and qualitative comparative analysis. Chapter one provides the conceptual and theoretical framework for the two experimental investigations. Chapter two describes the theory and design structure for the game developed for this dissertation work. Chapter three and four will discuss the effects of programming modality on learning outcomes. Specifically, chapter 3 focuses on implications of programming modality when determining how to implement changes for the design of the game for Study 2. Chapter five discusses a comparative analysis that investigated differing work flow patterns within the free choice condition between high and low performing students. Results from these three chapters illustrate the importance of examining this component of the computer science education process in supplemental games for middle and high school students. Additionally, this work contributes in furthering the investigation of these educational games and discusses implications for design of similar applications

The Relationship Between Motivation, Academic Achievement, and Engagement in Mathematics Using Digital Game-Based Learning: An Explanatory Sequential Mixed Methods Study

Digital game-based learning (DGBL) has unique factors that can engage students in the learning process. It has been shown that incorporating DGBL into mathematics can help bridge the learning gap, differentiate instruction, and engage students (Yang et al., 2018; Hulse et al., 2019; Chen et al., 2012; Naik, 2017). This study examined how students’ prior engagements are related to their academic achievement as well as investigated students’ motivation while utilizing DGBL in mathematics. An explanatory sequential mixed methods design was utilized to collect the quantitative data followed by the qualitative data. There were eighteen middle school participants in grades six through eight who all attended the same school within the Northeastern United States. The self-determination theory (SDT) served as the theoretical framework for examining the results. Data was collected through a pretest, posttest, an open-ended survey, and a closed-ended survey. The results of this study indicated that DGBL can improve academic achievement in mathematics. However, it was determined that students’ prior engagement was not related to their academic achievement. Additional research should be conducted on the motivational aspect of relatedness and DGBL since it was shown that there was a strong correlation between relatedness and the engagement themes of learning with peers and experiences with faculty

Making Waves, Mixing Colors, and Using Mirrors: The Self-Regulated Learning Support Features and Procedural Rhetoric of Three Whole-Body Educational Games

This dissertation investigates the question, How can the procedural rhetoric of three whole-body educational games improve the understanding of self-regulated learning with digital technology? It explores three whole-body educational games (WBEGs) using a quantitative study, a case study, and analyses of their procedural rhetoric to better understand the roles these types of games can have in teaching digital literacy and self-regulated learning (SRL) skills. The three WBEGs, Waves, Color Mixer, and Light and Mirrors, are each intended to teach science concepts to players. These games are similarly structured in that they all invite players to immerse themselves in the game by standing on the screen (the games project images on the floor). The WBEGs differ from traditional console video games because they receive input from players via motion-sensing technology, requiring players to make large movements with their bodies to influence elements within the game. This study explains SRL as a complex combination of internal (mental) behavior, external (observable) behavior, and interpersonal (social) behavior, identifying within three WBEGs the presence of elements supporting the SRL behaviors of goal setting, strategy planning, collaboration, progress monitoring, feedback, and reflection. These findings inform the understanding of SRL by revealing that each game includes a different combination of SRL-supporting elements that encourage the use of SRL skills in different ways. SRL scaffolding features are those elements within a WBEG that guide players to use certain SRL strategies, helping and supporting their efforts much like construction scaffolding supports a building as it is being erected. This dissertation also utilizes analyses of procedural rhetoric to investigate the techniques reinforced by the underlying structure of these three WBEGs in an effort to further the understanding of digital literacy in education and sociocultural contexts. All three WBEGs appear to emphasize player agency and collaboration. Waves and Light and Mirrors encourage player strategy, while Color Mixer rewards speed and rote knowledge. These reinforced techniques perpetuate the underlying cultural values of accuracy, collaboration, problem-solving, autonomy, and scaffolding. This study discusses these values in the contexts of education and society

Utilizing Classroom Meetings to Understand Student Values and Perceptions

This study addressed classroom meetings in order to teach social skills and address specific behavior issues. The author was completing a yearlong clinical teaching placement in a kindergarten classroom. The goal of her study was to observe what happens when class meetings are implemented to teach specific problem-areas in the classroom. In the study data was gathered through observations, student surveys, sociograms, and student interviews. The students participated in a class meeting twice a week for about thirty minutes. During the class meetings needed social skills were taught through play and role-playing activities and discussions were had to cooperatively solve specific behavior issues that happened in the classroom. Utilizing the constant comparative method the author analyzed data for major themes, which led to a better understanding of friendships, classroom meetings, difficulties encountered with kindergarten students, and insight into her students’ perceptions and understandings of school, relationships, values, and class meetings

The effects of problem-based learning scaffolds on cognitive load, problem-solving, and student performance within a multimedia-enhanced learning environment

textLearners who are novice problem solvers often encounter difficulty when solving complex problems. One explanation for this difficulty is that the cognitive requirements of problem-solving are sufficiently high that learners easily become overwhelmed and frustrated, leading to a state known as cognitive overload in which learning is obstructed. Cognitive Load Theory is concerned with the design of instructional approaches intended to manage the cognitive load required for thinking and problem-solving tasks. Scaffolds are any kind of support that facilitates the accomplishment of a difficult task that a learner would not be able to accomplish on their own. They are potential mechanisms to support students in negotiating the potentially high cognitive load required by complex problem-solving. The purpose of this study was to examine the effects of technology-based scaffolds within a problem-based learning environment known as Alien Rescue. The study investigated the impact of scaffolds on cognitive load, problem-solving behaviors, science knowledge, and student perceptions of the learning environment. Participants for this study included sixth grade students from a suburban middle school in the southwestern United States. Student classes were assigned to one of three treatment conditions: (a) a problem constraint condition in which students were guided through a problem-solving process similar to that of an expert, (b) a prompt condition in which students were provided with guiding messages during problem-solving, and (c) a control condition with no scaffolding. All conditions participated in the use of Alien Rescue for three weeks. Measures including a self-report measure of mental effort, calculated instructional efficiency scores, problem solution scores, student activity logs, and science knowledge test performance were used to evaluate students' cognitive load, problem-solving performance, problem-solving strategies, and learning gains. An open-ended questionnaire and student interviews were used to gather data on students' perceptions of the program. Results of the study indicate statistically significant differences between treatment conditions with respect to problem-solving efficiency, student problem-solving behaviors, and scientific knowledge gain. Additionally, qualitative findings highlight problematic aspects of the highly structured condition as implemented within the classroom context while also identifying components of the learning environment that were perceived as helpful and useful to participants. Teacher interviews also provided insight into classroom implementation of the program and opportunities to further enhance scaffolds to support student learning. Implications of the study from research, instructional design, and technology perspectives are discussed along with a treatment of study limitations and opportunities for further research in this area.Curriculum and Instructio

The effect of digital game-based learning on student learning: A literature review

Digital game-based learning can be used by educators to support students in developing skills. This review examined the effect of digital game-based learning on student learning at the K-12 level. Sixteen peer-reviewed research studies, two meta-analysis studies, and two literature reviews published between 2011-2019 were selected for analysis. The reviewed research indicated that when digital game-based learning is used that includes key game design elements (collaboration, choice, feedback) as well as instructional design, there typically is a positive impact on student engagement. Research also indicated that digital game-based learning along with collaboration can have a significant effect on student motivation, however, the addition of instructions and feedback were not found to have a significant effect. Individual studies on digital game-based learning showed a significant positive impact on student achievement, while one of two meta-analysis studies found that there was a small effect size for digital game-based learning on student achievement in mathematics. Further studies should be conducted on digital game-based learning at the K-12 level over an extended period of time with the addition of game design elements and instructional design. More studies where empirical/statistical data is collected, and involving content area experts in research was recommended

Using Technology to Support At-Risk Students' Learning

A new report finds that technology - when implemented properly -can produce significant gains in student achievement and boost engagement, particularly among students most at risk

Digital Games in the Science Classroom: Leveraging Internal and External Scaffolds during Game Play

We have developed a disciplinarily integrated game (DIG) to support students in interpreting, translating, and manipulating across formal representations in the domain of Newtonian kinematics. In this study, we seek to understand what game play looks like in a classroom context with particular attention given to how students leverage internal and external scaffolds to progress through the game and deepen their conceptual knowledge. We investigate the following questions: (1) In what ways do students interact with the game, with each other, and with their teacher when they play SURGE Symbolic in a classroom environment? (2) How do game scaffolds, both within and outside of the game, support or impede student learning and game play? (3) What are the implications of these observations for teachers and game designers? We found that although most students used internal scaffolds in some way to assist their game play, many found that these scaffolds were insufficient to get through challenges. They quickly sought help from external resources available to them outside the game to help them advance in the game. The source of information they needed to make progress came from various people or resources outside the game, what we are calling “knowers.