Multimodal Assessment in Action: What We Really Value in New Media Texts

As the Framework for Success in Postsecondary Writing illustrates, writing teachers at all educational levels can no longer ignore multimodality and the challenges that come with incorporating multimodal writing—texts composed using a combination of sound, images, video, etc.—into the classroom (NCTE, Framework). A chief struggle most writing teachers face is how to evaluate the multimodal texts their students produce, texts that are inherently diverse. In answer to the calls of scholars such as Yancey, Herrington, and Moran for research exploring multimodal assessment in situated classroom practice, my dissertation examines what K-16 writing teachers are and should be valuing in multimodal compositions and why. By investigating what practitioners and theorists value in new media texts, we can better align our multimodal assessment theories and practices to support effective instruction and assessment of multimodal writing. My study brings together theory and practice to provide guidance for writing teachers to navigate the challenges of multimodal assessment. My findings culminate in a multimodal assessment heuristic based in “design” that allows for the evaluation of not only the product, but also the situated composing practices of writers (Purdy). First inspired by my analysis of the multimodal assessment scholarship, then validated by both my analysis of the assignment sheets and interviews, my design-based assessment model provides a flexible, theoretically-grounded approach to multimodal assessment that reflects what this study suggests writing teacher-scholars most value in their students’ new media texts. My design-based multimodal assessment model integrates the three primary theoretical orientations that most influence multimodal assessment: multiliteracies/multimodality, rhetoric and composition, and new media. It forefronts the importance of valuing students’ situated composing processes and highlights multimodality’s goal of developing writer’s metacognitive awareness and sense of agency. A design-based approach to multimodal assessment emphasizes materially aware composing practices that introduce students to new composing technologies and the principles of graphic design, while not overemphasizing the technology itself. And it places rhetorical savvy as the primary objective. Finally, a design-based approach to multimodal assessment helps break down the dichotomy between print-based and digital texts, pushing writing teachers to embrace the notion that all texts are multimodal

Characterizing argumentation structure within the asynchronous, online communication of novice engineering design students

textPracticing argumentation in secondary school classrooms benefits students both in terms of learning how to argue and learning the course material at hand. Amidst the onset and growth of engineering design courses in secondary schools, this dissertation is an exploratory case study to characterize the use of argumentation among novice student engineering designers. The setting is a high school robotics class. Specifically, a group of students from one class section teamed up with a group of students from a separate class section to design and build a single robot. The team members communicated online via a shared, editable document. That text is the primary data set for my analysis. I looked for indications of argumentation structure that emerged from the online discussion, given that, to my knowledge, the students had not been taught argumentation strategies, per se. Engineering design is relatively new to secondary school, so I thought it appropriate to develop a baseline—a case study that reveals how students communicate about their designs when left largely to their own devices. This study may inform the development argumentation scaffolds that support the students’ existing strengths while ameliorating their weaknesses. My analytical supposition was that argumentation in design will take the form of resolving differences of opinion toward the creation of a single design. Hence, I used Pragma-dialectic theory as my analytical framework. It is a broad theory, based upon resolving differences of opinion in everyday conversation. As such, Pragma-dialectic theory may also be able to encompass the idiosyncrasies of team design, such as reliance on intuition and experience, as well as the important roles that designed objects play throughout the process. Taken together, the importance of intuition, experience, and objects suggests multiple modes of communication that ought to be considered arguments within design deliberations. Results suggest that the students worked to resolve differences of design opinions. In doing so, the students relied heavily on their designed objects to make their arguments meaningful. I classified five object-based claims which emerged from the students’ discussions: keystone, tinkering, visual, tactile, and counterfactual. These form the beginnings of a theory of object-based argumentation.Science, Technology, Engineering, and Mathematics Educatio

Self-directed multimodal learning in higher education

This book aims to provide an overview of theoretical and practical considerations in terms of self-directed multimodal learning within the university context. Multimodal learning is approached in terms of the levels of multimodality and specifically blended learning and the mixing of modes of delivery (contact and distance education). As such, this publication will provide a unique snapshot of multimodal practices within higher education through a self-directed learning epistemological lens. The book covers issues such as what self-directed multimodal learning entails, mapping of specific publications regarding blended learning, blended learning in mathematics, geography, natural science and computer literacy, comparative experiences in distance education as well as situated and culturally appropriate learning in multimodal contexts. This book provides a unique focus on multimodality in terms of learning and delivery within the context of self-directed learning. Therefore, the publication would not only advance the scholarship of blended and open distance learning in South Africa, but also the contribute to enriching the discourse regarding self-direction. From this book readers will get an impression of the latest trends in literature in terms of multimodal self-directed learning in South Africa as well as unique empirical work being done in this regard

Self-directed multimodal learning in higher education

This book aims to provide an overview of theoretical and practical considerations in terms of self-directed multimodal learning within the university context. Multimodal learning is approached in terms of the levels of multimodality and specifically blended learning and the mixing of modes of delivery (contact and distance education). As such, this publication will provide a unique snapshot of multimodal practices within higher education through a self-directed learning epistemological lens. The book covers issues such as what self-directed multimodal learning entails, mapping of specific publications regarding blended learning, blended learning in mathematics, geography, natural science and computer literacy, comparative experiences in distance education as well as situated and culturally appropriate learning in multimodal contexts. This book provides a unique focus on multimodality in terms of learning and delivery within the context of self-directed learning. Therefore, the publication would not only advance the scholarship of blended and open distance learning in South Africa, but also the contribute to enriching the discourse regarding self-direction. From this book readers will get an impression of the latest trends in literature in terms of multimodal self-directed learning in South Africa as well as unique empirical work being done in this regard

Teachers’ Perspectives on Multimodal Texts in Middle School Reading Language Arts Classrooms in the Rio Grande Valley

Literacy in the 21st century includes multiple modes of communication that include culturally and linguistic diverse representation. It also includes multimodal texts that use visual, audio, and technological elements to create meaning. The new changing technologies have expanded literacy to more than print and written forms. Literacy instruction has seen pedagogical changes, especially during the COVID-19 pandemic. Educators need to explore new literacy practices that benefit the growing diversity in societies along with the fast-growing technologies. Students need skills and mentoring to navigate digital learning platforms. Literacy in the 21st century includes multimodal texts, technology, nontraditional literacy skills, and multiliteracies. Recent literacy research shows an increasing implementation of multimodal literacies; thus, there is little to no research on teachers\u27 perspectives and students\u27 literacy development. This study offers insight into teachers\u27 perspectives on multimodal texts in middle school Reading Language Arts classrooms. Teachers’ perspectives regarding the ongoing changes to literacy and the digital world can provide understandings of how teachers are developing students’ literacy skills

Leveraging Multimodal Learning Analytics to Understand How Humans Learn with Emerging Technologies

Major education and training challenges are plaguing the United States in preparing the next generation of the future workforce to meet the demands of the 21st Century. Several calls have been released to improve education programs to ensure learners are acquiring 21st century knowledge, skills, and abilities (KSAs). As we embark on the digital and automation ages of the 21st century, it is essential that we move away from traditional education programs that define and measure KSAs as static constructs (e.g., standardized assessments) with little consideration of the actual real-time deployment of these processes, missing critical information on the degree to which learners are acquiring and applying 21st century KSAs. The objective of this dissertation is to use 1 book chapter and 2 journal articles to illustrate the value in leveraging emerging technologies and multimodal trace data to define and measure scientific thinking, reflection, and self-regulated learning--core 21st century skills, across contexts, domains, tasks, and populations (e.g., medical versus undergraduates versus middle-school students). Chapters 2-4 of this dissertation provide evidence of ways to leverage multimodal trace data guided by theoretical perspectives in cognitive and learning sciences, with a special focus in self-regulated learning, to assess the extent to which learners engaged in scientific thinking, reflection, and self-regulated learning during learning activities with emerging technologies. Overall, results from these chapters illustrate that it is necessary to utilize methods that capture learning processes as they unfold during learning activities that are guided by theoretical perspectives in self-regulated learning. Findings from this research hold significant broader impacts for addressing the education and training challenges in the United States by collecting multimodal trace data over the course of learning to not only detect and identify how learners are developing KSAs such as scientific thinking, reflection, and self-regulated learning, but where these data could be fed into an intelligent and adaptive system to repurpose it back to trainers, teachers, instructors, and learners for just-in-time interventions and individualized feedback. The intellectual merit of this dissertation focuses predominantly on the importance of utilizing rich streams of multimodal trace data that are mapped onto different theoretical perspectives on how humans self-regulate across tasks like clinical reasoning, scientific thinking, and reflection with emerging technologies such as a game-based learning environment called Crystal Island. Discussion is incorporated around ways to leverage multimodal trace data on undergraduate, middle-school, and medical student populations across a range of tasks including learning about microbiology to problem solving with a game-based learning environment called Crystal Island and clinically reasoning about diagnoses across emerging technologies

Digital Games For 21st Century Learning: Teacher Librarians\u27 Beliefs And Practices

Digital games as tools for learning in K–12 have been a topic of intense discussion over the last 15 years. One area of focus has been on the integration of commercial off-the-shelf games in lesson plans. A predictive factor for the adoption and integration of digital games is the attitudes or readiness of teachers. Yet, while many studies have examined this with teachers themselves, teacher librarians (TLs) have largely been ignored, despite the key role they play in education and technology adoption in schools. This study attempted to determine TLs’ beliefs and practices about digital games as 21st century learning tools, to examine similarities and differences with those of classroom teachers, and to see if and how TLs’ pedagogical beliefs impacted their perceptions of barriers toward digital game adoption. The Teachers’ Attitudes Toward Games (TATG) Survey measured TLs’ perceptions of barriers to using digital games. Findings suggest that TLs tended to use digital games to address discrete library skills—a behaviorist practice—despite the fact that they tended to hold constructivist pedagogical beliefs. Though, evidence showed that some were using games to integrate 21st century skills into classroom lessons. Similar to findings on classroom teachers, TLs perceived lack of time, lack of infrastructure, and lack of support as barriers to using digital games. Furthermore, TLs with behaviorist beliefs tended to perceive greater barriers to using digital games as compared to TLs with constructivist beliefs

Learning through assessment

This book aims to contribute to the discourse of learning through assessment within a self-directed learning environment. It adds to the scholarship of assessment and self-directed learning within a face-to-face and online learning environment. As part of the NWU Self-Directed Learning Book Series, this book is devoted to scholarship in the field of self-directed learning, focusing on ongoing and envisaged assessment practices for self-directed learning through which learning within the 21st century can take place. This book acknowledges and emphasises the role of assessment as a pedagogical tool to foster self-directed learning during face-to-face and online learning situations. The way in which higher education conceptualises teaching, learning and assessment has been inevitably changed due to the COVID- 19 pandemic, and now more than ever we need learners to be self-directed in their learning. Assessment plays a key role in learning and, therefore, we have to identify innovative ways in which learning can be assessed, and which are likely to become the new norm even after the pandemic has been brought under control. The goal of this book, consisting of original research, is to assist with the paradigm shift regarding the purpose of assessment, as well as providing new ideas on assessment strategies, methods and tools appropriate to foster self-directed learning in all modes of delivery

Self-Directed Learning

This book on self-directed learning (SDL) is devoted to original academic scholarship within the field of education, and is the 6th volume in the North-West University (NWU) SDL book series. In this book the authors explore how self-directed learning can be considered an imperative for education in a complex modern society. Although each chapter represents independent research in the field of self-directed learning, the chapters form a coherent contribution concerning the scholarship of self-directed learning, and specifically the effect of environmental and praxis contexts on the enhancement of self-directed learning in a complex society. The publication as a whole provides diverse perspectives on the importance of self-directed learning in varied contexts. Scholars working in a wide range of fields are drawn together in this scholarly work to present a comprehensive dialogue regarding self-directed learning and how this concept functions in a complex and dynamic higher education context. This book presents a combination of theory and practice, which reflects selected conceptual dimensions of self-directed learning in society, as well as research-based findings pertaining to current topical issues relating to implementing self-directed learning in the modern world. The varied methodologies provide the reader with different and balanced perspectives, as well as varied and innovative ideas on how to conduct research in the field of self-directed learning

After-School Programs: Impact on the Academic Outcomes of Elementary Students in a Rural School

The purpose of this quantitative, causal-comparative study was to determine if there is a difference in academic achievement between first-, second-, and third-grade students who attended a 21st Century Community Learning Center after-school program and first-, second-, and third-grade students who did not attend a 21st Century Community Learning Center after-school program. There is limited research investigating the effect of after-school programs on the academic achievement of students from rural school settings. Offering quality after-school programs in rural communities is important to meet the needs of students and families and promote positive academic and social outcomes. The sample (N=1062) included first-, second-, and third-grade students who attended a 21st Century Community Learning Center funded after-school program and first-, second-, and third-grade students who did not attend an after-school program. Multivariate analysis of covariance was used to compare student performance on STAR reading and STAR math benchmark assessments. There was no significant difference in STAR reading scores and STAR math scores between first-, second-, or third-graders who participated in a 21st Century Community Learning Center after-school program and those who did not. Recommendations for future research include using a random sample from a larger population, a longitudinal study comparing participants and non-participants over multiple years, and a mixed methods study analyzing participation, academic achievement, and staff training and experience