Adventures in Paragraph Writing: The Development and Refinement of Scalable and Effective Writing Exercises for Large-enrollment Engineering Courses

Adventures in paragraph writing: the development and refinement of scalable and effective writing exercises for large enrollment engineering courses. The ability to communicate effectively is a highly desirable attribute for today’s graduating engineers. Additionally, the inclusion of communication components in technical courses has been shown to enhance learning of technical content and can be leveraged to satisfy non-technical learning outcomes. However, the incorporation of such components in undergraduate engineering curricula remains challenging due to resource limitations, credit hour crunches, and other issues. This paper presents the design considerations and preliminary results from our ongoing work to create an effective, transferrable, low-overhead approach to paragraph writing exercises suitable for inclusion in any large engineering course. Key considerations in the development of these exercises include: identification of the motivations and learning outcomes for each exercise; development and tailoring of writing prompts (questions) appropriate for these outcomes; and the development and implementation of an assessment and feedback strategy,including resource-efficient grading rubrics and techniques.Results are reported from the application of the paragraph writing exercise in a large civil engineering undergraduate fluid mechanics course (120 students; approximately 15 assignments). A primary focus of this first application centered on two key components that must be refined in order for the exercise to be effective and transferrable: (1) the selection of writing prompts, and (2) assessment and feedback. Analysis of student paragraphs highlights the importance of the writing prompts in the success of the exercise, indicating that specific word choice, question focus, and supplemental instruction greatly affected the level of writing students submitted. Some writing prompts were selected to address and enhance technical content in the course, while other writing prompts were developed to broaden student awareness of engineering in societal, environmental, and global contexts. In addition to developing productive writing prompts, the assessment and feedback strategies were evaluated using student surveys and feedback. While minimal marking and holistic rubric assessment methods proved effective from a grading resource standpoint, students were frustrated by the lack of feedback associated with these techniques and uncomfortable with the holistic grading rubric. Data from student surveys point to the importance of giving meaningful feedback to students, and providing them with opportunities to revise their written submissions. Student surveys also highlighted an unforeseen obstacle to the exercise: student resistance to writing in technical courses. We provide several suggestions for overcoming student resistance, as well as improved assessment and feedback strategies that better meet student needs while still not over-burdening instructors and teaching assistants

Online Assessment in Large Undergraduate Courses During COVID-19 Emergency Response Teaching

The transition to online instruction during the COVID-19 pandemic was unprecedented and forced many universities to quickly embrace online distance learning. This context created new challenges, particularly around assessment strategies. Empirical research has demonstrated that formative assessment fosters more active learning in online classrooms. However, formative assessment strategies are not always adapted well to online platforms based on the nature of the subject matter and the size of the class. This qualitative case study sought to understand instructors’ experiences and strategies for conducting assessment remotely, specifically for large-size undergraduate courses. The investigation relied on data from semi-structured interviews with University of Maryland, College Park instructors who received a Teaching Innovation Grant from the Provost’s Office in Summer 2020 intended to fund sustainable online delivery beyond the emergency response teaching phase. For this analysis, we analyzed the transcripts of 13 interviews, representing a diverse range of programs, schools, and faculty seniority levels at the university. Findings show instructors experienced several successes during course retooling, including significant increases in student performance. Most instructors also indicated that they would continue to keep new online assessment strategies for the future, regardless of whether that future includes online, blended, or in-person delivery. Despite the anticipation that the pandemic would fuel more opportunities for cheating, there was only one experience of academic dishonesty

A CASE STUDY OF PEER ASSESSMENT IN A MOOC-BASED COMPOSITION COURSE: STUDENTS’ PERCEPTIONS, PEERS’ GRADING SCORES VERSUS INSTRUCTORS’ GRADING SCORES, AND PEERS’ COMMENTARY VERSUS INSTRUCTORS’ COMMENTARY

Although the use of peer assessment in MOOCs is common, there has been little empirical research about peer assessment in MOOCs, especially composition MOOCs. This study aimed to address issues in peer assessment in a MOOC-based composition course, in particular student perceptions, peer-grading scores versus instructor-grading scores, and peer commentary versus instructor commentary. The findings provided evidence that peer assessment was well received by the majority of student participants from their perspective as both peer evaluators of other students’ papers and as students being evaluated by their peers. However, many student participants also expressed negative feelings about certain aspects of peer assessment, for example peers’ lack of qualifications, peers’ negative and critical comments, and unfairness of peer grading. Statistical analysis of grades given by student peers and instructors revealed a consistency among grades given by peers but a low consistency between grades given by peers and those given by instructors, with the peer grades tending to be higher than those assigned by instructors. In addition, analysis of peer and instructor commentary revealed that peers’ commentary differed from instructors’ on specific categories of writing issues (idea development, organization, or sentence-level). For instance, on average peers focused a greater percentage of their comments (70%) on sentence-level issues than did instructors (64.7%), though both groups devoted more comments to sentence-level issues than to the two other issue categories. Peers’ commentary also differed from instructors’ in the approaches their comments took to communicating the writing issue (through explanation, question, or correction). For example, in commenting on sentence-level errors, on average 85% of peers’ comments included a correction as compared to 96% of instructors’ comments including that approach. In every comment category (idea development, organization, sentence-level), peers used a lower percentage of explanation—at least 10% lower—than did instructors. Overall, findings and conclusions of the study have limitations due to (1) the small size of composition MOOC studied and small sample size of graded papers used for the analysis, (2) the lack of research and scarcity of document archives on issues the study discussed, (3) the lack of examination of factors (i.e. level of education, cultural background, and English language proficiency) that might affect student participants’ perception of peer assessment, and (4) the lack of analysis of head notes, end notes, and length of comments. However, the study has made certain contributions to the existing literature, especially student perception of peer assessment in the composition MOOC in this study. Analysis of the grades given by peers and instructors in the study provides evidence-based information about whether online peer assessment should be used in MOOCs, especially composition MOOCs and what factors might affect the applicability and consistency of peer grading in MOOCs. In addition, analysis of the data provides insights into types of comments students in a composition MOOC made as compared to those instructors made. The findings of the study as a whole can inform the design of future research on peer assessment in composition MOOCs and indicate questions designers of peer assessment training and practice in such MOOCs could find helpful to consider

Weaving Academic Grace into the Fabric of Online Courses and Faculty Training: First-Year Engineering Student Advice for Online Faculty During the COVID-19 Pandemic and Faculty Responses

Background: In the spring of 2020, COVID-19 forced the majority of higher education online, resulting in a wave of new online students uniquely positioned to offer fresh perspectives and advice to faculty. Purpose: This study investigated the advice offered to online faculty by first-year engineering (FYE) students who were forced online during the pandemic and faculty ideas to address the student advice. Methods: This multi-methods study included qualitative data from 233 FYE students (in 67 teams across four class offerings) who provided advice for online faculty through an end-of-year team assignment, leveraging analytic induction methods for analysis. The Quality Matters Online Instructor Skill Set was used as the theoretical framework for viewing the student results (Quality Matters, 2016). After being presented with the student results, 41 faculty participants within two workshops brainstormed ways to respond to FYEs’ advice. Faculty workshop participants organized their own brainstorming/discussion results by themes within community documents. Results: Students forced online expressed the following needs/desires: instructional design practices appropriate for the online environment; understanding, flexibility, and patience from their faculty (which we defined as Academic Grace); instructor social presence; appropriate pedagogy for online learning environments; effective assessment; technologically capable instructors; and instructor understanding of their institutional context. Faculty advised responding to online students with more Academic Grace. Conclusions: This work reveals a new competency missing from traditional online instructor skills, that of Academic Grace. To embed Academic Grace within online courses, we propose that faculty consider a flexible bichronous model for online courses, in which students can choose to attend synchronous live lectures/classes or cover the material asynchronously at their own convenience. In this model, lecture/class recordings and supplemental asynchronous materials should be provided to foster fluid student movement between the learning modes. We also recommend online faculty training efforts include the components of Academic Grace: understanding, flexibility, and patience

Challenges and opportunities for classroom-based formative assessment and AI: a perspective article

The integration of artificial intelligence (AI) into educational contexts may give rise to both positive and negative ramifications for teachers’ uses of formative assessment within their classrooms. Drawing on our diverse experiences as academics, researchers, psychometricians, teachers, and teacher educators specializing in formative assessment, we examine the pedagogical practices in which teachers provide feedback, facilitate peer- and self-assessments, and support students’ learning, and discuss how existing challenges to each of these may be affected by applications of AI. Firstly, we overview the challenges in the practice of formative assessment independently of the influence of AI. Moreover, based on the authors’ varied experience in formative assessment, we discuss the opportunities that AI brings to address the challenges in formative assessment as well as the new challenges introduced by the application of AI in formative assessment. Finally, we argue for the ongoing importance of self-regulated learning and a renewed emphasis on critical thinking for more effective implementation of formative assessment in this new AI-driven digital age

MOOCs: Expectations and Reality

This comprehensive study of MOOCs from the perspective of institutions of higher education includes an investigation of definitions and characteristics of MOOCs, their origins, institutional goals for developing and delivering MOOCs, how MOOC data is being used, a review of MOOC resource requirements and costs, and a compilation of ideas from 83 interviewees about MOOCs and the future of higher education. We identify six major goals for MOOC initiatives and assess the evidence regarding whether these goals are being met, or are likely to be in the future

Moving Toward Blended Learning: A Multiple Case Design Based Research Study In Higher Education

The purpose of this multiple case design-based research study was to determine what elements were needed to assist two higher education instructors inexperienced in designing and teaching a blended learning course to successfully create and implement it, to document the instructors’ perceptions about their first experience of teaching a blended learning course, and to reveal how this blended learning course influenced student satisfaction. The goal of the study was to iteratively design, develop, implement, evaluate and redesign a desired blended learning course based on constructivist design theory, cognitive learning theory, and ARCS motivational design theory over the three iterative phases. This design-based research approach used a mixed study of quantitative and qualitative research methods including student surveys, instructor interviews, learning environment and observations. Quantitative data in terms of determining any change in the level of students’ motivation between the beginning of the semester and the end of the semester, and students’ motivational attitude toward the use of instructional activities and tools at the fifth and tenth week of the semester was collected. Multiple choice comprehensive pretest and posttest surveys were given to students to detect changes in their motivation level, and a multiple choice comprehensive survey was given to students to detect their motivational attitude. Qualitative data in terms of identifying the need of appropriate technological processes and resources to create a desired blended learning course, enhancing the effectiveness and efficiency of the blended learning course, and revealing instructor perceptions about teaching a blended learning course was collected over the three iterative designed intervention phases. Instructor perceptions were captured through in-depth interviews, and the strengths and weaknesses of the blended learning environment were ascertained through observations. The results of this study demonstrated Blackboard Learn (Learning Management System) and Google Documents were two beneficial learning resources to create a desired blended learning environment. The design and implementation of these learning resources enabled the instructors to shift from a passive teaching style to an active teaching style. Students became active and interactive learners through the adoption of active learning approaches and transactional collaborative learning approaches in the designed blended learning environments. Through the process of three iterative design cycles, the blended learning environments were modified to optimize the efficiency and effectiveness of learning activities and maximize the quality of learning and teaching experiences. The results also revealed that the instructors’ overall perception was positive toward taking part in combining online and face-to-face learning and they were satisfied with teaching a blended learning course. Lastly, findings from the paired t-test completed in SPSS which compared the students’ motivation level in the beginning of the semester and the end of the semester were not statistically significant in both cases