Development and Uses of Upper-division Conceptual Assessment

The use of validated conceptual assessments alongside more standard course exams has become standard practice for the introductory courses in many physics departments. These assessments provide a more standard measure of certain learning goals, allowing for comparisons of student learning across instructors, semesters, and institutions. Researchers at the University of Colorado Boulder have developed several similar assessments designed to target the more advanced physics content of upper-division classical mechanics, electrostatics, quantum mechanics, and electrodynamics. Here, we synthesize the existing research on our upper-division assessments and discuss some of the barriers and challenges associated with developing, validating, and implementing these assessments as well as some of the strategies we have used to overcome these barriers.Comment: 12 pages, 5 figures, submitted to the Phys. Rev. ST - PER Focused collection on Upper-division PE

An investigation into the knowledge and skill requirements for effective teaching of technology in english secondary schools

This thesis is concerned with the knowledge and skill requirements to teach technology education. Technology education has an important part to play in the UK economy. There is great demand to produce a technologically skilled workforce and secondary school technology education is a key element in the supply of skilled engineering technicians and graduates. Whilst there have been improvements in the number of pupils choosing to study mathematics and science there has been a decline in those studying technology. The work in this thesis has focused on the subject of Design and Technology as it provides pupils with the majority of their compulsory technology education in England. This thesis is comprised of four studies, adopting a mixed-methods approach. The first study characterised the background knowledge of Design and Technology teachers through a demographic analysis. In the second study observations were made on the adoption and teaching of a novel technology resource by trainee teachers. The third study analysed the opinions of teachers who attended a subject knowledge enhancement professional development course. In the fourth study the results of the previous studies were explored in further detail to triangulate findings and to test assumptions. In the first study the admissions data of 341 trainee Design and Technology teachers over the academic years 2000-2001 and 2013-2014 inclusive was analysed. The key finding of this analysis was that 81% of Design and Technology teachers have their entry qualification in creative arts and design and not in a technology subject. This misalignment of subject knowledge was discussed to be a result of the existing training standards and hypothesised to be contributory to the lack of technology teaching, and over emphasis of design in Design and Technology. The second study used observational methods to record how three trainee teachers adopted and taught lessons using a novel technology resource created for the study. The resource was designed to teach laser cutting and the design of mechanical systems. Subsequent analysis revealed the difficulties participants had in understanding and teaching the technology aspects of the projects. The existing practice, and collective knowledge of teachers within the schools used in the study were found to create obstacles for the trainees in trying to implement technological content. The third study developed a new professional development course for teachers to address the issues observed in the second study. The quantitative and qualitative data was obtained from 20 participant design and technology teachers before, during and after the course. Participants reported to be confidence in teaching technology, yet were unable to demonstrate a deep understanding of the subject content. Participants engaged with the procedural knowledge aspects of the course but not with the conceptual knowledge. They considered many aspects of technological and engineering content to be irrelevant to pupils. The fourth, and final, study developed questionnaires to assess teacher and pupil reactions to the provision of 57 different technology projects resources and training sessions to 82 schools across London. Useable data were generated from 33 teachers and 458 pupils. Measurements of teachers confidence in teaching the new Technology National Curriculum revealed that teachers strengths were the making of products. The weaknesses were teaching modern mechanical and electrical systems. Pupils motivation towards technology revealed positive attitudes, but they were unaffected by resources teachers considered to be novel. This study was used to triangulate the findings of the previous study and validate the claims made. The major contribution to knowledge of this thesis is the quantified description and analysis of teachers technology knowledge. The interrelationships of the distinct teacher knowledge domains were analysed to discover how they affect technology education. The main conclusion of this study is that teachers have difficulties in developing and teaching technology based schemes of work to meet the National Curriculum requirements. However, teachers appear unaware of this situation and consider themselves confident in teaching the technology curriculum topics. These difficulties have been caused by teachers lack of compatible background subject knowledge, and were evident in the teaching of projects without secure technology content. This thesis recommends that a significant intervention is required to provide support to Design and Technology teachers to develop their knowledge and skills in teaching technology

The Usage of Online Assessment Moodle LMS and Google Classroom Environment for English Language Teaching

Moodle and Google Classroom learning management systems (LMSs) generally operate in higher education and are accommodating when shifting from traditional face-to-face instruction to online courses. The study aims to examine and analyze online assessment or testing in Moodle and Google Classroom for English language learning. The study concentrated on the mixed method and the convergent parallel design. This research reveals methods to construct, adapt, and evaluate online assessments or testing in Moodle or Google Classroom. Moodle scores higher than Google Classroom in the Automated evaluation and Submission for Items evaluation aspect. On the other hand, Discussions on the Platforms and Share and Publication have a better experience with Google Classroom educators. English language lecturers or instructors exposed that Moodle comprehended Item Mean scores of 2.43, 2.42, and 2.41. it exposed those quizzes are the most common automated evaluation. Interactive multimedia applications may also be practical for online learning and assessment. However, the mean scores of 2.09, 2.16, and 2.18 revealed that comes to online learning, Moodle instructors who consider it an inadequate Google Classroom are out of touch with reality. Moodle and Google classroom scored low for the teacher aspect as implementation differences, and the finding elaborates on the opportunities and challenges of online assessment and testing. The participants noticed increased English language learners’ accomplishments and improved English lecturers’ online technical abilities. These results support the transition toward the future introduction of more online English language online course

Current Issues in Emerging eLearning, Volume 7, Issue 1: APLU Special Issue on Implementing Adaptive Learning At Scale

The second of two Specials Issues of the CIEE journal to have been produced and guest edited by the Personalized Learning Consortium (PLC) of the Association of Public and Land-grant Universities (APLU), featuring important research resulting from university initiatives to launch, implement and scale up the use of adaptive courseware and the strategies of adaptive learning

Undergraduate Curriculum and Academic Policy Committee Minutes, October 17, 2012

Minutes from the Wright State University Faculty Senate Undergraduate Curriculum and Academic Policy Committee meeting held on October 17, 2012

Student-Centered Learning: Functional Requirements for Integrated Systems to Optimize Learning

The realities of the 21st-century learner require that schools and educators fundamentally change their practice. "Educators must produce college- and career-ready graduates that reflect the future these students will face. And, they must facilitate learning through means that align with the defining attributes of this generation of learners."Today, we know more than ever about how students learn, acknowledging that the process isn't the same for every student and doesn't remain the same for each individual, depending upon maturation and the content being learned. We know that students want to progress at a pace that allows them to master new concepts and skills, to access a variety of resources, to receive timely feedback on their progress, to demonstrate their knowledge in multiple ways and to get direction, support and feedback from—as well as collaborate with—experts, teachers, tutors and other students.The result is a growing demand for student-centered, transformative digital learning using competency education as an underpinning.iNACOL released this paper to illustrate the technical requirements and functionalities that learning management systems need to shift toward student-centered instructional models. This comprehensive framework will help districts and schools determine what systems to use and integrate as they being their journey toward student-centered learning, as well as how systems integration aligns with their organizational vision, educational goals and strategic plans.Educators can use this report to optimize student learning and promote innovation in their own student-centered learning environments. The report will help school leaders understand the complex technologies needed to optimize personalized learning and how to use data and analytics to improve practices, and can assist technology leaders in re-engineering systems to support the key nuances of student-centered learning

An investigation into student and teacher perceptions of, and attitudes towards, the use of information communications technologies to support digital forms of summative performance assessment in the applied information technology and engineering studies courses in Western Australia

This study investigated the connections between teachers’ and students’ perceptions of, and attitudes towards, the use of Information and Communications Technologies (ICT) to support assessment in senior secondary courses in Western Australia, and the feasibility of such support in various forms. This investigation focused on the main characteristics of these perceptions, and attitudes and their relationships with curriculum, pedagogy, assessment and ICT. The findings provide guidelines for educators in using ICT to support summative performance assessment. My study was part of the main research study undertaken by Edith Cowan University (ECU) and the Curriculum Council of Western Australia (CCWA) and will provides significant clarity into the implementation of ICT support for performance assessment employing practices which characterise practical performance in digital forms. It was in the range of teacher and student perceptions and attitudes that this study added knowledge to the practice of digital forms of assessment. The overall intent was to design, cultivate and implement the best assessment task possible to measure the practical performance of students in Engineering Studies and Applied Information Technology (AIT). Therefore, it was also necessary to evaluate the feasibility of this task and factors that would affect feasibility such as perceptions and attitudes of particpants. To achieve this the study needed to gather data in various forms from a wide variety of sources that would allow triangluation of data analysis. Qualitative data were gathered from a student survey where a set of measurements scales were constructed. Quantitative data were assembled from observation and discussion with teachers before, during and after schools’ visits, from open-ended items in the student survey section and from teacher interview responses. In addition small groups of students were assembled into discussion forums and responses to a series of questions were recorded and analysed. A number of critical thresholds had been reached to underpin the relevance and importance of research into aspects of the use of ICT to support summative assessment. Firstly the growth in access to, and improvements, in ICT services has enabled this emergent area of digital assessment or e-assessment (JISC, 2006). However, this growth is not sufficient justification for the investigation and implementation of digital forms of assessment. The research is justified when this growth in ICT is combined with the increasing use of ICT to improve pedagogical practices; the employment of ICT to improve productivity in education; and the need to effectively and efficiently assess the practical performance of students in a large number of contexts. It was likely that the development of techniques to represent student performance in digital forms would assist the addressing of these imperatives. Whether these techniques were successful would depend on a number of influences including the attitudes and perceptions of students and teachers. When accountability and efficiency are called upon comparisions are often made with non-ICT strategies. These controlled experiment approaches can prove problematic due to ethical and political questions arising with non-ICT groups. The inherent assumptions to computer use in exams contexts are still conducted using pen and paper. In addition their lack of or slow uptake of ICT and the believed that curriculum will remain unchanged despite the introduction of ICT to support. Therefore this study took an ethnographic, rather than experimental approach, but sought to make comparisons between two key stakeholders; teachers and students. In line with the larger study of which this study was a part, data were collected using observation, interview, survey and document analysis. Analysis and interpretation included the application of a feasibility framework and case study comparison. The adoption of the Concerns Based Adoption Model (CBAM) or models based upon CBAM as an instrument to analyse data was employed in the case studies. The feasibility framework comprised four interrelated and complex parameters Manageability, Technical, Functional and Pedgogical dimensions is described in chapter eight of this study. It was evident from the research data, that students’ and teachers’ positive attutudes towards the computer-based performance exams and their beliefs in the value of ICT for assessment and all these intrinsic factors were fundamental to the feasibility of the implementation of digital forms of assessment in both Engineering Studies and AIT. From research data it was evident the application of ICT increasingly permeates students’ and teachers’ work and life, and their attitudes towards interaction with computer systems was a major factor in the success of digital forms of assessments in practical performance tasks. This was the focus and the background for this study. This study found that students in both the Engineering studies and AIT case studies attempted the assessment tasks with enthusiasm, however the AIT assessments were perceived a little more positively by students and teachers than the Engineering studies assessment. Assessment tasks worked best where the approach was familiar to students. This occurred for almost all cases in AIT, but not for Engineering although approach was relatively similar there were logisitical constraints in organising time to complete the tasks and in some cases technical in running the software on school workstations or accessing online systems through school networks. In a number of schools changes had to be mads to standard operating systems to allow software to run off USB thumb drives, video to be viewed, Flash applications to run within Internet browsers and sound to be recorded. Overall the study found that the benefits of digital forms of assessment implemented outweighted the constraints for both the Engineering studies and AIT course. In particular students’ and teachers’ responses were overwhelmingly postive due to the practical nature of the work in all assessment tasks. Generally they perferred this form of assessment to paper-based assessments. This study has added to existing knowledge on the implementing of digital forms of assessment, in particular to both the Engineering Studies and AIT, and in general to secondary senior courses in Western Australian (WA) schools

Proceedings of the 1st international workshop on software process education, training and professionalism (SPETP 2015)

These Proceedings contain the papers accepted for publication and presentation at the first 1st International Workshop on Software Process Education, Training and Professionalism (SPETP 2015) held in conjunction with the 15th International Conference on Software Process Improvement and Capability dEtermination (SPICE 2015), Gothenburg, Sweden, during June 15-17, 2015. During the 14th International Conference on Software Process Improvement and Capability dEtermination (SPICE 2014) held in Vilnius, Lithuania, at a post conference dinner, a group of key individuals from education and industry started to discuss the challenges faced for software process education, training and professionalism, especially with the background of the new modes of learning and teaching in higher education. Further discussions held post conference with key players in the relevant professional and personal certification fields led to a consensus that it is time for the industry to rise to the new challenges and set out in a manifesto a common vision for educators and trainers together with a set of recommendations to address the challenges faced. It was therefore agreed co-located the 1st International Workshop on Software Process Education, Training and Professionalism with the 15th International Conference on Software Process Improvement and Capability dEtermination. This workshop focused on the new challenges for and best practices in software process education, training and professionalism. The foundation for learning of software process should be part of a university or college education however software process is often treated as ‘add one’ module to the core curriculum. In a professional context, whilst there have been a number of initiatives focused on the certification related to the software process professional these have had little success for numerous reasons. Cooperation in education between industry, academia and professional bodies is paramount, together with the recognition of how the education world is changing and how education is resourced, delivered (with online and open learning) and taken up. Over the next 10 years on-line learning is projected to grow fifteen fold, accounting for 30% of all education provision, according to the recent report to the European Commission on New modes of learning and teaching in higher education. It is a great pleasure to see the varied contributions to this 1st International Workshop on Software Process Education, Training and Professionalism and we hope that our joint dedication, passion and innovation will lead to success for the profession through the publication of the manifesto as a key outcome from the workshop. On behalf of the SPETP 2015 conference Organizing Committee, we would like to thank all participants. Firstly all the authors, whose quality work is the essence of the conference, and the members of the Program Committee, who helped us with their expertise and diligence in reviewing all of the submissions. As we all know, organizing a conference requires the effort of many individuals. We wish to thank also all the members of our Organizing Committee, whose work and commitment were invaluable

Expansive Framing as Pragmatic Theory for Online and Hybrid Instructional Design

This article explores the complex question of how instruction should be framed (i.e., contextualized). Reports from the US National Research Council reveal a broad consensus among experts that most instruction should be framed with problems, examples, cases, and illustrations. Such framing is assumed to help learners connect new knowledge to broader “real world” knowledge, motivate continued engagement, and ensure that learners can transfer their new knowledge to subsequent contexts. However, different theories of learning lead to different assumptions about when such frames should be introduced and how such frames should be created. This article shows how contemporary situative theories of learning argue that frames should be (a) introduced before instructional content, (b) generated by learners themselves, (c) used to make connections with people, places, topics, and times beyond the boundaries of the course, and (d) used to position learners as authors who hold themselves and their peers accountable for their participation in disciplinary discourse. This expansive approach to framing promises to support engagement with disciplinary content that is productive (i.e., increasingly sophisticated, raising new questions, recognizing confusion, making new connections, etc.) and generative (i.e., supporting transferable learning that is likely to be useful and used in a wide range of subsequent educational, professional, achievement, and personal contexts). A framework called Participatory Learning and Assessment (PLA) is presented that embeds expansively framed engagement within multiple levels of increasing formal assessments. This paper first summarizes PLA as theory-laden design principles. It then presents PLA as fourteen more prescriptive steps that some may find easier to implement and to learn as they go. Examples are presented from several courses from an extended program of design-based research using this approach in online and hybrid secondary, undergraduate, graduate, and technical courses.Indiana University Office of the Vice Provost of Information Technolog

Grounding Design of Instruction: An exploration of the uses of Scientific-Based Research and Theory in the Design of Online Instruction by Faculty in Higher Education

This study was conducted to explore the processes educators in higher education used to ground their design of online instruction using scientific-based research and theory. Literature reviewed suggested reasons educators fail to ground the design of instruction were a lack of formal training in instructional methods, skills, support, and research understanding. The rationale for the study was to (a) increase understanding of how educators use scientific research and theory as a basis in decision-making during design and creation of online instruction,(b)identify best practices, and (c) add to the conversation in the instructional design field. A qualitative case study research design was utilized to interview, review course, and review documents of four participants to capture their viewpoints as to the (a) meaning of; (b) evidence; (c) step by step processes; and (d) problems associated with the processes of grounding the design of online instruction in scientific-based research and theory. Data obtained were analyzed through detailed case description, direct interpretation, cross-case analysis, pattern establishment, and naturalistic generalization. Pedagogy, instructional design, instructional technology, support, and problems emerged as key thematic issues. Findings suggested that although educators were consistent in defining meaning, followed step-by-step processes, and had evidence to support their decisions, they encountered logistical challenges of time, technology and design in the process of using scientific-based research and theory to ground the design of online instruction. The implications for practice from this research were similar to recommendations of other researchers. For this process to be smoother, regular training, peer professional interactions, and support must be present