Formative Assessment Design: A Balancing Act

Formative assessment has been considered a promising way to support student learning. It has been defined as both an instrument and a process. The instrument provides information about a student’s learning. During the process, the information is judged and used by teachers, students, or their peers for actions that support that learning. Teachers have difficulty understanding and using the evidence from assessment instruments. Therefore, this dissertation investigates what content and visual presentation of a formative assessment instrument could help teachers. The dissertation consists of five studies: -A theoretical study about the validation of formative assessment. -A needs assessment, which investigated the type of instructional actions as well as the information needs to enable these actions. -A evaluation study investigating the usability of a formative assessment platform -A factorial study investigating the extent to which visualizations of measurement error in score reports influence teachers’ instructional decisions. -A study that explores how to visualize a learning trajectory that can be used for the purpose of formative assessment. With regard to the content of formative assessment instruments, we concluded that the instrument needs: 1. Fine-grained information about students’ current performance (e.g., learning strategies, misconceptions); 2. Information about students’ desired performance (e.g., learning objectives, learning trajectory); 3. Directions to follow-up actions (e.g., learning materials, suggestions for grouping). With regard to the visual presentation of formative assessment instruments, we concluded that: 1. Measurement error presentations affect teachers’ decisions, however, several misconceptions were identified. 2. A graphical visualization might be the most appropriate way to present possible learning pathways. Several design principles for visualization were identified in relation to the content, structure, and usability of the learning trajectory. Overall, this dissertation shows that it is necessary and fruitful to design and evaluate assessment instruments with the intended audience in order to ensure that they will understand and use the assessment results in an appropriate way

Validation and Evaluation of a Tool for Developing an Integrated View of ICT-Based Educational Innovation

The increasing digitalization of education requires an integrated view of innovation and related expertise development. This study validated and evaluated the content and use of the ”Integrated ICT Motion Sensor”, a tool for stimulating awareness about ICT-based educational innovation among multiple stakeholders within higher education institutions. The Motion Sensor offers administrators, managers, ICT specialists, educational designers, and lecturers a guiding tool for entering into a dialogue about substantive themes such as vision and policy, leadership, professional development, and ICT infrastructure within the institution. The validation of the content by questionnaires and a focus group with 10 experts showed that the experts’ input was almost in line with the Motion Sensor prototype, which was based on the literature. The use of the Motion Sensor was evaluated in a pilot study within four higher educational institutions. Results from the questionnaires showed that participants generally appreciated the nature and course of the conversation. Moreover, the Motion Sensor led to more awareness about ICT-based educational innovation among participants