A conceptual model for re ecting on expected learning vs. demonstrated student performance

© 2013, Australian Computer Society, Inc. Educators are faced with many challenging questions in designing an effective curriculum. What prerequisite knowledge do students have before commencing a new subject? At what level of mastery? What is the spread of capabilities between bare-passing students vs. the top-performing group? How does the intended learning specification compare to student performance at the end of a subject? In this paper we present a conceptual model that helps in answering some of these questions. It has the following main capabilities: capturing the learning specification in terms of syllabus topics and outcomes; capturing mastery levels to model progression; capturing the minimal vs. aspirational learning design; capturing confidence and reliability metrics for each of these mappings; and finally, comparing and re ecting on the learning specification against actual student performance. We present a web-based implementation of the model, and validate it by mapping the final exams from four programming subjects against the ACM/IEEE CS2013 topics and outcomes, using Bloom's Taxonomy as the mastery scale. We then import the itemised exam grades from 632 students across the four subjects and compare the demonstrated student performance against the expected learning for each of these. Key contributions of this work are the validated conceptual model for capturing and comparing expected learning vs. demonstrated performance, and a web-based implementation of this model, which is made freely available online as a community resource

The Effectiveness of Aural Instructions with Visualisations in E-Learning Environments

Based on Mayer’s (2001) model for more effective learning by exploiting the brain’s dual sensory channels for information processing, this research investigates the effectiveness of using aural instructions together with visualisation in teaching the difficult concepts of data structures to novice computer science students. A small number of previous studies have examined the use of audio and visualisation in teaching and learning environments but none has explored the integration of both technologies in teaching data structures programming to reduce the cognitive load on learners’ working memory. A prototype learning tool, known as the Data Structure Learning (DSL) tool, was developed and used first in a short mini study that showed that, used together with visualisations of algorithms, aural instructions produced faster student response times than did textual instructions. This result suggested that the additional use of the auditory sensory channel did indeed reduce the cognitive load. The tool was then used in a second, longitudinal, study over two academic terms in which students studying the Data Structures module were offered the opportunity to use the DSL approach with either aural or textual instructions. Their use of the approach was recorded by the DSL system and feedback was invited at the end of every visualisation task. The collected data showed that the tool was used extensively by the students. A comparison of the students’ DSL use with their end-of-year assessment marks revealed that academically weaker students had tended to use the tool most. This suggests that less able students are keen to use any useful and available instrument to aid their understanding, especially of difficult concepts. Both the quantitative data provided by the automatic recording of DSL use and an end-of-study questionnaire showed appreciation by students of the help the tool had provided and enthusiasm for its future use and development. These findings were supported by qualitative data provided by student written feedback at the end of each task, by interviews at the end of the experiment and by interest from the lecturer in integrating use of the tool with the teaching of the module. A variety of suggestions are made for further work and development of the DSL tool. Further research using a control group and/or pre and post tests would be particularly useful

Introductory programming: a systematic literature review

As computing becomes a mainstream discipline embedded in the school curriculum and acts as an enabler for an increasing range of academic disciplines in higher education, the literature on introductory programming is growing. Although there have been several reviews that focus on specific aspects of introductory programming, there has been no broad overview of the literature exploring recent trends across the breadth of introductory programming. This paper is the report of an ITiCSE working group that conducted a systematic review in order to gain an overview of the introductory programming literature. Partitioning the literature into papers addressing the student, teaching, the curriculum, and assessment, we explore trends, highlight advances in knowledge over the past 15 years, and indicate possible directions for future research

Supporting students’ confidence judgement through visualising alignment in open learner models

Supporting students’ knowledge monitoring skills, a component of metacognition, can help students regulate their own learning. This thesis investigates the alignment of learners’ confidence in their knowledge with a computer’s assessment of their knowledge, visualised using an Open Learner Model (OLM). The research explored students’ preferred method for visualising inconsistent data (e.g. misalignment) in an OLM, and the ways in which visualising alignment can influence student interaction with the computer. The thesis demonstrates that visualising alignment in Open Learner Models signifi-cantly increases students’ confidence compared to a control condition. In particular, visualising alignment benefited low-achieving students, in terms of knowledge monitoring and this was associated with improvements in their performance. Students showed a preference towards the visualisations that provides an overview of the in-formation (i.e. opacity) rather than ones, which provide detailed information. Graph-ical representation is shown to be more beneficial in motivating students to interact with the system than text-based representation of the same information in the con-text of representing the alignment within OLMs

The Explanatory Visualization Framework: an active learning framework for teaching creative computing using explanatory visualizations

Visualizations are nowadays appearing in popular media and are used everyday in the workplace. This democratisation of visualization challenges educators to develop effective learning strategies, in order to train the next generation of creative visualization specialists. There is high demand for skilled individuals who can analyse a problem, consider alternative designs, develop new visualizations, and be creative and innovative. Our three-stage framework, leads the learner through a series of tasks, each designed to develop different skills necessary for coming up with creative, innovative, effective, and purposeful visualizations. For that, we get the learners to create an explanatory visualization of an algorithm of their choice. By making an algorithm choice, and by following an active-learning and project-based strategy, the learners take ownership of a particular visualization challenge. They become enthusiastic to develop good results and learn different creative skills on their learning journey

Learning analytics: a case study of the process of design of visualizations

The ability to visualize student engagement and experience data provides valuable opportunities for learning support and curriculum design. With the rise of the use of learning analytics to provide actionable intelligence [1]on students\u27 learning, the challenge is to create visualizations of the data which are clear and useful to the intended audience. This process of finding the best way to visually represent data is often iterative, with many different designs being trialled before the final design is settled upon. This paper presents a case study of the process of refining a visualization of students\u27 learning experience data. In this case the aim was to create a visual representation of the continuity of care students were exposed to during a longitudinal placement as part of a medical degree. The process of visualization refinement is outlined as well as the lessons learnt along the way

Visualising alignment to support students’ judgment of confidence in open learner models

Knowledge monitoring is a component of metacognition which can help students regulate their own learning. In adaptive learning software, the system’s model of the student can be presented as an open learner model (OLM) which is intended to enable monitoring processes. We explore how presenting alignment, between students’ self-assessed confidence and the system’s model of the student, supports knowledge monitoring. When students can see their confidence and their performance (either combined within one skill meter or expanded as two separate skill meters), their knowledge monitoring and performance improves, particularly for low-achieving students. These results indicate the importance of communicating the alignment between the system’s evaluation of student performance and student confidence in the correctness of their answers as a means to support metacognitive skills

The affordances of virtual world technologies to empower the visualisation of complex theory concepts in computer science: Enhancing success and experience in higher education

Abstract:This research targeted complex abstract concepts in Computer Science and focused on bringing about the visualisation of such concepts using virtual world technologies. The research proposed the use of virtual world elements to support the understanding and learning of six computer science subjects having difficult theory concepts at the Higher Education level.The researcher decided to choose Higher Education as the platform for this research, due to the significant need to understand and learn complex abstract concepts of Computer Science at this level. The framework of the research is Higher Education within Further Education, which was chosen for its challenging nature with regards to students’ background and the level of additional support required for their success.The Second Life virtual world was selected and utilised to build purposely designed and scripted scenarios to empower the visualisation of complex theory concepts of the selected computer science subjects. These scenarios were embedded, in a predetermined order, within the curriculum delivery of a number of selected Computer Science modules from a Foundation Degree and a BSc (Hons) in Computing Programmes in a FE college in England. The research activities were carried out in two academic years, 2012/2013 and 2013/2014, in order to involve more students and obtain additional data to effectively, and more accurately, answer the research questions.The research aimed at identifying the extent to which using virtual world technologies to visualise difficult theory concepts in Computer Science subjects, might enhance students' learning and achievement. The research outcomes provided positive answers to the four research questions, which pursued the extent to which the visualisation of such concepts using Second life virtual world might, 1) facilitate students’ understanding of the complex abstract concepts in their HE Computer Science subjects, 2) increase students’ engagement in their HE Computer Science sessions, 3) enhance affective quality (to include elements such as appeal, enjoyment, interest and appreciation), and 4) improve student’s achievement (i.e. grades) in the targeted modules.In answer to these questions, the research outcomes showed that subject difficulty was reduced by 25% and around three quarters of students acknowledged enhanced learning in the virtual environment. Seventy percent of students acknowledged becoming more engaged in their study sessions that were carried out in virtual worlds, and more than three quarters of students acknowledged enhanced affective quality. Finally, around 85% of the modules covered by the research witnessed improved students’ achievement (i.e. higher grades).The researcher explained potential use, advantages and limitations of employing Second Life in Higher Education in general and HE Computer Science in particular, and provided recommendations to academic institutions that are interested in applying such virtual world technologies to overcome the challenges involved

Encouraging the Acquistion of Drawing Skills in Game Design: a Case Study

Undergraduate, Interactive Games Design (IGD) courses offered by technical universities in the UK recruit students who are not required to have art or design backgrounds. However, they need to be able to represent their creative ideas. Observations at the University of Gloucestershire have shown that many students find difficulties in expressing their ideas in a visual manner as they do not have adequate drawing skills and eventually some focus on coding and some withdraw. This thesis investigates the links between game design and drawing skills, examining concepts of creativity, learning, design communication and education. To establish the basis of this problem, it was necessary to gain an insight into students‘ and tutors‘ viewpoints and interpretation of this course. Using an interpretive philosophical framework, a mixed method approach was chosen to allow for greater opportunity to understand the phenomenon. Within an action research paradigm, the research was carried out in an evolutionary manner. The extent of the problem was established by eliciting tutors‘ insight from other institutions both arts and technical based. A case study was set out to study two cohorts of students. This identified the problems reported by students and the impact of these on students‘ attitude and motivation. The nature and necessity of drawing skills for sketching storyboards were explored by gaining views of students, tutors and industry professionals. The effect of the tutor-led Art interventions at UoG was investigated. The research identified criteria to assess the quality of storyboard communications and finally a framework for an e-learning object to develop storyboard communication skills was specified. This study revealed that obtaining visual skills is fundamental in order to be able to draw or use rapid prototyping techniques for storyboarding. This needs to be addressed in a specified module or several sessions. It appeared that the design of an art intervention (tutor-based or e-learning object) for IGD students, needs to address the issues of confidence and teamwork alongside with the learning materials in a constructive and gamified style and as interactive as possible in a structured goal-based manner. It would also benefit from Active learning teaching style