A review of Australasian investigations into problem solving and the novice programmer

This Australasian focused review compares a number of recent studies that have identified difficulties encountered by novices while learning programming and problem solving. These studies have shown that novices are not performing at expected levels and many novices have only a fragile knowledge of programming, which may prevent them from learning and applying problem solving strategies. The review goes on to explore proposals for explicitly incorporating problem solving strategy instruction into introductory programming curricula and assessment, in an attempt to produce improved learning outcomes for novices. Finally, directions suggested by the reviewed studies are gathered and some unanswered questions are raised

The abstraction transition taxonomy: developing desired learning outcomes through the lens of situated cognition

We report on a post-hoc analysis of introductory programming lecture materials. The purpose of this analysis is to identify what knowledge and skills we are asking students to acquire, as situated in the activity, tools, and culture of what programmers do and how they think. The specific materials analyzed are the 133 Peer Instruction questions used in lecture to support cognitive apprenticeship -- honoring the situated nature of knowledge. We propose an Abstraction Transition Taxonomy for classifying the kinds of knowing and practices we engage students in as we seek to apprentice them into the programming world. We find students are asked to answer questions expressed using three levels of abstraction: English, CS Speak, and Code. Moreover, many questions involve asking students to transition between levels of abstraction within the context of a computational problem. Finally, by applying our taxonomy in classifying a range of introductory programming exams, we find that summative assessments (including our own) tend to emphasize a small range of the skills fostered in students during the formative/apprenticeship phase

Analysis reuse exploiting taxonomical information and belief assignment in industrial problem solving

To take into account the experience feedback on solving complex problems in business is deemed as a way to improve the quality of products and processes. Only a few academic works, however, are concerned with the representation and the instrumentation of experience feedback systems. We propose, in this paper, a model of experiences and mechanisms to use these experiences. More specifically, we wish to encourage the reuse of already performed expert analysis to propose a priori analysis in the solving of a new problem. The proposal is based on a representation in the context of the experience of using a conceptual marker and an explicit representation of the analysis incorporating expert opinions and the fusion of these opinions. The experience feedback models and inference mechanisms are integrated in a commercial support tool for problem solving methodologies. The results obtained to this point have already led to the definition of the role of ‘‘Rex Manager’’ with principles of sustainable management for continuous improvement of industrial processes in companies

Assessment and learning outcomes: the evaluation of deep learning in an on-line course

Using an online learning environment, students from European countries collaborated and communicated to carry out problem based learning in occupational therapy. The effectiveness of this approach was evaluated by means of the final assessments and published learning outcomes. In particular, transcripts from peer-to-peer sessions of synchronous communication were analysed. The SOLO taxonomy was used and the development of deep learning was studied week by week. This allowed the quality of the course to be appraised and showed, to a certain extent, the impact of this online international course on the learning strategies of the students. Results indicate that deep learning can be supported by synchronous communication and online meetings between course participants.</p

Solved! Making the case for collaborative problem-solving

This report argues that the ability to solve problems with others is a crucial skill for our young people in the workplace of the future but the current education system does little to support it. Key findings Collaborative problem-solving (CPS) is an increasingly important skill to teach young people in order to prepare them for the future. Despite strong evidence for its impact, CPS is rarely taught in schools but if structured well it can reinforce knowledge and improve attainment. Significant barriers exist for teachers implementing this practice, from behaviour management to curriculum coverage, to task-design. For CPS to gain ground, a concerted shift is needed including teacher training, better resources and system level support. This report is part of Nesta’s ongoing commitment to equipping young people with the skills they need to succeed. It makes a series of recommendations on how organisations and policymakers can help support and embrace the implementation of CPS. Nesta is following this up with a series of small-scale pilots of aligned programmes in order to evaluate impact and explore how CPS can be implemented in a range of practical settings. Policy recommendations Stimulate production of quality collaborative problem-solving (CPS) resources and training, from primary education onwards. Fund existing, aligned programmes to scale and evaluate impact. Educate and involve the out-of-school learning sector and volunteer educators. Develop smarter collaborative problem-solving assessment methods. Help higher education organisations and MOOCs to track what works

Learning in law: using MCQs for summative assessment in core law courses

This article reports on an investigation undertaken by the authors on the verity of multiple choice questions (MCQs) as components of summative assessment in first level core courses within a law program. Student results are compared across different years where the only variable was the use of MCQs substituted for a research assignment. Comparison will be made about results of the general student body, as well as higher performing students and those who failed the courses to gauge whether either group is favoured by having MCQs. Conclusions will be drawn about constraints and opportunities from the authors’ experience in using MCQs in these courses

Assessing the quality of a student-generated question repository

We present results from a study that categorizes and assesses the quality of questions and explanations authored by students, in question repositories produced as part of the summative assessment in introductory physics courses over the past two years. Mapping question quality onto the levels in the cognitive domain of Bloom's taxonomy, we find that students produce questions of high quality. More than three-quarters of questions fall into categories beyond simple recall, in contrast to similar studies of student-authored content in different subject domains. Similarly, the quality of student-authored explanations for questions was also high, with approximately 60% of all explanations classified as being of high or outstanding quality. Overall, 75% of questions met combined quality criteria, which we hypothesize is due in part to the in-class scaffolding activities that we provided for students ahead of requiring them to author questions.Comment: 24 pages, 5 figure

Is comprehension or application the more important skill for first-year computer science students?

Time and performance data was collected on a class of 147 Computer Science 1B students, where students carried out a design and programming task based on one that had been seen in a previous examination. Given that students had previously worked through the task, we assessed their comprehension of that material in this assignment. We were then able to collect the performance data and correlate this with the examination marks for the student to determine if there was a relationship between performance in the examination and performance in this practical. We were also able to correlate the performance in this practical with the time taken to complete the practical, and with the student’s statement as to whether they remembered how they had solved it in their previous attempt. By doing this, we discovered that the students who remembered having solved it previously had a significantly higher mean examination mark than those students who claimed not to remember it. Unsurprisingly, students also performed better in this assignment if they had performed better in the examination. The mean time to complete the task was significantly less for those students who claimed to remember the task. In this task, the comprehension of the original material and the ability to recall it was of more importance than the ability to apply knowledge to an unseen problem.Nickolas J. G. Falkne

Wireless Keypads - A New Classroom Technology Using Enhanced Multiple-Choice Questions

This article discusses the advantages of using wireless keypads in the Lecture/classroom. This new technology requires multiple-choice (MC) questions to mate with the keypad entry features of these devices. The format of the traditional MC response is constrained to five choices and only one best response is allowed. For this reason, we propose enhancements to the traditional MC question. This enhanced MC question allows as many as ten answers. The answers can vary in their degree of correctness and can be assigned partial credit. By combining wireless keypads and multiple-choice questions, we can readily perform both formative and summative assessments of student learning. Examples and classroom applications are presented.Comment: pdf file, 8 pages,

Using web-based peer assessment in fostering deep learning in computer programming

Active learning is considered by many academics as an important and effective learning strategy. Students can improve the quality of their work by developing their higher cognitive skills through reflection on their own ideas and practice of analytic and evaluative skills. Peer assessment is one of the successful approaches which can be used to enhance this deep learning. In this paper we discuss a novel web-based peer assessment system to support computer programming courses. We discuss the educational rational for the system, and the deep learning theory, report on its deployment on large programming modules. The preliminary results indicate that the system has successfully helped students to develop their higher cognitive skills in learning computer programming