A review of Australasian investigations into problem solving and the novice programmer

This Australasian focused review compares a number of recent studies that have identified difficulties encountered by novices while learning programming and problem solving. These studies have shown that novices are not performing at expected levels and many novices have only a fragile knowledge of programming, which may prevent them from learning and applying problem solving strategies. The review goes on to explore proposals for explicitly incorporating problem solving strategy instruction into introductory programming curricula and assessment, in an attempt to produce improved learning outcomes for novices. Finally, directions suggested by the reviewed studies are gathered and some unanswered questions are raised

An architecture for systematic tracking of skills and competence level progression in computer science

A typical Computer Science degree is three to five years long, consists of four to six subjects per semester, and two semesters per year. A student enrolled in such a degree is expected to learn both discipline-specific skills and transferable generic skills. These skills are to be taught in a progressive sequence through the duration of the degree. As the student progresses through the subjects and semesters of a degree, his skill portfolio and competence level for each skill is expected to grow. Effectively modeling these curriculum skills, mapping them to assessment tasks across subjects of a degree, and measuring the progression in learner competence level is, largely, still an unsolved problem. Previous work at this scale is limited. This systematic tracking of skills and competence is crucial for effective quality control and optimization of degree structures. Our main contribution is an architecture for a curriculum information management system to facilitate this systematic tracking of skill and competence level progression in a Computer Science context

The Many Ways of the BRACElet Project

This paper provides a retrospective snapshot of the first two years of a multi-institutional multi-national study (MIMN) in Computer Science Education called the BRACElet Project. This study has been inquiring into how novice programmers comprehend and write computer programs. The context for the study is outlined, together with details of how it has evolved and those who have participated. Some challenges encountered during the project are highlighted and pointers for the successful conduct of such a study are provided. The paper concludes by noting pitfalls to be avoided, some open research questions, and current plans for furthering the project

A conceptual model for re ecting on expected learning vs. demonstrated student performance

© 2013, Australian Computer Society, Inc. Educators are faced with many challenging questions in designing an effective curriculum. What prerequisite knowledge do students have before commencing a new subject? At what level of mastery? What is the spread of capabilities between bare-passing students vs. the top-performing group? How does the intended learning specification compare to student performance at the end of a subject? In this paper we present a conceptual model that helps in answering some of these questions. It has the following main capabilities: capturing the learning specification in terms of syllabus topics and outcomes; capturing mastery levels to model progression; capturing the minimal vs. aspirational learning design; capturing confidence and reliability metrics for each of these mappings; and finally, comparing and re ecting on the learning specification against actual student performance. We present a web-based implementation of the model, and validate it by mapping the final exams from four programming subjects against the ACM/IEEE CS2013 topics and outcomes, using Bloom's Taxonomy as the mastery scale. We then import the itemised exam grades from 632 students across the four subjects and compare the demonstrated student performance against the expected learning for each of these. Key contributions of this work are the validated conceptual model for capturing and comparing expected learning vs. demonstrated performance, and a web-based implementation of this model, which is made freely available online as a community resource

The Skills Framework for the Information Age: Engaging Stakeholders in Curriculum Design

This paper reports on a research project, examining the role of the Skills Framework for the Information Age (SFIA) in Information and Communications Technology (ICT) curriculum design and management. A goal was to investigate how SFIA informs a top-down approach to curriculum design, beginning with a set of skills that define a particular career role. A further goal was to evaluate the extent to which SFIA facilitates stakeholder interaction, such that academic programs can better identify industry needs while preparing graduates for the intended career role. The paper also evaluates the extent to which SFIA informs the identification of authentic forms of assessment and the skills and levels of autonomy and responsibility required by entry-level and Masters graduate ICT positions. Processes and practices for ICT curriculum design and management are recommended based on findings arising from this research. Although this research was conducted in an Australian context, findings suggest that there is value in using SFIA for ICT curriculum design and management, even in those jurisdictions where it is not required for accreditation or professional certification purposes

The Skills Framework for the Information Age: Engaging Stakeholders in ICT Curriculum Design

This paper reports on a research project, examining the role of the Skills Framework for the Information Age (SFIA) in Information and Communications Technology (ICT) curriculum design and management. A goal was to investigate how SFIA informs a top-down approach to curriculum design, beginning with a set of skills that define a particular career role. A further goal was to evaluate the extent to which SFIA facilitates stakeholder interaction, such that academic programs can better identify industry needs while preparing graduates for the intended career role. The paper also evaluates the extent to which SFIA informs the identification of authentic forms of assessment and the skills and levels of autonomy and responsibility required by entry-level and Masters graduate ICT positions. Processes and practices for ICT curriculum design and management are recommended based on findings arising from this research. Although this research was conducted in an Australian context, findings suggest that there is value in using SFIA for ICT curriculum design and management, even in those jurisdictions where it is not required for accreditation or professional certification purposes

This course has a Bloom rating of 3.9

This paper analyses the cognitive difficulty of six courses that may be taken as credit towards an IT degree offered by a regional Australian University. The assessment requirements of these six courses are evaluated using Bloom’s taxonomy and from this a difficulty metric, called here a Bloom Rating, is computed for each course. The analysis reveals that some quite lowly courses in terms of their ordering in the programme, such as first-year programming, are comparatively high in their cognitive demands, whereas some of the more advanced non-programming courses have relatively low levels of cognitive difficulty. An explanation for these trends is offered