Early Developmental Activities and Computing Proficiency

As countries adopt computing education for all pupils from primary school upwards, there are challenging indicators: significant proportions of students who choose to study computing at universities fail the introductory courses, and the evidence for links between formal education outcomes and success in CS is limited. Yet, as we know, some students succeed without prior computing experience. Why is this? <br/><br/> Some argue for an innate ability, some for motivation, some for the discrepancies between the expectations of instructors and students, and some – simply – for how programming is being taught. All agree that becoming proficient in computing is not easy. Our research takes a novel view on the problem and argues that some of that success is influenced by early childhood experiences outside formal education. <br/><br/> In this study, we analyzed over 1300 responses to a multi-institutional and multi-national survey that we developed. The survey captures enjoyment of early developmental activities such as childhood toys, games and pastimes between the ages 0 — 8 as well as later life experiences with computing. We identify unifying features of the computing experiences in later life, and attempt to link these computing experiences to the childhood activities. <br/><br/> The analysis indicates that computing proficiency should be seen from multiple viewpoints, including both skill-level and confidence. It shows that particular early childhood experiences are linked to parts of computing proficiency, namely those related to confidence with problem solving using computing technology. These are essential building blocks for more complex use. We recognize issues in the experimental design that may prevent our data showing a link between early activities and more complex computing skills, and suggest adjustments. Ultimately, it is hoped that this line of research will feed in to early years and primary education, and thereby improve computing education for all

An Exploration of Traditional and Data Driven Predictors of Programming Performance

This thesis investigates factors that can be used to predict the success or failure of students taking an introductory programming course. Four studies were performed to explore how aspects of the teaching context, static factors based upon traditional learning theories, and data-driven metrics derived from aspects of programming behaviour were related to programming performance. In the first study, a systematic review into the worldwide outcomes of programming courses revealed an average pass rate of 67.7\%. This was found to have not significantly changed over time, or to have differed based upon aspects of the teaching context, such as the programming language taught to students. The second study showed that many of the factors based upon traditional learning theories, such as learning styles, are context dependent, and fail to consistently predict programming performance when they are applied across different teaching contexts. The third study explored data-driven metrics derived from the programming behaviour of students. Analysing data logged from students using the BlueJ IDE, 10 new data-driven metrics were identified and validated on three independently gathered datasets. Weaker students were found to make a greater percentage of successive errors, and spend a greater percentage of their lab time resolving errors than stronger students. The Robust Relative algorithm was developed to hybridize four of the strongest data-driven metrics into a performance predictor. The novel relative scoring of students based upon how their resolve times for different types of errors compared to the resolve times of their peers, resulted in a predictor which could explain a large proportion of the variance in the performance of three independent cohorts, $R^2$ = 42.19\%, 43.65\% and 44.17\% - almost double the variance which could be explained by Jadud's Error Quotient metric. The fourth study situated the findings of this thesis within the wider literature, by applying meta-analysis techniques to statistically synthesise fifty years of conflicting research, such that the most important factors for learning programming could be identified. 482 results describing the effects of 116 factors on programming performance were synthesised and consolidated to form a six class theoretical framework. The results showed that the strongest predictors identified over the past fifty years are data-driven metrics based upon programming behaviour. Several of the traditional predictors were also found to be influential, suggesting that both a certain level of scientific maturity and self-concept are necessary for programming. Two thirds of the weakest predictors were based upon demographic and psychological factors, suggesting that age, gender, self-perceived abilities, learning styles, and personality traits have no relevance for programming performance. This thesis argues that factors based upon traditional learning theories struggle to consistently predict programming performance across different teaching contexts because they were not intended to be applied for this purpose. In contrast, the main advantage of using data-driven approaches to derive metrics based upon students' programming processes, is that these metrics are directly based upon the programming behaviours of students, and therefore can encapsulate such changes in their programming knowledge over time. Researchers should continue to explore data-driven predictors in the future

Predicting and Improving Performance on Introductory Programming Courses (CS1)

This thesis describes a longitudinal study on factors which predict academic success in introductory programming at undergraduate level, including the development of these factors into a fully automated web based system (which predicts students who are at risk of not succeeding early in the introductory programming module) and interventions to address attrition rates on introductory programming courses (CS1). Numerous studies have developed models for predicting success in CS1, however there is little evidence on their ability to generalise or on their use beyond early investigations. In addition, they are seldom followed up with interventions, after struggling students have been identified. The approach overcomes this by providing a web-based real time system, with a prediction model at its core that has been longitudinally developed and revalidated, with recommendations for interventions which educators could implement to support struggling students that have been identified. This thesis makes five fundamental contributions. The first is a revalidation of a prediction model named PreSS. The second contribution is the development of a web-based, real time implementation of the PreSS model, named PreSS#. The third contribution is a large longitudinal, multi-variate, multi-institutional study identifying predictors of performance and analysing machine learning techniques (including deep learning and convolutional neural networks) to further develop the PreSS model. This resulted in a prediction model with approximately 71% accuracy, and over 80% sensitivity, using data from 11 institutions with a sample size of 692 students. The fourth contribution is a study on insights on gender differences in CS1; identifying psychological, background, and performance differences between male and female students to better inform the prediction model and the interventions. The final, fifth contribution, is the development of two interventions that can be implemented early in CS1, once identified by PreSS# to potentially improve student outcomes. The work described in this thesis builds substantially on earlier work, providing valid and reliable insights on gender differences, potential interventions to improve performance and an unsurpassed, generalizable prediction model, developed into a real time web-based system

Self-Efficacy and Engagement as Predictors of Student Programming Performance

Programming is a core subject introduced in the first year of an Undergraduate Computer Science programme. Since programming is a core subject, it is a major concern that high attrition and failure rates continue to be reported in such courses. Evidence from the literature suggests that programming is cognitively demanding, and the solutions proposed have had minimal impact on students in introductory programming courses. However, in the literature on learning theory, there is evidence suggesting that the self-efficacy beliefs of students affect their engagement, and that their engagement affects their performance. In the literature on introductory programming courses, there is a lack of research examining the effect of self-efficacy on engagement, and the effect of engagement on the programming performance of students. This leaves a gap in programming research that this research seeks to fill. Based on student engagement frameworks in the literature on learning theory, a conceptual model was developed. To operationalise and validate the conceptual model within the context of learning programming, a study consisting of focus group interviews and a survey on students in introductory programming courses is proposed. The results of the survey will be analysed using structural equation modelling (SEM) techniques

CS1: how will they do? How can we help? A decade of research and practice

Background and Context: Computer Science attrition rates (in the western world) are very concerning, with a large number of students failing to progress each year. It is well acknowledged that a significant factor of this attrition, is the students’ difficulty to master the introductory programming module, often referred to as CS1. Objective: The objective of this article is to describe the evolution of a prediction model named PreSS (Predict Student Success) over a 13-year period (2005–2018). Method: This article ties together, the PreSS prediction model; pilot studies; a longitudinal, multi-institutional re-validation and replication study; improvements to the model since its inception; and interventions to reduce attrition rates. Findings: The outcome of this body of work is an end-to-end real-time web-based tool (PreSS#), which can predict student success early in an introductory programming module (CS1), with an accuracy of 71%. This tool is enhanced with interventions that were developed in conjunction with PreSS#, which improved student performance in CS1. Implications: This work contributes significantly to the computer science education (CSEd) community and the ITiCSE 2015 working group’s call (in particular the second grand challenge), by re-validating and developing further the original PreSS model, 13 years after it was developed, on a modern, disparate, multi-institutional data set

Introductory programming: a systematic literature review

As computing becomes a mainstream discipline embedded in the school curriculum and acts as an enabler for an increasing range of academic disciplines in higher education, the literature on introductory programming is growing. Although there have been several reviews that focus on specific aspects of introductory programming, there has been no broad overview of the literature exploring recent trends across the breadth of introductory programming. This paper is the report of an ITiCSE working group that conducted a systematic review in order to gain an overview of the introductory programming literature. Partitioning the literature into papers addressing the student, teaching, the curriculum, and assessment, we explore trends, highlight advances in knowledge over the past 15 years, and indicate possible directions for future research

Review of Measurements Used in Computing Education Research and Suggestions for Increasing Standardization

The variables that researchers measure and how they measure them are central in any area of research. Which research questions can be asked and how they are answered depends on measurement. This paper describes a systematic review of the literature in computing education research to summarize the commonly used variables and measurements in 197 papers and to compare them to best practices in measurement for human-subjects research. Characteristics of the literature that are examined in the review include variables measured (including learner characteristics), measurements used, and type of data analysis. The review illuminates common practices related to each of these characteristics and their interactions with other characteristics. The paper lists standardized measurements that were used in the literature and highlights commonly used variables for which no standardized measures exist. To conclude, this review compares common practice in computing education to best practices in human-subjects research to make recommendations for increasing rigor

A molecular and cellular characterisation of the effects of neonicotinoid pesticides on the brain of the pollinator Bombus terrestris.

Bombus terrestris (L.) is one of the most important native and commercial pollinator species worldwide. Along with other pollinators their populations are in decline due to a multifactorial phenomenon that includes the extensive use of neonicotinoid insecticides. Thus, the characterisation and understanding of neonicotinoid effects on bees at the molecular level is essential to mitigate the risks of their use in the environment. This study initially characterised the brain proteomes of bumblebees in response to aging prior to assessing changes at the behavioural, cellular and molecular level as a response to neonicotinoid exposure. We demonstrated the highly catalytic nature of the developing bumblebee brain and how energy and carbohydrate metabolism increase in response to aging, while genetic information processes are downregulated. By considering differences in mode of action and mode of exposure to the neonicotinoids clothianidin and imidacloprid, the effects of acute and chronic oral exposure on bumblebee workers were determined. Neonicotinoids differentially impair energy metabolism and structural processes in the brain suggesting possible divergence of insecticide mode of action. Clothianidin and imidacloprid triggered different behavioural responses and toxicity in bees, with the former causing hyperactivity and the latter, temporal paralysis. Imidacloprid is less toxic to bumblebees and the brain physiology is differentially affected depending on chemical, dose or mode of exposure selected. The levels of the synapse associated protein synapsin increased in bumblebee brains for imidacloprid-exposed bees only, and functional annotation analysis of differential expressed proteins indicated impairment of intracellular transport, energy metabolism, translational activity, purines and pyrimidines metabolism, endocytic and exocytic activity and synaptic functioning as a whole. The pathways affected by neonicotinoid exposure vary depending on chemical and mode of exposure, which complicates the identification of biomarkers of neonicotinoid exposure in bumblebees. In addition, neonicotinoid metabolism in bees is poorly understood and these chemicals can accumulate in the bee body, which potentially contributes to long term toxicity. Overall the results presented in this thesis demonstrate individual and distinct ways by which neonicotinoids influence neuronal communication and provide novel insights into molecular aspects of bee health, through highlighting the pathways affected by aging and pesticide use on this important pollinator species

Benefits to Australia from ACIAR-funded Research

Research and Development/Tech Change/Emerging Technologies,