Identification and Evaluation of Predictors for Learning Success and of Models for Teaching Computer Programming in Contemporary Contexts

Introductory undergraduate computer programming courses are renowned for higher than average failure and withdrawal rates when compared to other subject areas. The closer partnership between higher education and the rapidly expanding digital technology industry, as demonstrated by the establishment of new Degree Apprenticeships in computer science and digital technologies, requires efficient and effective means for teaching programming skills. This research, therefore, aimed to identify reliable predictors of success in learning programming or vulnerability to failure. The research also aimed to evaluate teaching methods and remedial interventions towards recommending a teaching model that supported and engaged learners in contemporary contexts that were relevant to the workplace. Investigation of qualifications designed to prepare students for undergraduate computer science courses revealed that A-level entrants achieved significantly higher programming grades than BTEC students. However, there was little difference between the grades of those with and those without previous qualifications in computing or ICT subjects. Analysis of engagement metrics revealed a strong correlation between extent of co-operation and programming grade, in contrast to a weak correlation between programming grade and code understanding. Further analysis of video recordings, interviews and observational records distinguished between the type of communication that helped peers comprehend tasks and concepts, and other forms of communication that were only concerned with completing tasks. Following the introduction of periodic assessment, essentially converting a single final assessment to three staged summative assessment points, it was found that failing students often pass only one of the three assignment parts. Furthermore, only 10% of those who failed overall had attempted all three assignments. Reasons for failure were attributed to ‘surface’ motivations (such as regulating efforts to achieve a minimum pass of 40%), ineffective working habits or stressful personal circumstances rather than any fundamental difficulty encountered with subject material. A key contribution to pedagogical practice made by this research is to propose an ‘incremental’ teaching model. This model is informed by educational theory and empirical evidence and comprises short cycles of three activities: presenting new topic information, tasking students with a relevant exercise and then demonstrating and discussing the exercise solution. The effectiveness of this model is evidenced by increased engagement, increased quiz scores at the end of each teaching session and increased retention of code knowledge at the end of the course

Team Research at the Biology–Mathematics Interface: Project Management Perspectives

The success of interdisciplinary research teams depends largely upon skills related to team performance. We evaluated student and team performance for undergraduate biology and mathematics students who participated in summer research projects conducted in off-campus laboratories. The student teams were composed of a student with a mathematics background and an experimentally oriented biology student. The team mentors typically ranked the students' performance very good to excellent over a range of attributes that included creativity and ability to conduct independent research. However, the research teams experienced problems meeting prespecified deadlines due to poor time and project management skills. Because time and project management skills can be readily taught and moreover typically reflect good research practices, simple modifications should be made to undergraduate curricula so that the promise of initiatives, such as MATH-BIO 2010, can be implemented

Block-Based Development of Mobile Learning Experiences for the Internet of Things

The Internet of Things enables experts of given domains to create smart user experiences for interacting with the environment. However, development of such experiences requires strong programming skills, which are challenging to develop for non-technical users. This paper presents several extensions to the block-based programming language used in App Inventor to make the creation of mobile apps for smart learning experiences less challenging. Such apps are used to process and graphically represent data streams from sensors by applying map-reduce operations. A workshop with students without previous experience with Internet of Things (IoT) and mobile app programming was conducted to evaluate the propositions. As a result, students were able to create small IoT apps that ingest, process and visually represent data in a simpler form as using App Inventor's standard features. Besides, an experimental study was carried out in a mobile app development course with academics of diverse disciplines. Results showed it was faster and easier for novice programmers to develop the proposed app using new stream processing blocks.Spanish National Research Agency (AEI) - ERDF fund

Effects of Real-World Experiences in Active Learning (R.E.A.L.) Applied in an Information Systems Data Communication and Networking Course

The purpose of this study was to determine if the use of Real-World Experiences in Active Learning (R.E.A.L.) impacted student learning outcomes in an undergraduate information systems (IS) data communication and networking course. A quasi-experimental, quantitative approach was used to investigate whether the R.E.A.L. treatments, used as active learning strategies, significantly impacted student performance, short-term retention, long-term retention, and student engagement. The data collection was completed in one semester. Participants were students enrolled in an IS data communication and networking course during the Fall 2019 semester. The students, enrolled in the two sections of the course, were taught using a crossover design where each student received eight treatments. The researcher of the study served as the instructor for both sections. The research question and four hypotheses were analyzed using repeated measures MANCOVA and multi-level modeling (MLM). After a statistical analysis of the direct effects of the R.E.A.L. treatments on student performance, short term retention, long term retention, and engagement, none of the four hypotheses were fully supported. The results indicated that the R.E.A.L. xiii treatments did not significantly impact the student learning outcomes from the course. Research findings partially supported hypothesis H1 indicating that age, ethnicity, and major have some influence on students’ performance and age may have some influence on short-term retention. Statistically significant results were obtained for the H1a Network treatment (F(1,28) = 6.033, p = 0.021, partial η2 = 0.177), meaning that the mean for the H1a Network treatment (M = 90.842) was significantly different than the lecture mean (M = 75.533). The H1b Handshake treatment (F(1,28) = 15.405, p = .001, partial η2 = 0.355) and the H1c Wireless treatment (F(1,28) = 11.385, p = .002, partial η2 = 0.289) produced results in the reverse direction of what was hypothesized, meaning that the mean for the H1b Handshake treatment (M = 49.800) and the H1c Wireless treatment (M = 86.842) were significantly lower than the lecture means for both hypothesis tests. Research findings partially supported hypothesis H2 indicating that age may have influence on short-term retention. Statistically significant results were obtained for the H2e Network speed treatment (F(1,28) = 5.709, p = 0.024, partial η2 = 0.164) and H2f Network management treatment (F(1,28) = 5.654, p = 0.024, partial η2 = 0.163). However, findings from the MLM post hoc tests of direct, interaction, and indirect effects did show some areas for future work in certain demographics, especially gender and ethnicity. Findings of the study were not shown to be significant however, the post hoc testing revealed areas where future work could be beneficial

A mixed-methods exploration of an environment for learning computer programming

A mixed-methods approach is evaluated for exploring collaborative behaviour, acceptance and progress surrounding an interactive technology for learning computer programming. A review of literature reveals a compelling case for using mixed-methods approaches when evaluating technology-enhanced-learning environments. Here, ethnographic approaches used for the requirements engineering of computing systems are combined with questionnaire-based feedback and skill tests. These are applied to the ‘Ceebot’ animated 3D learning environment. Video analysis with workplace observation allowed detailed inspection of problem solving and tacit behaviours. Questionnaires and knowledge tests provided broad sample coverage with insights into subject understanding and overall response to the learning environment. Although relatively low scores in programming tests seemingly contradicted the perception that Ceebot had enhanced understanding A mixed-methods approach is evaluated for exploring collaborative behaviour, acceptance and progress surrounding an interactive technology for learning computer programming. A review of literature reveals a compelling case for using mixed-methods approaches when evaluating technology-enhanced-learning environments. Here, ethnographic approaches used for the requirements engineering of computing systems are combined with questionnaire-based feedback and skill tests. These are applied to the ‘Ceebot’ animated 3D learning environment. Video analysis with workplace observation allowed detailed inspection of problem solving and tacit behaviours. Questionnaires and knowledge tests provided broad sample coverage with insights into subject understanding and overall response to the learning environment. Although relatively low scores in programming tests seemingly contradicted the perception that Ceebot had enhanced understanding of programming, this perception was nevertheless found to be correlated with greater test performance. Video analysis corroborated findings that the learning environment and Ceebot animations were engaging and encouraged constructive collaborative behaviours. Ethnographic observations clearly captured Ceebot’s value in providing visual cues for problem-solving discussions and for progress through sharing discoveries. Notably, performance in tests was most highly correlated with greater programming practice (p50.01). It was apparent that although students had appropriated technology for collaborative working and benefitted from visual and tacit cues provided by Ceebot, they had not necessarily deeply learned the lessons intended. The key value of the ‘mixed-methods’ approach was that ethnographic observations captured the authenticity of learning behaviours, and thereby strengthened confidence in the interpretation of questionnaire and test findings. of programming, this perception was nevertheless found to be correlated with greater test performance. Video analysis corroborated findings that the learning environment and Ceebot animations were engaging and encouraged constructive collaborative behaviours. Ethnographic observations clearly captured Ceebot’s value in providing visual cues for problem-solving discussions and for progress through sharing discoveries. Notably, performance in tests was most highly correlated with greater programming practice (p50.01). It was apparent that although students had appropriated technology for collaborative working and benefitted from visual and tacit cues provided by Ceebot, they had not necessarily deeply learned the lessons intended. The key value of the ‘mixed-methods’ approach was that ethnographic observations captured the authenticity of learning behaviours, and thereby strengthened confidence in the interpretation of questionnaire and test findings

Business Process Management Education in Academia: Status, challenges, and Recommendations

In response to the growing proliferation of Business Process Management (BPM) in industry and the demand this creates for BPM expertise, universities across the globe are at various stages of incorporating knowledge and skills in their teaching offerings. However, there are still only a handful of institutions that offer specialized education in BPM in a systematic and in-depth manner. This article is based on a global educators’ panel discussion held at the 2009 European Conference on Information Systems in Verona, Italy. The article presents the BPM programs of five universities from Australia, Europe, Africa, and North America, describing the BPM content covered, program and course structures, and challenges and lessons learned. The article also provides a comparative content analysis of BPM education programs illustrating a heterogeneous view of BPM. The examples presented demonstrate how different courses and programs can be developed to meet the educational goals of a university department, program, or school. This article contributes insights on how best to continuously sustain and reshape BPM education to ensure it remains dynamic, responsive, and sustainable in light of the evolving and ever-changing marketplace demands for BPM expertise

An empirical study of the “prototype walkthrough”: a studio-based activity for HCI education

For over a century, studio-based instruction has served as an effective pedagogical model in architecture and fine arts education. Because of its design orientation, human-computer interaction (HCI) education is an excellent venue for studio-based instruction. In an HCI course, we have been exploring a studio-based learning activity called the prototype walkthrough, in which a student project team simulates its evolving user interface prototype while a student audience member acts as a test user. The audience is encouraged to ask questions and provide feedback. We have observed that prototype walkthroughs create excellent conditions for learning about user interface design. In order to better understand the educational value of the activity, we performed a content analysis of a video corpus of 16 prototype walkthroughs held in two HCI courses. We found that the prototype walkthrough discussions were dominated by relevant design issues. Moreover, mirroring the justification behavior of the expert instructor, students justified over 80 percent of their design statements and critiques, with nearly one-quarter of those justifications having a theoretical or empirical basis. Our findings suggest that PWs provide valuable opportunities for students to actively learn HCI design by participating in authentic practice, and provide insight into how such opportunities can be best promoted