Development and Validation of the Computational Thinking Concepts and Skills Test

Calls for standardized and validated measures of computational thinking have been made repeatedly in recent years. Still, few such tests have been created and even fewer have undergone rig- orous psychometric evaluation and been made available to re- searchers. The purpose of this study is to report our work in de- veloping and validating a test of computational thinking concepts and skills and to compare different scoring methods for the test. This computational thinking exam is intended to be used in com- puting education research as a common measure of computational thinking so that the research community will be able to make more meaningful comparisons across samples and studies. The Computational Thinking Concepts and Skills Test (CTCAST) was administered to students in several courses, evaluated and revised, and then administered to another group of students. Part of the revision included changing half of the items to a multiple-select format. The test scores using the three scoring methods were com- pared to each other and to scores on a different test of core com- puter science knowledge. Results indicate the CTCAST and the test of core computer science knowledge measure similar, but not identical, aspects of students’ knowledge and skills, and that item- level statistics vary according to the scoring method that is used. Recommendations for using and scoring the test are presented

Development and Validation of the Computational Thinking Concepts and Skills Test

Calls for standardized and validated measures of computational thinking have been made repeatedly in recent years. Still, few such tests have been created and even fewer have undergone rig- orous psychometric evaluation and been made available to re- searchers. The purpose of this study is to report our work in de- veloping and validating a test of computational thinking concepts and skills and to compare different scoring methods for the test. This computational thinking exam is intended to be used in com- puting education research as a common measure of computational thinking so that the research community will be able to make more meaningful comparisons across samples and studies. The Computational Thinking Concepts and Skills Test (CTCAST) was administered to students in several courses, evaluated and revised, and then administered to another group of students. Part of the revision included changing half of the items to a multiple-select format. The test scores using the three scoring methods were com- pared to each other and to scores on a different test of core com- puter science knowledge. Results indicate the CTCAST and the test of core computer science knowledge measure similar, but not identical, aspects of students’ knowledge and skills, and that item- level statistics vary according to the scoring method that is used. Recommendations for using and scoring the test are presented

Development and Validation of the Computational Thinking Concepts and Skills Test

Calls for standardized and validated measures of computational thinking have been made repeatedly in recent years. Still, few such tests have been created and even fewer have undergone rig- orous psychometric evaluation and been made available to re- searchers. The purpose of this study is to report our work in de- veloping and validating a test of computational thinking concepts and skills and to compare different scoring methods for the test. This computational thinking exam is intended to be used in com- puting education research as a common measure of computational thinking so that the research community will be able to make more meaningful comparisons across samples and studies. The Computational Thinking Concepts and Skills Test (CTCAST) was administered to students in several courses, evaluated and revised, and then administered to another group of students. Part of the revision included changing half of the items to a multiple-select format. The test scores using the three scoring methods were com- pared to each other and to scores on a different test of core com- puter science knowledge. Results indicate the CTCAST and the test of core computer science knowledge measure similar, but not identical, aspects of students’ knowledge and skills, and that item- level statistics vary according to the scoring method that is used. Recommendations for using and scoring the test are presented

Communicating Computational Concepts and Practices Within High School Students’ Portfolios of Making Electronic Textiles

Portfolios have recently gained traction within computer science education as a way to assess students’ computational thinking and practices. Whereas traditional assessments such as exams tend to capture learning within artificial settings at a single point in time, portfolios provide more authentic opportunities to document a trajectory of students’ learning and practices in everyday contexts. Furthermore, because communication itself has been defined as an important computational thinking practice, portfolios give students a place to practice this skill in the classroom. In this study, we report on the implementation of a digital portfolio with a class of 21 high school students used to capture the process of creating of an electronic textile mural project. While students’ understanding of computational concepts were only partially captured within the portfolios, their engagements with computational practices—such as debugging and iteration—were better highlighted. Much of this was due to the students’ existing communicative strategies themselves, both in terms of how precise they were in describing issues, as well as how they leveraged images and code to explain their process. Recommendations for designing more effective portfolio assessments are discussed, which include greater emphasis on creating shared classroom discourse, and leveraging students’ existing experiences with multimedia

Novice programming environments: lowering the barriers, supporting the progression

In 2011, the author published an article that looked at the state of the art in novice programming environments. At the time, there had been an increase in the number of programming environments that were freely available for use by novice programmers, particularly children and young people. What was interesting was that they offered a relatively sophisticated set of development and support features within motivating and engaging environments, where programming could be seen as a means to a creative end, rather than an end in itself. Furthermore, these environments incorporated support for the social and collaborative aspects of learning. The article considered five environments—Scratch, Alice, Looking Glass, Greenfoot, and Flip— examining their characteristics and investigating the opportunities they might offer to educators and learners alike. It also considered the broader implications of such environments for both teaching and research. In this chapter, the author revisits the same five environments, looking at how they have changed in the intervening years. She considers their evolution in relation to changes in the field more broadly (e.g., an increased focus on “programming for all”) and reflects on the implications for teaching, as well as research and further development

Design Scaffolding for Computational Making in the Visual Programming Tool ARIS

In this thesis, I explore how design scaffolds, or (i.e., intellectual supports) can assist learners engaging with computational making processes. Computational making combines programming with artifact production. Due to the complexity of tasks involved in computational making, there is an increasing need to explore and develop support systems for learners engaging with computational making. With $3,000 funding from Utah State University’s College of Education and Human Services, an undergraduate researcher and I, who both have experience with youth and computational making research, explored how design scaffolds impact youth engaging with computational making processes. To do so, we held a workshop where 11 learners (11 female, ages 11-16) used ARIS, a platform designed for non-programmers to create mobile games. In addition, we interviewed five ARIS designers who were able to evaluate our design scaffolds. We provide insights for improving the use of design scaffolds in computational making with ARIS specifically that also apply broadly to computational making processes. Moreover, we developed an ARIS course that teaches educators to use a design scaffold tool for ARIS. This research provides immediate benefits for educators who access the ARIS course and researchers seeking to improve upon design scaffold research for computational making processes

Computational Thinking in Education: Where does it fit? A systematic literary review

Computational Thinking (CT) has been described as an essential skill which everyone should learn and can therefore include in their skill set. Seymour Papert is credited as concretising Computational Thinking in 1980 but since Wing popularised the term in 2006 and brought it to the international community's attention, more and more research has been conducted on CT in education. The aim of this systematic literary review is to give educators and education researchers an overview of what work has been carried out in the domain, as well as potential gaps and opportunities that still exist. Overall it was found in this review that, although there is a lot of work currently being done around the world in many different educational contexts, the work relating to CT is still in its infancy. Along with the need to create an agreed-upon definition of CT lots of countries are still in the process of, or have not yet started, introducing CT into curriculums in all levels of education. It was also found that Computer Science/Computing, which could be the most obvious place to teach CT, has yet to become a mainstream subject in some countries, although this is improving. Of encouragement to educators is the wealth of tools and resources being developed to help teach CT as well as more and more work relating to curriculum development. For those teachers looking to incorporate CT into their schools or classes then there are bountiful options which include programming, hands-on exercises and more. The need for more detailed lesson plans and curriculum structure however, is something that could be of benefit to teachers

Computational Thinking and Its Mathematics Origins through Purposeful Music Mixing with African American High School Students

Computational thinking (CT) is being advocated as core knowledge needed by all students—particularly, students from underrepresented groups—to prepare for the 21st century (Georgia Department of Education, 2017; Smith, 2016, 2017; The White House, 2017; Wing, 2006, 2014). The K–12 Computer Science Frameworks (2016), written by a national steering committee, defines CT as “the thought processes involved in expressing solutions as computational steps or algorithms that can be carried out by a computer” (p. 68). This project investigated current national introductory CT curricula and their related programming platforms used in high schools. In particular, the study documents the development, implementation, and quantitative outcomes of a purposeful introductory CT curriculum framed by an eclectic theoretical perspective (Stinson, 2009) that included culturally relevant pedagogy and critical play through a computational music remixing platform known as EarSketch. This purposeful introductory CT curriculum, designed toward engaging African American high school students, was implemented with a racially diverse set of high school students to quantitatively measure their engagement and CT content knowledge change. The goal of the project was to increase engagement and CT content knowledge of all student participants, acknowledging that what benefits African American students tends to benefit all students (Hilliard, 1992; Ladson-Billings, 2014). An analysis of the findings suggests that there was a significant increase in student cognitive engagement for racially diverse participants though not for the subset of African American students. Affective and conative engagement did not significantly change for racially diverse participants nor for the African American student subset. However, both the racially diverse set of students’ and their subset of African American students’ CT content knowledge significantly increased. As well, there was no significant difference between African American students and non-African American students post-survey engagement and CT content knowledge post-assessment means when adjusted for their pre-survey engagement and pre-assessment knowledge respectively. Hence, showing that purposeful music mixing using EarSketch designed toward African American students benefitted a racially diverse set of students in cognitive engagement and CT content knowledge and the African American subset of students in CT content knowledge. Implications and recommendations for further study are discussed