Challenges for IT-Enabled Formative Assessment of Complex 21st Century Skills

In this article, we identify and examine opportunities for formative assessment provided by information technologies (IT) and the challenges which these opportunities present. We address some of these challenges by examining key aspects of assessment processes that can be facilitated by IT: datafication of learning; feedback and scaffolding; peer assessment and peer feedback. We then consider how these processes may be applied in relation to the assessment of horizontal, general complex 21st century skills (21st CS), which are still proving challenging to incorporate into curricula as well as to assess. 21st CS such as creativity, complex problem solving, communication, collaboration and self-regulated learning contain complex constructs incorporating motivational and affective components. Our analysis has enabled us to make recommendations for policy, practice and further research. While there is currently much interest in and some progress towards the development of learning/assessment analytics for assessing 21st CS, the complexity of assessing such skills, together with the need to include affective aspects means that using IT-enabled techniques will need to be combined with more traditional methods of teacher assessment as well as peer assessment for some time to come. Therefore learners, teachers and school leaders must learn how to manage the greater variety of sorts and sources of feedback including resolving tensions of inconsistent feedback from different sources

The Undergraduate–Postgraduate–Faculty Triad: Unique Functions and Tensions Associated with Undergraduate Research Experiences at Research Universities

We present an exploratory study of how undergraduates' involvement in research influences postgraduates (i.e., graduate and postdoctoral researchers) and faculty. We used a qualitative approach to examine the relationships among undergraduates, postgraduates, and the faculty head in a research group. In this group, undergraduates viewed postgraduates as more approachable than the faculty head both literally and figuratively. Mentorship by postgraduates presented unique challenges for undergraduates, including unrealistic expectations and varying abilities to mentor. The postgraduates and faculty head concurred that undergraduates contributed to the group's success and served as a source of frustration. Postgraduates appreciated the opportunity to observe multiple approaches to mentoring as they saw the faculty head and other postgraduates interact with undergraduates. The faculty head viewed undergraduate research as important for propagating the research community and for gaining insights into undergraduates and their postgraduate mentors. These results highlight how the involvement of undergraduates and postgraduates in research can limit and enhance the research experiences of members of the undergraduate–postgraduate–faculty triad. A number of tensions emerge that we hypothesize are intrinsic to undergraduate research experiences at research universities. Future studies can focus on determining the generalizability of these findings to other groups and disciplines

What counts as evidence and equity?

Editorial introduction to Vol. 34 of Review of Research in Education (American Educational Research Association/Sage)

Nonparametric statistical methods

Nonparametric methods are appropriate when certain assumptions about distributions that common parametric methods make are questionable. In this entry, we review nonparametric statistical tests based on exact or simulated sampling distributions. We also discuss methods for nonparametric data exploration and nonparametric regression and we explain computer-based methods for estimating standard errors and confidence intervals and regression functions. The methods are illustrated using Pisa data from 2019