Sex, finance, and literacy assessment

Accepted author manuscriptDiscussions about literacy assessment can often be polarizing for teachers, school administrators, and other stakeholders. Given the diverse and often charged perspectives on assessment within both the profession and the broader public discourse, it can be difficult to engage in productive dialogue about the role that literacy assessment plays in promoting or inhibiting effective models of literacy education. This department provides perspectives, questions, and research that enables readers to better advocate for themselves and their students as they develop their own assessment programs and respond to assessment programs that are imposed on them.Ye

Ethical considerations and writing assessment

Open access article. Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International license (CC BY-NC-ND 4.0) appliesIn this introductory article, I set the stage for the arguments that follow in each of the contributions to this special issue. First, I critically examine the three pillars of the current Standards--fairness, validity, and reliability--exploring briefly how on their own each concept is insufficient to guiding ethical practice. Then I briefly examine the Standards themselves highlighting their limitations in guiding ethical practice. Finally, I provide a brief introduction to the various dimensions of the theory of ethics we are developing in this special issue.Ye

An integrated design and appraisal framework for ethical writing assessment

Open access article. Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International license (CC BY-NC-ND 4.0) appliesIn my introduction to this special issue, I highlighted the insufficiency of key measurement concepts--fairness, validity, and reliability--in guiding the design and implementation of writing assessments. I proposed that the concept of ethics provides a more complete framework for guiding assessment design and use. This article advances the philosophical foundation for our theory of ethics articulated by Elliot (this issue). Starting with fairness as first principle, it examines how safety and risk can be addressed through the application of an integrated design and appraisal framework (IDAF) for writing assessment tools. The paper is structured around two case studies set in Alberta, Canada. Case Study 1 applies Kane's (2013) IUA model of validation to an appraisal--Alberta's English 30-1 (grade 12 academic English) diploma exam program--highlighting in the process the limitations in contemporary validity theory. Case Study 2 examines an assessment design project I am currently undertaking in partnership with 8 English language arts teachers in southern Alberta. This case study examines how the IDAF supports ethical assessment design and appraisal.Ye

A key role for iron-bound phosphorus in authigenic apatite formation in North Atlantic continental platform sediments

A combination of pore water and solid phase analysis was used to determine whether authigenic carbonate fluorapatite (CFA) is currently forming in the sediment at two locations (OMEX I and II) on the North Atlantic continental platform Goban Spur (southwest of Ireland). Results of selective P extractions suggest that an early diagenetic redistribution of Fe-bound P to an authigenic P phase may be occurring at both stations. A steady-state diagenetic model describing the depth profiles of pore water HPO42− and three solid phase forms of P (organic P, Fe-bound P and authigenic P) was developed and applied to the data of station OMEX-I. The model results indicate that CFA formation can account for the observed increase of authigenic P with depth at this station. Furthermore, the results show that an intense cycling of P between Fe-bound P and pore water HPO42− at the redox interface can create conditions beneficial for CFA formation. This internal P cycle is driven by downward, bioturbational transport of mainly in-situ-formed Fe-bound P into the reduced sediment zone. Losses from the internal P cycle due to CFA formation and HPO42− diffusion are compensated for by sorption of HPO42− released from organic matter to Fe oxides in the oxidized surface sediment. Fe-bound P thus acts as an intermediate between organic P and CFA. CFA can account for between 25 and 70% of the total burial flux of reactive P at station OMEX-I and thus may act as an important sink for P in this low sedimentation, continental margin environment

Articulating a sociocognitive construct of writing expertise for the digital age

Open access article. Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License (CC BY-NC-ND 4.0) appliesBackground: In this article, we articulate an updated construct describing domains of expertise in writing, one that meets the contemporary needs of those who research, teach, and assess writing—particularly in a digital age. This article appears in a collection published as a special issue of The Journal of Writing Analytics that explores both the challenges and the opportunities involved in integrating digitally delivered formative assessments into classroom instruction, illustrated by the example of Workplace English Communication (WEC). Each article in this special issue addresses different aspects of the challenges involved in developing assessments of complex tasks. The three framework articles that lead this special issue all highlight the importance of robust construct models as a foundation for assessment design. In this article, we present an integrated sociocognitive-oriented construct model for expertise in writing that informs the assessment design work discussed in this special issue. Research Questions: With the overarching purpose of developing a contemporary, integrated construct, we conducted a critical review of journal articles focused on expertise in writing ability, exploring the following research questions: o RQ1: What knowledge domains necessary for writing expertise are described in research articles from 1971 to 2020? o RQ2: How do these domains coalesce to describe a construct of writing expertise for the digital age? o RQ3: How can this broad construct be extrapolated to an idiographic model that describes the expertise required for writing in workplace contexts assessed by the WEC modules? Methodology: We conducted a critical review of writing scholarship from the past 50 years. The purpose of a critical review is to synthesize the significant scholarship in the field in order to advance theory. We chose 1971 as our starting date, which was the year in which Emig published her seminal study examining writing processes, as opposed to products. Our search parameters included the following: the articles were to address writing constructs or theories in their title or abstract, be peer reviewed, written in English, and written between 1971 and the present (spring 2020). We consulted the databases of ERIC (Educational Resource Information Center), Academic Search Complete, and ProQuest. Then, we conducted a second round of searching via a hand search of the top five ranked journals in writing research. From our initial screening, we eliminated any articles that were either duplicates or irrelevant during a close read of the texts. Articles were eliminated if they were not explicitly focused on construct/theory development and/or made little contribution to construct development; also, some were eliminated if they did not contribute anything new to construct development due to saturation. Once we arrived at our final list of texts, we read the texts and coded them using NVivo over two rounds including provisional coding and pattern coding. Results: Our critical review of 109 texts revealed that the following writing knowledge domains have predominated the literature: metacognitive, critical discourse, discourse, rhetorical aim, genre, communication task process, and substantive knowledge. We bring these domains together to form a sociocognitive construct of writing expertise, which describes the knowledge domains necessary to develop expertise in the digital age. Discussion and Conclusion: After discussing the knowledge domains revealed by our critical review of the literature, we then describe how we take our construct from the nomothetic level and apply it at the idiographic level in the context of the WEC modules that are the focus of this special issue. We conclude by elucidating the implications this construct has for writing curriculum, instruction, and assessment.Ye

Afterword: meeting the challenges of Workplace English Communication in the 21st century

Open access article. Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0) applies[Abstract not available]Ye

A framework for using consequential validity evidence in evaluating large-scale writing assessments: a Canadian study

Sherpa Romeo blue journalThe increasing diversity of students in contemporary classrooms and the concomitant increase in large-scale testing programs highlight the importance of developing writing assessment programs that are sensitive to the challenges of assessing diverse populations. To this end, this paper provides a framework for conducting consequential validity research on large-scale writing assessment programs. It illustrates this validity model through a series of instrumental case studies drawing on the research literature conducted on writing assessment programs in Canada. We derived the cases from a systematic review of the literature published between January 2000 and December 2012 that directly examined the consequences of large-scale writing assessment on writing instruction in Canadian schools. We also conducted a systematic review of the publicly available documentation published on Canadian provincial and territorial government websites that discussed the purposes and uses of their large-scale writing assessment programs. We argue that this model of constructing consequential validity research provides researchers, test developers, and test users with a clearer, more systematic approach to examining the effects of assessment on diverse populations of students. We also argue that this model will enable the development of stronger, more integrated validity arguments.Ye

Principled development of Workplace English Communication part 1: a sociocognitive framework

Background: This study advances a sociocognitive approach to modeling complex communication tasks. Using an integrative perspective of linguistic, cultural, and substantive (LCS) patterns, we provide a framework for understanding the nature and acquisition of people’s adaptive capabilities in social/cognitive complex adaptive systems. We also illustrate the application of the framework to learning and assessment. As we will show, understanding the connection between measurement models and users’ needs is important to increase assessments’ educative usefulness. Questions Addressed: Our framework is designed to address questions regarding the following four areas: the nature of sociocognitive perspectives in educational measurement, the application of LCS patterns to complex communication tasks captured in an extended formative assessment of Workplace English Communication (WEC), the usefulness of psychometric models for instruction and assessment with such complex tasks, and considerations for measurement modeling. Conclusions: Our study concludes with reflections on the challenges of complex assessments such as WEC, the advantages of sociocognitive modeling for new assessment genres, and the roles of situated measurement models in meeting the challenges.Ye