Epistemology, pedagogy, assessment and learning analytics

There is a well-established literature examining the relationships between epistemology (the nature of knowledge), pedagogy (the nature of learning and teaching), and assessment. Learning Analytics (LA) is a new assessment technology and should engage with this literature since it has implications for when and why different LA tools might be deployed. This paper discusses these issues, relating them to an example construct, epistemic beliefs – beliefs about the nature of knowledge – for which analytics grounded in pragmatic, sociocultural theory might be well placed to explore. This example is particularly interesting given the role of epistemic beliefs in the everyday knowledge judgements students make in their information processing. Traditional psychological approaches to measuring epistemic beliefs have parallels with high stakes testing regimes; this paper outlines an alternative LA for epistemic beliefs which might be readily applied to other areas of interest. Such sociocultural approaches afford opportunity for engaging LA directly in high quality pedagogy

Rethinking university assessment

Developments in globalisation and new technologies are making significant impacts in higher education. Universities in a global market are increasingly concerned to reorient their degree programmes to meet the vocational needs of the Knowledge Economy. A growing adoption of technology enhanced learning, through blended and networked learning, has the potential to transform higher education practice – but assessment methods have been slow to change. This paper argues the case for universities to align assessment methods to meet the needs of 21st Century knowledge workers. It identifies skills and dispositions associated with graduate occupations in the Knowledge Economy, informing a new conceptual model for assessment. Radical recommendations are made to faculty staff and university policymakers: instead of centring assessment on the personal, academic achievements of individuals at the end of a degree course, the focus should instead be on the quality of the collective, applied achievements of students operating in project teams

Developing Learning Analytics for Epistemic Commitments in a Collaborative Information Seeking Environment

Learning analytics sits at the confluence of learning, information, and computer sciences. Using a distinctive account of learning analytics as a form of assessment, I first argue for its potential in pedagogically motivated learning design, suggesting a particular construct – epistemic cognition in literacy contexts – to probe using learning analytics. I argue for a recasting of epistemic cognition as ‘epistemic commitments’ in collaborative information tasks drawing a novel alignment between information seeking and multiple document processing (MDP) models, with empirical and theoretical grounding given for a focus on collaboration and dialogue in such activities. Thus, epistemic commitments are seen in the ways students seek, select, and integrate claims from multiple sources, and the ways in which their collaborative dialogue is brought to bear in this activity. Accordingly, the empirical element of the thesis develops two pedagogically grounded literacy based tasks: a MDP task, in which pre-selected documents were provided to students; and a collaborative information seeking task (CIS), in which students could search the web. These tasks were deployed at scale (n > 500) and involved writing an evaluative review, followed by a pedagogically supported peer assessment task. Assessment outcomes were analysed in the context of a new epistemic commitments-oriented set of trace data, and psychometric data regarding the participants’ epistemic cognition. Demonstrating the value of the methodological and conceptual approach taken, qualitative analyses indicate clear epistemic activity, and stark differences in behaviour between groups, the complexity of which is challenging to model computationally. Despite this complexity, quantitative analyses indicate that up to 30% of variance in output scores can be modelled using behavioural indicators. The explanatory potential of behaviourally-oriented models of epistemic commitments grounded in tool-interaction and collaborative dialogue is demonstrated. The thesis provides an exemplification of theoretically positioned analytic development, drawing on interdisciplinary literatures in addressing complex learning contexts

Traversing Across Learning Environments And The Need For A Single Data Standard In Digital Learning Environments

As Big Data becomes ever present in many industries, in education it presents a particularly interesting problem as many technologies begin to develop, data standards become variant. This raises the issue that ad-hoc data standards present discontinuity across platforms particularly in the analysis and interpretation of data collected in Personalised Learning Environments. This presents an ethical dilemma when this data becomes actionable and active in decision making regarding a learners’ progress and advancement. This article asserts that there exists a hypothetical dilemma in the predicament that ad-hoc data standards result in potentially misleading or erroneous interpretations that have longitudinal effects for learners. This also raises other ethical implications for who has access to such data and at what level should access be granted. This article postulates that it is important therefore for educational technologies should maintain a common, or single, data standard where uniformity and commonality of understanding between variables can be determined mitigating variance through misinterpretation. Finally, contemporary technologies such as Experience API are discussed that endeavour to address concerns relating to a single data standard and its relationship to Activity Theory and by extension pedagogy. This article’s primary focus is to bring to light the necessity for diligence when developing data-driven educational technologies and the potential issues for the system itself. There will also be implications for the educator’s usage of informed intervention and the longitudinal effects on the learner

Innovating Pedagogy 2015: Open University Innovation Report 4

This series of reports explores new forms of teaching, learning and assessment for an interactive world, to guide teachers and policy makers in productive innovation. This fourth report proposes ten innovations that are already in currency but have not yet had a profound influence on education. To produce it, a group of academics at the Institute of Educational Technology in The Open University collaborated with researchers from the Center for Technology in Learning at SRI International. We proposed a long list of new educational terms, theories, and practices. We then pared these down to ten that have the potential to provoke major shifts in educational practice, particularly in post-school education. Lastly, we drew on published and unpublished writings to compile the ten sketches of new pedagogies that might transform education. These are summarised below in an approximate order of immediacy and timescale to widespread implementation

Critical perspectives on writing analytics

Writing Analytics focuses on the measurement and analysis of written texts for the purpose of understanding writing processes and products, in their educational contexts, and improving the teaching and learning of writing. This workshop adopts a critical, holistic perspective in which the definition of "the system" and "success" is not restricted to IR metrics such as precision and recall, but recognizes the many wider issues that aid or obstruct analytics adoption in educational settings, such as theoretical and pedagogical grounding, usability, user experience, stakeholder design engagement, practitioner development, organizational infrastructure, policy and ethics

Social learning analytics: Navigating the changing settings of higher education.

Current trends and challenges in higher education (HE) require a reorientation towards openness, technology use and active student participation. In this article we will introduce Social Learning Analytics (SLA) as instrumental in formative assessment practices, aimed at supporting and strengthening students as active learners in increasingly open and social learning environments. The analysis of digital traces of students’ learning behaviors provides insight into learning opportunities and can raise students’ awareness about where to be and whom to join. Against the background of these HE trends and challenges, we discuss opportunities for applying SLA to support open learning practices, that will move students from awareness to productive engagement in learning activities that promote co–construction of knowledge

An Educational Philosophy Perspective On Teaching in Contemporary Curriculum Development

Current research supports the significance of critical consciousness development in the educational process. The research on reflective participatory learning and critical consciousness to foster critical consciousness in higher education may be far superior, notwithstanding a few shortcomings. More research is needed to determine the nature of critical consciousness in the higher education curriculum's philosophy of education and the best ways to support these students' vital development of consciousness. The critical consciousness technique was used in this investigation, and critical consciousness as a theoretical paradigm in education philosophy seeks to address multi-systemic oppression. All educational initiatives, including curricular decisions are grounded on philosophy. Critical consciousness encourages educators and students to consider other identities' viewpoints when reading and evaluating texts. It extends the goal of education to a more excellent social environment; this content critique and analysis method humanizes the learning process. Philosophy looks for and makes visible the good that all people should pursue and focus their deliberate education toward. In philosophy, the curriculum is prescriptive since it specifies the broad guidelines, courses, and disciplines that should be completed to earn a particular grade or standard. Like philosophy, the curriculum is normative and has guiding ideas and theories. Philosophy becomes a benchmark by which to evaluate the objectives, curriculum choices, and education delivery methods. Curriculum must be understood that they are constantly faced with making decisions about curricula and that philosophy plays a significant role in the decision-making process