Towards a competency model for adaptive assessment to support lifelong learning

Adaptive assessment provides efficient and personalised routes to establishing the proficiencies of learners. We can envisage a future in which learners are able to maintain and expose their competency profile to multiple services, throughout their life, which will use the competency information in the model to personalise assessment. Current competency standards tend to over simplify the representation of competency and the knowledge domain. This paper presents a competency model for evaluating learned capability by considering achieved competencies to support adaptive assessment for lifelong learning. This model provides a multidimensional view of competencies and provides for interoperability between systems as the learner progresses through life. The proposed competency model is being developed and implemented in the JISC-funded Placement Learning and Assessment Toolkit (mPLAT) project at the University of Southampton. This project which takes a Service-Oriented approach will contribute to the JISC community by adding mobile assessment tools to the E-framework

An evaluation of pedagogically informed parameterised questions for self assessment

Self-assessment is a crucial component of learning. Learners can learn by asking themselves questions and attempting to answer them. However, creating effective questions is time-consuming because it may require considerable resources and the skill of critical thinking. Questions need careful construction to accurately represent the intended learning outcome and the subject matter involved. There are very few systems currently available which generate questions automatically, and these are confined to specific domains. This paper presents a system for automatically generating questions from a competency framework, based on a sound pedagogical and technological approach. This makes it possible to guide learners in developing questions for themselves, and to provide authoring templates which speed the creation of new questions for self-assessment. This novel design and implementation involves an ontological database that represents the intended learning outcome to be assessed across a number of dimensions, including level of cognitive ability and subject matter. The system generates a list of all the questions that are possible from a given learning outcome, which may then be used to test for understanding, and so could determine the degree to which learners actually acquire the desired knowledge. The way in which the system has been designed and evaluated is discussed, along with its educational benefits

Acceptance of competency-based workplace e-learning systems: Effects of individual and peer learning support

Current endeavors to integrate competency-based learning approaches with e-learning systems designed for delivery of training to adult learners in the workplace are growing. However, academic efforts in examining learners' perceptions of, and reactions toward, this technology-delivered pedagogical innovation are limited. Drawing together perspectives from the literature on training and instructional design and technology acceptance, this research proposed a conceptual model to examine the influences of perceived individual and social learning support on employees' acceptance of competency-based e-learning systems. Structural equation modeling and multi-group structural equation modeling techniques were applied to sample data collected from work settings in Mainland China. The results show the positive effects of perceived individual learning support and perceived support for promoting a norm of cooperation on employees' intention to use the competency-based e-learning system. It was also found that perceived support for enhancing social ties had a negative effect on employees' behavioral intention. The gender, age, prior experience, and work experience differences in the main effects were also investigated. Besides, qualitative data collected via semi-structured in-depth interview provide complementary evidence to the findings. © 2011 Elsevier Ltd. All rights reserved.postprin

A Causal-Comparative Study on the Efficacy of Intelligent Tutoring Systems on Middle-Grade Math Achievement

This study is a quantitative examination of intelligent tutoring systems in two similar suburban middle schools (grades 6-8) in the Southeastern United States. More specifically, it is a causal-comparative study purposed with examining the efficacy of intelligent tutoring systems as they relate to math achievement for students at two similar middle schools in the Midlands of South Carolina. The independent variable, use of an intelligent tutoring system in math instruction, is defined as the supplementary use of two intelligent tutoring systems, Pearson’s Math Digits and IXL, for math instruction. The dependent variable is math achievement as determined by the Measures of Academic Progress (MAP) SC 6+Math test. The student data examined is archived MAP SC 6+ Math scores from the 2017-2018 school year. A one-way ANCOVA was used to compare the mean achievement gain scores of both groups, students whose math instruction included intelligent tutoring systems and students whose math instruction did not include intelligent tutoring systems, to establish whether or not there was any statistically significant difference between the adjusted population means of the two independent groups. The results showed that the adjusted mean of posttest scores of students who did not receive math instruction that involved an intelligent tutoring system were significantly higher than those who did

Service-oriented coordination platform for technology-enhanced learning

It is currently difficult to coordinate learning processes, not only because multiple stakeholders are involved (such as students, teachers, administrative staff, technical staff), but also because these processes are driven by sophisticated rules (such as rules on how to provide learning material, rules on how to assess students’ progress, rules on how to share educational responsibilities). This is one of the reasons for the slow progress in technology-enhanced learning. Consequently, there is a clear demand for technological facilitation of the coordination of learning processes. In this work, we suggest some solution directions that are based on SOA (Service-Oriented Architecture). In particular, we propose a coordination service pattern consistent with SOA and based on requirements that follow from an analysis of both learning processes and potentially useful support technologies. We present the service pattern considering both functional and non-functional issues, and we address policy enforcement as well. Finally, we complement our proposed architecture-level solution directions with an example. The example illustrates our ideas and is also used to identify: (i) a short list of educational IT services; (ii) related non-functional concerns; they will be considered in future work