Towards a competency model for adaptive assessment to support lifelong learning

Adaptive assessment provides efficient and personalised routes to establishing the proficiencies of learners. We can envisage a future in which learners are able to maintain and expose their competency profile to multiple services, throughout their life, which will use the competency information in the model to personalise assessment. Current competency standards tend to over simplify the representation of competency and the knowledge domain. This paper presents a competency model for evaluating learned capability by considering achieved competencies to support adaptive assessment for lifelong learning. This model provides a multidimensional view of competencies and provides for interoperability between systems as the learner progresses through life. The proposed competency model is being developed and implemented in the JISC-funded Placement Learning and Assessment Toolkit (mPLAT) project at the University of Southampton. This project which takes a Service-Oriented approach will contribute to the JISC community by adding mobile assessment tools to the E-framework

An evaluation of pedagogically informed parameterised questions for self assessment

Self-assessment is a crucial component of learning. Learners can learn by asking themselves questions and attempting to answer them. However, creating effective questions is time-consuming because it may require considerable resources and the skill of critical thinking. Questions need careful construction to accurately represent the intended learning outcome and the subject matter involved. There are very few systems currently available which generate questions automatically, and these are confined to specific domains. This paper presents a system for automatically generating questions from a competency framework, based on a sound pedagogical and technological approach. This makes it possible to guide learners in developing questions for themselves, and to provide authoring templates which speed the creation of new questions for self-assessment. This novel design and implementation involves an ontological database that represents the intended learning outcome to be assessed across a number of dimensions, including level of cognitive ability and subject matter. The system generates a list of all the questions that are possible from a given learning outcome, which may then be used to test for understanding, and so could determine the degree to which learners actually acquire the desired knowledge. The way in which the system has been designed and evaluated is discussed, along with its educational benefits

Models of everywhere revisited: a technological perspective

The concept ‘models of everywhere’ was first introduced in the mid 2000s as a means of reasoning about the environmental science of a place, changing the nature of the underlying modelling process, from one in which general model structures are used to one in which modelling becomes a learning process about specific places, in particular capturing the idiosyncrasies of that place. At one level, this is a straightforward concept, but at another it is a rich multi-dimensional conceptual framework involving the following key dimensions: models of everywhere, models of everything and models at all times, being constantly re-evaluated against the most current evidence. This is a compelling approach with the potential to deal with epistemic uncertainties and nonlinearities. However, the approach has, as yet, not been fully utilised or explored. This paper examines the concept of models of everywhere in the light of recent advances in technology. The paper argues that, when first proposed, technology was a limiting factor but now, with advances in areas such as Internet of Things, cloud computing and data analytics, many of the barriers have been alleviated. Consequently, it is timely to look again at the concept of models of everywhere in practical conditions as part of a trans-disciplinary effort to tackle the remaining research questions. The paper concludes by identifying the key elements of a research agenda that should underpin such experimentation and deployment

Genisa: A web-based interactive learning environment for teaching simulation modelling

Intelligent Tutoring Systems (ITS) provide students with adaptive instruction and can facilitate the acquisition of problem solving skills in an interactive environment. This paper discusses the role of pedagogical strategies that have been implemented to facilitate the development of simulation modelling knowledge. The learning environment integrates case-based reasoning with interactive tools to guide tutorial remediation. The evaluation of the system shows that the model for pedagogical activities is a useful method for providing efficient simulation modelling instruction

The evolving landscape of learning technology

This paper provides an overview of the current and emerging issues in learning technology research, concentrating on structural issues such as infrastructure, policy and organizational context. It updates the vision of technology outlined by Squires’ (1999) concept of peripatetic electronic teachers (PETs) where Information and Communication Technologies (ICT) provide an enabling medium to allow teachers to act as freelance agents in a virtual world and reflects to what extent this vision has been realized The paper begins with a survey of some of the key areas of ICT development and provides a contextualizing framework for the area in terms of external agendas and policy drivers. It then focuses upon learning technology developments which have occurred in the last five years in the UK and offers a number of alternative taxonomies to describe this. The paper concludes with a discussion of the issues which arise from this work

Improving instructional effectiveness with computer‐mediated communication

This study explores the use of asynchronous Computer‐Mediated Communication (CMC) in the delivery of instructional content, and points up the interaction among learners, as well as between learners and instructors. The instructional content in the project described was available to learners online as Microsoft Word documents, with email being used for communicating within the student group. Many students, as well as some of the instructors, felt uncomfortable with the flexibility and openness that a CMC environment allowed. However, once familiar with this process of instruction and interaction, learners were able to work consistently at their own pace, and understand that instructors are interested in every individual learner's opinion and in the collective views of the group. It was evident that a CMC‐based instructional delivery system, when carefully planned, has the potential to facilitate that outcome, and to improve instructional effectiveness

Adaptive development and maintenance of user-centric software systems

A software system cannot be developed without considering the various facets of its environment. Stakeholders – including the users that play a central role – have their needs, expectations, and perceptions of a system. Organisational and technical aspects of the environment are constantly changing. The ability to adapt a software system and its requirements to its environment throughout its full lifecycle is of paramount importance in a constantly changing environment. The continuous involvement of users is as important as the constant evaluation of the system and the observation of evolving environments. We present a methodology for adaptive software systems development and maintenance. We draw upon a diverse range of accepted methods including participatory design, software architecture, and evolutionary design. Our focus is on user-centred software systems

Assessment of Generic Skills through an Organizational Learning Process Model

This contribution has been published in this repository with the permission of the publisher. This contribution was presented in WEBIST 2018 (http://www.webist.org/?y=2018) and has been published by SCITEPRESS in http://www.scitepress.org/PublicationsDetail.aspx?ID=y9Yt0eHt02o=&.The performance in generic skills is increasingly important for organizations to succeed in the current competitive environment. However, assessing the level of performance in generic skills of the members of an organization is a challenging task, subject to both subjectivity and scalability issues. Organizations usually lay their organizational learning processes on a Knowledge Management System (KMS). This work presents a process model to support managers of KMSs in the assessment of their individuals’ generic skills. The process model was deployed through an extended version of a learning management system. It was connected with different information system tools specifically developed to enrich its features. A case study with Computer Science final-year students working in a software system was conducted following an authentic learning approach, showing promising results.Visaigle Project (grant TIN2017-85797-R)