Transforming a competency model to assessment items

The problem of comparing and matching different learners’ knowledge arises when assessment systems use a one-dimensional numerical value to represent “knowledge level”. Such assessment systems may measure inconsistently because they estimate this level differently and inadequately. The multi-dimensional competency model called COMpetence-Based learner knowledge for personalized Assessment (COMBA) is being developed to represent a learner’s knowledge in a multi-dimensional vector space. The heart of this model is to treat knowledge, not as possession, but as a contextualized space of capability either actual or potential. The paper discusses the automatic generation of an assessment from the COMBA competency model as a “guideon- the–side”

Towards a competency model for adaptive assessment to support lifelong learning

Adaptive assessment provides efficient and personalised routes to establishing the proficiencies of learners. We can envisage a future in which learners are able to maintain and expose their competency profile to multiple services, throughout their life, which will use the competency information in the model to personalise assessment. Current competency standards tend to over simplify the representation of competency and the knowledge domain. This paper presents a competency model for evaluating learned capability by considering achieved competencies to support adaptive assessment for lifelong learning. This model provides a multidimensional view of competencies and provides for interoperability between systems as the learner progresses through life. The proposed competency model is being developed and implemented in the JISC-funded Placement Learning and Assessment Toolkit (mPLAT) project at the University of Southampton. This project which takes a Service-Oriented approach will contribute to the JISC community by adding mobile assessment tools to the E-framework

An evaluation of pedagogically informed parameterised questions for self assessment

Self-assessment is a crucial component of learning. Learners can learn by asking themselves questions and attempting to answer them. However, creating effective questions is time-consuming because it may require considerable resources and the skill of critical thinking. Questions need careful construction to accurately represent the intended learning outcome and the subject matter involved. There are very few systems currently available which generate questions automatically, and these are confined to specific domains. This paper presents a system for automatically generating questions from a competency framework, based on a sound pedagogical and technological approach. This makes it possible to guide learners in developing questions for themselves, and to provide authoring templates which speed the creation of new questions for self-assessment. This novel design and implementation involves an ontological database that represents the intended learning outcome to be assessed across a number of dimensions, including level of cognitive ability and subject matter. The system generates a list of all the questions that are possible from a given learning outcome, which may then be used to test for understanding, and so could determine the degree to which learners actually acquire the desired knowledge. The way in which the system has been designed and evaluated is discussed, along with its educational benefits

Transforming a competency model to assessment items

The problem of comparing and matching different learners’ knowledge arises when assessment systems use a one-dimensional numerical value to represent “knowledge level”. Such assessment systems may measure inconsistently because they estimate this level differently and inadequately. The multi-dimensional competency model called COMpetence-Based learner knowledge for personalized Assessment (COMBA) is being developed to represent a learner’s knowledge in a multi-dimensional vector space. The heart of this model is to treat knowledge, not as possession, but as a contextualized space of capability either actual or potential. The paper discusses the automatic generation of an assessment from the COMBA competency model as a “guide-on-the–side”

The effect of organizational culture on CRM success

Copyright @ 2013 EMCIS.The aim of this paper is to develop a theoretical framework exemplifying the effect of organizational culture on the success of Customer Relationship Management (CRM) systems' implementation. This is deemed significant as yet little research has investigated the role of organizational culture as a critical success factor to CRM implementation. The proposed theoretical framework is developed based on the notion that nurturing an organizational culture that promotes adaptive learning leads to better management of customer information that in turn improves the quality of customer information, which is considered a key contributor to successful implementation of CRM initiatives. The Competing Values Framework (CVF) is used to measure "Organizational Culture" since it has proven its validity in examining the effect of organizational culture on organizational effectiveness and performance

Simulation of learning in supply partnerships

This paper introduces a general, formal treatment of dynamic constraints, i.e., constraints on the state changes that are allowed in a given state space. Such dynamic constraints can be seen as representations of "real world" constraints in a managerial context. The notions of transition, reversible and irreversible transition, and transition relation will be introduced. The link with Kripke models (for modal logics) is also made explicit. Several (subtle) examples of dynamic constraints will be given. Some important classes of dynamic constraints in a database context will be identified, e.g. various forms of cumulativity, non-decreasing values, constraints on initial and final values, life cycles, changing life cycles, and transition and constant dependencies. Several properties of these dependencies will be treated. For instance, it turns out that functional dependencies can be considered as "degenerated" transition dependencies. Also, the distinction between primary keys and alternate keys is reexamined, from a dynamic point of view.

Innovation as an Emerging System Property: An Agent Based Simulation Model

The paper elaborates the notion of innovation as an emerging property of complex system dynamics and presents an agent-based simulation model (ABM) of an economy where systemic knowledge interactions among heterogeneous agents are crucial for the recombinant generation of new technological knowledge and the introduction of innovations. In this approach the organization of the system plays a crucial role in assessing the chances of individual firms to actually introduce innovations because it qualifies the access to external knowledge, an indispensable input, together with internal learning and research activities, into the recombinant generation of new knowledge. The introduction of innovations is analyzed as the result of systemic knowledge interactions among myopic agents that are credited with an extended procedural rationality that includes forms of creative reaction. The creative reaction of agents may lead to the introduction of productivity enhancing innovations. This takes place only when the structural, organizational and institutional characteristics of the system are such that agents, reacting to out-of-equilibrium conditions, can actually take advantage of external knowledge available within the innovation system into which they are embedded to generate new technological knowledge. The ABM enables one to explore effects of alternative organizational features of the systems, namely different configurations of the intellectual property right regimes and different architectural configurations of the regional structure into which knowledge interactions take place, on the rates of introduction of technological innovations. The results of the ABM suggest that the dissemination of knowledge favors the emergence of creative reactions and hence faster rates of introduction of technological innovations.Complex System Dynamics, Innovation, Emergent Property, Technological Knowledge, Intellectual Property Rights, Knowledge Dissemination

Developing the scales on evaluation beliefs of student teachers

The purpose of the study reported in this paper was to investigate the validity and the reliability of a newly developed questionnaire named ‘Teacher Evaluation Beliefs’ (TEB). The framework for developing items was provided by the two models. The first model focuses on Student-Centered and Teacher-Centered beliefs about evaluation while the other centers on five dimensions (what/ who/ when/ why/ how). The validity and reliability of the new instrument was investigated using both exploratory and confirmatory factor analysis study (n=446). Overall results indicate that the two-factor structure is more reasonable than the five-factor one. Further research needs additional items about the latent dimensions “what” ”who” ”when” ”why” “how” for each existing factor based on Student-centered and Teacher-centered approaches

Herbert Simon's decision-making approach: Investigation of cognitive processes in experts

This is a post print version of the article. The official published can be obtained from the links below - PsycINFO Database Record (c) 2010 APA, all rights reserved.Herbert Simon's research endeavor aimed to understand the processes that participate in human decision making. However, despite his effort to investigate this question, his work did not have the impact in the “decision making” community that it had in other fields. His rejection of the assumption of perfect rationality, made in mainstream economics, led him to develop the concept of bounded rationality. Simon's approach also emphasized the limitations of the cognitive system, the change of processes due to expertise, and the direct empirical study of cognitive processes involved in decision making. In this article, we argue that his subsequent research program in problem solving and expertise offered critical tools for studying decision-making processes that took into account his original notion of bounded rationality. Unfortunately, these tools were ignored by the main research paradigms in decision making, such as Tversky and Kahneman's biased rationality approach (also known as the heuristics and biases approach) and the ecological approach advanced by Gigerenzer and others. We make a proposal of how to integrate Simon's approach with the main current approaches to decision making. We argue that this would lead to better models of decision making that are more generalizable, have higher ecological validity, include specification of cognitive processes, and provide a better understanding of the interaction between the characteristics of the cognitive system and the contingencies of the environment