Assessing OER impact across varied organisations and learners: experiences from the "Bridge to Success" initiative

and detailed analysis of how resources impact learning. Simultaneously, it is inherent in the concept of OER that resources are to be used in different contexts and in varied ways. Encouraging institutions to appropriate resources to their needs is important to the effective application of OER. A major challenge is to develop research practices that can effectively evaluate this heterogeneous usage and impact. In this paper we consider experiences of assessing impact from Bridge to Success: an initiative in which online courses in mathematics and study skills, originally developed at the Open University UK, were remixed for a US audience and made available as OER. The released materials were subsequently used in more than 16 US-based institutions including colleges, universities, high schools, and projects to help the long-term unemployed. The materials were used in a variety of ways. In some cases, units of these open online courses were used as supplementary materials, whilst elsewhere the courses were used in drop-in labs and face-to-face sessions. In several contexts, the materials were provided to a cohort of students to help them prepare for formal assessments. In others, underachieving students were specifically targeted and advised to use the resources. This variety of pilot contexts provided a challenging dimension to understanding the value of the OER intervention to the learner. Understanding use is seen as a key component in the further development of OER (Atkins, Seely Brown & Hammond, 2007). However approaches to this where institutions have been encouraged to contextualise materials to their own needs are currently limited. We explore different approaches to evaluating this type of impact across contexts. Analysing data on frequency and type of access, learning gains, institutional enrolment and persistence of students are critical areas for this type of research, and require an understanding of institutional and learner characteristics, in addition to the varied ways in which the materials are facilitated. Openness creates challenges for researchers to collect and link data about all kinds of use. For example, institutions collect information on enrolment, assessment and retention in different formats: this data can be sensitive or difficult to share. In addition, to truly understand impact, researchers need to be able to distinguish different forms of resource use and connect this to specific user groups. The paper evaluates our experiences by defining the types of impact data required by a range of stakeholders, and the achievements and challenges in delivering this information as part of the Bridge to Success initiative. A wide range of quantitative and qualitative methods were used in researching the impact of the initiative, but limitations exist in our current ability to understand use and to link this to the requirements of the different contexts of use. Based on both the successes and failures we had in monitoring impact we outline suggested approaches towards an effective general model for assessing OER impact

Institutional legacies in TNCs and their management through training academies: the case of transnational law firms in Italy

This paper highlights the effects of heterogeneous institutional contexts on transnational professional service firms, a relatively understudied issue. Specifically the paper provides empirical analysis of how the specificities of the Italian institutional context affect the activities of English legal professional service firms in Milan. This reveals the intimate connection between varieties of capitalisms, place-specific workplace cultures and practices, and the institution-related challenges transnational professional service firms and all transnational corporations (TNCs) face. The paper also reveals the way institutionally generated differences at the level of work practices are managed in transnational law firms through worldwide training programmes designed to ‘govern’ the practices of workers in different parts of the TNC’s network. This highlights the importance of studying attempts to manage institutional heterogeneity at the level of workplace practices, something often missed in existing meso-scale studies of TNCs’ governance structures. Consequently, detailed empirical archaeologies exploring the direct links between institutions and practices are highlighted as being an important as part of future research analysing the effects of institutions on TNCs

Advanced Knowledge Technologies at the Midterm: Tools and Methods for the Semantic Web

The University of Edinburgh and research sponsors are authorised to reproduce and distribute reprints and on-line copies for their purposes notwithstanding any copyright annotation hereon. The views and conclusions contained herein are the author’s and shouldn’t be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of other parties.In a celebrated essay on the new electronic media, Marshall McLuhan wrote in 1962:Our private senses are not closed systems but are endlessly translated into each other in that experience which we call consciousness. Our extended senses, tools, technologies, through the ages, have been closed systems incapable of interplay or collective awareness. Now, in the electric age, the very instantaneous nature of co-existence among our technological instruments has created a crisis quite new in human history. Our extended faculties and senses now constitute a single field of experience which demands that they become collectively conscious. Our technologies, like our private senses, now demand an interplay and ratio that makes rational co-existence possible. As long as our technologies were as slow as the wheel or the alphabet or money, the fact that they were separate, closed systems was socially and psychically supportable. This is not true now when sight and sound and movement are simultaneous and global in extent. (McLuhan 1962, p.5, emphasis in original)Over forty years later, the seamless interplay that McLuhan demanded between our technologies is still barely visible. McLuhan’s predictions of the spread, and increased importance, of electronic media have of course been borne out, and the worlds of business, science and knowledge storage and transfer have been revolutionised. Yet the integration of electronic systems as open systems remains in its infancy.Advanced Knowledge Technologies (AKT) aims to address this problem, to create a view of knowledge and its management across its lifecycle, to research and create the services and technologies that such unification will require. Half way through its sixyear span, the results are beginning to come through, and this paper will explore some of the services, technologies and methodologies that have been developed. We hope to give a sense in this paper of the potential for the next three years, to discuss the insights and lessons learnt in the first phase of the project, to articulate the challenges and issues that remain.The WWW provided the original context that made the AKT approach to knowledge management (KM) possible. AKT was initially proposed in 1999, it brought together an interdisciplinary consortium with the technological breadth and complementarity to create the conditions for a unified approach to knowledge across its lifecycle. The combination of this expertise, and the time and space afforded the consortium by the IRC structure, suggested the opportunity for a concerted effort to develop an approach to advanced knowledge technologies, based on the WWW as a basic infrastructure.The technological context of AKT altered for the better in the short period between the development of the proposal and the beginning of the project itself with the development of the semantic web (SW), which foresaw much more intelligent manipulation and querying of knowledge. The opportunities that the SW provided for e.g., more intelligent retrieval, put AKT in the centre of information technology innovation and knowledge management services; the AKT skill set would clearly be central for the exploitation of those opportunities.The SW, as an extension of the WWW, provides an interesting set of constraints to the knowledge management services AKT tries to provide. As a medium for the semantically-informed coordination of information, it has suggested a number of ways in which the objectives of AKT can be achieved, most obviously through the provision of knowledge management services delivered over the web as opposed to the creation and provision of technologies to manage knowledge.AKT is working on the assumption that many web services will be developed and provided for users. The KM problem in the near future will be one of deciding which services are needed and of coordinating them. Many of these services will be largely or entirely legacies of the WWW, and so the capabilities of the services will vary. As well as providing useful KM services in their own right, AKT will be aiming to exploit this opportunity, by reasoning over services, brokering between them, and providing essential meta-services for SW knowledge service management.Ontologies will be a crucial tool for the SW. The AKT consortium brings a lot of expertise on ontologies together, and ontologies were always going to be a key part of the strategy. All kinds of knowledge sharing and transfer activities will be mediated by ontologies, and ontology management will be an important enabling task. Different applications will need to cope with inconsistent ontologies, or with the problems that will follow the automatic creation of ontologies (e.g. merging of pre-existing ontologies to create a third). Ontology mapping, and the elimination of conflicts of reference, will be important tasks. All of these issues are discussed along with our proposed technologies.Similarly, specifications of tasks will be used for the deployment of knowledge services over the SW, but in general it cannot be expected that in the medium term there will be standards for task (or service) specifications. The brokering metaservices that are envisaged will have to deal with this heterogeneity.The emerging picture of the SW is one of great opportunity but it will not be a wellordered, certain or consistent environment. It will comprise many repositories of legacy data, outdated and inconsistent stores, and requirements for common understandings across divergent formalisms. There is clearly a role for standards to play to bring much of this context together; AKT is playing a significant role in these efforts. But standards take time to emerge, they take political power to enforce, and they have been known to stifle innovation (in the short term). AKT is keen to understand the balance between principled inference and statistical processing of web content. Logical inference on the Web is tough. Complex queries using traditional AI inference methods bring most distributed computer systems to their knees. Do we set up semantically well-behaved areas of the Web? Is any part of the Web in which semantic hygiene prevails interesting enough to reason in? These and many other questions need to be addressed if we are to provide effective knowledge technologies for our content on the web

Challenges in Bridging Social Semantics and Formal Semantics on the Web

This paper describes several results of Wimmics, a research lab which names stands for: web-instrumented man-machine interactions, communities, and semantics. The approaches introduced here rely on graph-oriented knowledge representation, reasoning and operationalization to model and support actors, actions and interactions in web-based epistemic communities. The re-search results are applied to support and foster interactions in online communities and manage their resources

Requirements modelling and formal analysis using graph operations

The increasing complexity of enterprise systems requires a more advanced analysis of the representation of services expected than is currently possible. Consequently, the specification stage, which could be facilitated by formal verification, becomes very important to the system life-cycle. This paper presents a formal modelling approach, which may be used in order to better represent the reality of the system and to verify the awaited or existing system’s properties, taking into account the environmental characteristics. For that, we firstly propose a formalization process based upon properties specification, and secondly we use Conceptual Graphs operations to develop reasoning mechanisms of verifying requirements statements. The graphic visualization of these reasoning enables us to correctly capture the system specifications by making it easier to determine if desired properties hold. It is applied to the field of Enterprise modelling

Economic growth, innovation systems, and institutional change: a trilogy in five parts

Development and growth are products of the interplay and interaction among heterogeneous actors operating in specific institutional settings. There is a much alluded-to, but under-investigated, link between economic growth, innovation systems, and institutions. There is widespread agreement among most economists on the positive reinforcing link between innovation and growth. However, the importance of institutions as catalysts in this link has not been adequately examined. The concept of innovation systems has the potential to fill this gap. But these studies have not conducted in-depth institutional analyses or focussed on institutional transformation processes, thereby failing to link growth theory to the substantive institutional tradition in economics. In this paper we draw attention to the main shortcomings of orthodox and heterodox growth theories, some of which have been addressed by the more descriptive literature on innovation systems. Critical overviews of the literatures on growth and innovation systems are used as a foundation to propose a new perspective on the role of institutions and a framework for conducting institutional analysis using a multi-dimensional typology of institutions. The framework is then applied to cases of Taiwan and South Korea to highlight the instrumental role played by institutions in facilitating and curtailing economic development and growth

Assessing collaborative learning: big data, analytics and university futures

Traditionally, assessment in higher education has focused on the performance of individual students. This focus has been a practical as well as an epistemic one: methods of assessment are constrained by the technology of the day, and in the past they required the completion by individuals under controlled conditions, of set-piece academic exercises. Recent advances in learning analytics, drawing upon vast sets of digitally-stored student activity data, open new practical and epistemic possibilities for assessment and carry the potential to transform higher education. It is becoming practicable to assess the individual and collective performance of team members working on complex projects that closely simulate the professional contexts that graduates will encounter. In addition to academic knowledge this authentic assessment can include a diverse range of personal qualities and dispositions that are key to the computer-supported cooperative working of professionals in the knowledge economy. This paper explores the implications of such opportunities for the purpose and practices of assessment in higher education, as universities adapt their institutional missions to address 21st Century needs. The paper concludes with a strong recommendation for university leaders to deploy analytics to support and evaluate the collaborative learning of students working in realistic contexts