Reuse of Neural Modules for General Video Game Playing

A general approach to knowledge transfer is introduced in which an agent controlled by a neural network adapts how it reuses existing networks as it learns in a new domain. Networks trained for a new domain can improve their performance by routing activation selectively through previously learned neural structure, regardless of how or for what it was learned. A neuroevolution implementation of this approach is presented with application to high-dimensional sequential decision-making domains. This approach is more general than previous approaches to neural transfer for reinforcement learning. It is domain-agnostic and requires no prior assumptions about the nature of task relatedness or mappings. The method is analyzed in a stochastic version of the Arcade Learning Environment, demonstrating that it improves performance in some of the more complex Atari 2600 games, and that the success of transfer can be predicted based on a high-level characterization of game dynamics.Comment: Accepted at AAAI 1

ICOPER Project - Deliverable 4.3 ISURE: Recommendations for extending effective reuse, embodied in the ICOPER CD&R

The purpose of this document is to capture the ideas and recommendations, within and beyond the ICOPER community, concerning the reuse of learning content, including appropriate methodologies as well as established strategies for remixing and repurposing reusable resources. The overall remit of this work focuses on describing the key issues that are related to extending effective reuse embodied in such materials. The objective of this investigation, is to support the reuse of learning content whilst considering how it could be originally created and then adapted with that ‘reuse’ in mind. In these circumstances a survey on effective reuse best practices can often provide an insight into the main challenges and benefits involved in the process of creating, remixing and repurposing what we are now designating as Reusable Learning Content (RLC). Several key issues are analysed in this report: Recommendations for extending effective reuse, building upon those described in the previous related deliverables 4.1 Content Development Methodologies and 4.2 Quality Control and Web 2.0 technologies. The findings of this current survey, however, provide further recommendations and strategies for using and developing this reusable learning content. In the spirit of ‘reuse’, this work also aims to serve as a foundation for the many different stakeholders and users within, and beyond, the ICOPER community who are interested in reusing learning resources. This report analyses a variety of information. Evidence has been gathered from a qualitative survey that has focused on the technical and pedagogical recommendations suggested by a Special Interest Group (SIG) on the most innovative practices with respect to new media content authors (for content authoring or modification) and course designers (for unit creation). This extended community includes a wider collection of OER specialists. This collected evidence, in the form of video and audio interviews, has also been represented as multimedia assets potentially helpful for learning and useful as learning content in the New Media Space (See section 4 for further details). Section 2 of this report introduces the concept of reusable learning content and reusability. Section 3 discusses an application created by the ICOPER community to enhance the opportunities for developing reusable content. Section 4 of this report provides an overview of the methodology used for the qualitative survey. Section 5 presents a summary of thematic findings. Section 6 highlights a list of recommendations for effective reuse of educational content, which were derived from thematic analysis described in Appendix A. Finally, section 7 summarises the key outcomes of this work

From open content to open thinking

So far Open Educational Resources (OER) research has focused on the objective to 'open' education by making accessible free educational resources to the world. In the latest years the movement has matured, and a growing amount of OER have been made available by universities, researchers and scholars through several portals. Nonetheless, the level of adoption of OERs into common teaching practices remains quite low. In this paper we suggest that one of the main barriers to OER's adoption is the lack of 'opening up' to people's thinking around OERs and we propose Cohere, a tool which aims at making this thinking visible and exportable in ways that support the emergence of 'collective intelligence' around OERs research. Accessing Collective Intelligence (CI) around OERs is presented as a medium to know and understand what people think, how people design and use OERs thus increasing the easy of re-use of OER in learning and research practices

COLLABORATIVE PORTAL MODEL FOR INTERCULTURAL TEAMS KNOWLEDGE MANAGEMENT

In the multinational organizations, more groups of individuals are being involved in the process of knowledge creation in a collaborative manner, of sharing knowledge and learning from it. These individuals can have heterogeneous cultures and they must use a common language. IT has created and is developing the infrastructure for cross-cultural communications and intercultural knowledge management. Nowadays, intercultural knowledge management can be realized with support of Collaborative Technologies and Knowledge Management Support Systems (KMSS). In this respect Collaborative Technologies and Intercultural Knowledge Management Support Systems (IKMSS) will be the appropriate way for supporting intercultural communication, learning and collaborative knowledge management in organizations. In this paper we present a conceptual model of a collaborative portal for Intercultural Team Knowledge Management as a powerful support for increasing team’s performance.: collaborative support, collaboration, knowledge management, intercultural teams, intercultural knowledge management, intercultural knowledge management portal

Distribution-Based Categorization of Classifier Transfer Learning

Transfer Learning (TL) aims to transfer knowledge acquired in one problem, the source problem, onto another problem, the target problem, dispensing with the bottom-up construction of the target model. Due to its relevance, TL has gained significant interest in the Machine Learning community since it paves the way to devise intelligent learning models that can easily be tailored to many different applications. As it is natural in a fast evolving area, a wide variety of TL methods, settings and nomenclature have been proposed so far. However, a wide range of works have been reporting different names for the same concepts. This concept and terminology mixture contribute however to obscure the TL field, hindering its proper consideration. In this paper we present a review of the literature on the majority of classification TL methods, and also a distribution-based categorization of TL with a common nomenclature suitable to classification problems. Under this perspective three main TL categories are presented, discussed and illustrated with examples

Knowledge re-use for decision support

Effective decision support has already been identified as a fundamental requirement for the realisation of Network Enabled Capability. Decision making itself is a knowledge-intensive process, and it is known that right decisions can only be reached based on decision maker's good judgement, which in turn is based on sufficient knowledge. It is not unusual for decision makers to make incorrect decisions because of insufficient knowledge. However, it is not always possible for decision makers to have all the knowledge needed for making decisions in complex situations without external support. The re-use of knowledge has been identified as providing an important contribution to such support, and this paper considers one, hitherto unexplored, aspect of how this may be achieved. This paper is concerned with the computational view of knowledge re-use to establish an understanding of a knowledge-based system for decision support. The paper explores knowledge re-use for decision support from two perspectives: knowledge provider's and knowledge re-user's. Key issues and challenges of knowledge re-use are identified from both perspectives. A structural model for knowledge re-use is proposed with initial evaluation through empirical study of both experienced and novice decision maker's behaviour in reusing knowledge to make decisions. The proposed structural model for knowledge re-use captures five main elements (knowledge re-uers, knowledge types, knowledge sources, environment, and integration strategies) as well as the relationships between the elements, which forms a foundation for constructing a knowledge-based decision support system. The paper suggests that further research should be investigating the relationship between knowledge re-use and learning to achieve intelligent decision support