Relational Representations in Reinforcement Learning: Review and Open Problems

This paper is about representation in RL.We discuss some of the concepts in representation and generalization in reinforcement learning and argue for higher-order representations, instead of the commonly used propositional representations. The paper contains a small review of current reinforcement learning systems using higher-order representations, followed by a brief discussion. The paper ends with research directions and open problems.\u

Using the online cross-entropy method to learn relational policies for playing different games

By defining a video-game environment as a collection of objects, relations, actions and rewards, the relational reinforcement learning algorithm presented in this paper generates and optimises a set of concise, human-readable relational rules for achieving maximal reward. Rule learning is achieved using a combination of incremental specialisation of rules and a modified online cross-entropy method, which dynamically adjusts the rate of learning as the agent progresses. The algorithm is tested on the Ms. Pac-Man and Mario environments, with results indicating the agent learns an effective policy for acting within each environment

The role of Intangible Assets in the Relationship between HRM and Innovation: A Theoretical and Empirical Exploration

This paper, as far as known, provides a first attempt to explore the role of intellectual capital (IC) and knowledge management (KM) in an integrative way between the relationship of human resource (HR) practices and two types of innovation (radical and incremental). More specifically, the study investigates two sub-components of IC – human capital and organizational social capital. At the same time, four KM channels are discussed, such as knowledge creation, acquisition, transfer and responsiveness.\ud The research is a part of a bigger project financed by the Ministry of Economic Affairs and the province of Overijssel in the Netherlands. The project studies the ‘competencies for innovation’ and is conducted in collaboration with innovative companies in the Eastern part of the Netherlands. \ud An exploratory survey design with qualitative and quantitative data is used for\ud investigating the topic in six companies from industrial and service sector in the region of Twente, the Netherlands. Mostly, the respondents were HR directors. The findings showed that some parts of IC and KM configurations were related to different types of innovation. To make the picture even more complicated, HR practices were sometimes perceived interchangeably with IC and KM by HR directors. Overall, the whole picture about the relationships stays unclear and opens a floor for further research

Contracts, relationships and innovation in business-to-business exchanges

Purpose: – This paper aims to contrast two approaches to the study of contracts in business and industrial marketing: first, as a legal document in shaping at the outset exchanges and interactions, for instance in projects; and second, as relational norms in becoming integrated into a business relationship through interactions, for instance as a resource. Design/methodology/approach: – The paper draws on cross-case comparison of three projects, as actors develop an engineering service for optimizing the maintenance of large-scale capital equipment by analyzing real-time data from sensors and user records. Comparison is by coding interview and observational data as micro-sequences of interactions among actors. Findings: – Preparing contracts allows a project to commence and is an early form of interaction, intensifying new relationships or cutting into and recasting established ones. Relational norms augment and can supersede the early focus on the contract, thus incorporating incremental innovation and absorbing some uncertainties. Research limitations/implications: – The research approach benefits from detailed comparison and captures some variety across its three cases, but the discussion is limited to theoretical generalization. Practical implications: – The analysis and discussion highlights and focuses on when different approaches to understanding contracting are more apparent across durable business relationships. Transitions from a contractual document to a view of relational norms are subtle, vulnerable and not always made successfully. Originality/value: – This paper’s originality is in it comparison of overlapping approaches to understanding businesses’ uses of contacts in business and industrial marketing, of contract and relational norms. It develops a valuable research proposition, in the transition from a mainly contractual to a mainly relational uses of contracts, thus identifying contract as a particular business resource, to be deployed and embedded

Efficient Incremental Breadth-Depth XML Event Mining

Many applications log a large amount of events continuously. Extracting interesting knowledge from logged events is an emerging active research area in data mining. In this context, we propose an approach for mining frequent events and association rules from logged events in XML format. This approach is composed of two-main phases: I) constructing a novel tree structure called Frequency XML-based Tree (FXT), which contains the frequency of events to be mined; II) querying the constructed FXT using XQuery to discover frequent itemsets and association rules. The FXT is constructed with a single-pass over logged data. We implement the proposed algorithm and study various performance issues. The performance study shows that the algorithm is efficient, for both constructing the FXT and discovering association rules

Using Kernel Perceptrons to Learn Action Effects for Planning

Abstract — We investigate the problem of learning action effects in STRIPS and ADL planning domains. Our approach is based on a kernel perceptron learning model, where action and state information is encoded in a compact vector representation as input to the learning mechanism, and resulting state changes are produced as output. Empirical results of our approach indicate efficient training and prediction times, with low average error rates (< 3%) when tested on STRIPS and ADL versions of an object manipulation scenario. This work is part of a project to integrate machine learning techniques with a planning system, as part of a larger cognitive architecture linking a highlevel reasoning component with a low-level robot/vision system. I

Intellectual Capital Architectures and Bilateral Learning: A Framework For Human Resource Management

Both researchers and managers are increasingly interested in how firms can pursue bilateral learning; that is, simultaneously exploring new knowledge domains while exploiting current ones (cf., March, 1991). To address this issue, this paper introduces a framework of intellectual capital architectures that combine unique configurations of human, social, and organizational capital. These architectures support bilateral learning by helping to create supplementary alignment between human and social capital as well as complementary alignment between people-embodied knowledge (human and social capital) and organization-embodied knowledge (organizational capital). In order to establish the context for bilateral learning, the framework also identifies unique sets of HR practices that may influence the combinations of human, social, and organizational capital

The Effect of Alliance Block Membership on Innovative Performance

Alliance, membership, Innovation, performance

Information technology as boundary object for transformational learning

Collaborative work is considered as a way to improve productivity and value generation in construction. However, recent research demonstrates that socio-cognitive factors related to fragmentation of specialized knowledge may hinder team performance. New methods based on theories of practice are emerging in Computer Supported Collaborative Work and organisational learning to break these knowledge boundaries, facilitating knowledge sharing and the generation of new knowledge through transformational learning. According to these theories, objects used in professional practice play a key role in mediating interactions. Rules and methods related to these practices are also embedded in these objects. Therefore changing collaborative patterns demand reconfiguring objects that are at the boundary between specialized practices, namely boundary objects. This research is unique in presenting an IT strategy in which technology is used as a boundary object to facilitate transformational learning in collaborative design work