MC2: MPEG-7 content modelling communities

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel UniversityThe use of multimedia content on the web has grown significantly in recent years. Websites such as Facebook, YouTube and Flickr cater for enormous amounts of multimedia content uploaded by users. This vast amount of multimedia content requires comprehensive content modelling otherwise retrieving relevant content will be challenging. Modelling multimedia content can be an extremely time consuming task that may seem impossible particularly when undertaken by individual users. However, the advent of Web 2.0 and associated communities, such as YouTube and Flickr, has shown that users appear to be more willing to collaborate in order to take on enormous tasks such as multimedia content modelling. Harnessing the power of communities to achieve comprehensive content modelling is the primary focus of this research. The aim of this thesis is to explore collaborative multimedia content modelling and in particular the effectiveness of existing multimedia content modelling tools, taking into account the key development challenges of existing collaborative content modelling research and the associated modelling tools. Four research objectives are pursued in order to achieve this; first, design a user experiment to study users’ tagging behaviour with existing multimedia tagging tools and identify any relationships between such user behaviour; second, design and develop a framework for MPEG-7 content modelling communities based on the results of the experiment; third, implement an online service as a proof of concept of the framework; fourth, validate the framework through the online service during a repeat of the initial user experiment. This research contributes first, a conceptual model of user behaviour visualised as a fuzzy cognitive map and, second, an MPEG-7 framework for multimedia content modelling communities (MC2) and its proof of concept as an online service. The fuzzy cognitive model embodies relationships between user tagging behaviour and context and provides an understanding of user priorities in the description of content features and the relationships that exist between them. The MC2 framework, developed based on the fuzzy cognitive model, is deep-rooted in user content modelling behaviour and content preferences. A proof of concept of the MC2 framework is implemented as an online service in which all metadata is modelled using MPEG-7. The online service is validated, first, empirically with the same group of users and through the same experiment that led to the development of the fuzzy cognitive model and, second, functionally against the folksonomy and MPEG-7 content modelling tools used in the initial experiment. The validation demonstrates that MC2 has the advantages without the shortcomings of existing multimedia tagging tools by harnessing the ease of use of folksonomy tools while producing comprehensive structured metadata.Supported by UK Engineering and Physical Sciences Research Council (EPSRC

The gamification of accessibility design: A proposed framework

The use of Gamification for the purpose of training and raising awareness has attracted considerable interest over the last years. However, the development of such solutions to use within the area of accessibility design has not been yet explored. In this paper, we present a proposed framework using Gamification as a method for engaging and motivating web designers to increase the adoption of the W3C WCAG 2.0 guidelines. It is anticipated that our framework will provide a more interactive and intuitive learning experience

Chain of command in autonomous cooperative agents for battles in real-time strategy games

This paper investigates incorporating chain of command in swarm intelligence of honey bees to create groups of ranked co-operative autonomous agents for an RTS game in to create and re-enact battle simulations. The behaviour of the agents are based on the foraging and defensive behaviours of honey bees, adapted to a human environment. The chain of command is implemented using a hierarchical decision model. The groups consist of multiple model-based reflex agents, with individual blackboards for working memory, with a colony level blackboard to mimic the foraging patterns and include commands received from ranking agents. An agent architecture and environment are proposed that allows for creation of autonomous cooperative agents. The behaviour of agents is then evaluated both mathematically and empirically using an adaptation of anytime universal intelligence test and agent believability metric

Swarm intelligence for autonomous cooperative agents in battles for real-time strategy games

This paper investigates the use the swarm intelligence of honey bees to create groups of co-operative AI for an RTS game in order to create and re-enact battle simulations. The behaviour of the agents are based on the foraging and defensive behaviours of honey bees, adapted to a human environment. The groups consist of multiple model-based reflex agents, with individual blackboards for working memory, with a colony level blackboard to mimic the foraging patterns. An agent architecture and environment is proposed that allows for creation of autonomous cooperative agents. The behaviour of agents is then evaluated and their intelligence is tested using an adaptation of Anytime Universal Intelligence Test

A novel approach to automatic music composing: Using genetic algorithm

Artificial music composition is one of the ever rising problems of computer science. Genetic Algorithm has been one of the most useful means in our hands to solve optimization problems. By use of precise assumptions and adequate fitness function it is possible to change the music composing into an optimization problem. This paper proposes a new genetic algorithm for composing music. Considering entropy of the notes distribution as a factor of fitness function and developing mutation and crossover functions based on harmonic rules and trying to keep the melodies intact during these processes would result in a musical piece pleasant to human ears and interesting for human mind. This algorithm does not have the constraints of the previous algorithms. Restraining mutation and crossover functions with a goal of producing melodies based on acceptable melodies composed by humans, this algorithm is not bound to any genre, instrument or melody. The experimental results of this approach show that it is near to the human composing and the results produced from it are more acceptable than the ones produced by its predecessors

Reducing Extrinsic Burdens on Players of Digital Games: An Integrated Framework

Increasingly complex gameplay and gameworlds are placing greater demands on players, while grander approaches to help them cope, such as heads-up displays (HUDs), maps, notifications, and real-time statistics, may often create even more layers of complexity, and thus burdens, further detaching players from core gameplay. In this article, we distinguish between ‘intrinsic’ (fundamental to gameplay) and ‘extrinsic’ (peripheral or extraneous to gameplay) game elements, where the latter may be seen to increase burdens on players unnecessarily, subsequently affecting engagement. We propose a framework, comprising core, interaction, and interface layers, that reveals how extrinsicality may be minimised to better facilitate intrinsic gameplay and engagement

A Serious Game for Raising Designer Awareness of Web Accessibility Guidelines

Accessibility of products and services is key for people living with a disability to ensure that they are easier to use. However, web accessibility guidelines have been shown to be cumbersome to understand, which impacts on designers’ intention to use them. Several tools have been proposed in the literature, but they mostly focus on automatic accessibility testing, a process that is performed after a product has been developed. Little attention has been paid to using web accessibility guidelines during the design phase. In this paper, we present GATE, a serious game to help raise designer awareness of web accessibility guidelines, which is part of our work in progress on gamified technologies for this purpose. Its usability and perceived effectiveness were evaluated through an empirical study using a mixed methods approach. Our initial findings show that GATE is a promising solution that scored high in its playability and potential for use. This work has important potential contributions for the wider adoption of web accessibility guidelines

Reflective agents for personalisation in collaborative games

The collaborative aspect of games has been shown to potentially increase player performance and engagement over time. However, collaborating players need to perform well for the team as a whole to benefit and thus teams often end up performing no better than a strong player would have performed individually. Personalisation offers a means for improving overall performance and engagement, but in collaborative games, personalisation is seldom implemented, and when it is, it is overwhelmingly passive such that the player is not guided to goal states and the effectiveness of the personalisation is not evaluated and adapted accordingly. In this paper, we propose and apply the use of reflective agents to personalisation (‘reflective personalisation’) in collaborative gaming for individual players within collaborative teams via a combination of individual player and team profiling in order to improve player and thus team performance and engagement. The reflective agents self-evaluate, dynamically adapting their personalisation techniques to most effectively guide players towards specific goal states, match players and form teams. We incorporate this agent-based approach within a microservices architecture, which itself is a set of collaborating services, to facilitate a scalable and portable approach that enables both player and team profiles to persist across multiple games. An experiment involving 90 players over a two-month period was used to comparatively assess three versions of a collaborative game that implemented reflective, guided, and passive personalisation for individual players within teams. Our results suggest that the proposed reflective personalisation approach improves team player performance and engagement within collaborative games over guided or passive personalisation approaches, but that it is especially effective for improving engagement

Efficient in-game communication in collaborative online multiplayer Games

The ability to communicate during online gaming is one that has become fundamental. Players could use voice, textual chat, pre-determined commands or a combination of these methods in order to command a team, follow an appointed leader or simply to socialise with friends. There is an abundance of reasons why a person will choose to utilise the conversational frameworks available, however, when considering a game where players must work together in order to reach a common goal, it is up for interpretation to determine which method works most efficiently. The aim of this work is to address this need through a game that utilises these three methods of communication in order to determine their efficiency. A combination of qualitative and quantitative methods was employed to formulate a well-rounded conclusion. Results indicated that a combination of voice and predetermined commands is the most efficient method of in-game communication in online, task-oriented games