Serious games: design and development

With the growth of the video game industry, interest in video game research has increased, leading to the study of Serious Games. Serious Games are generally perceived as games that use the video games’ capabilities to emerge players, for other purposes besides entertainment. These purposes include education and training, among others. By using Serious Games for education, teachers could capture the students’ attention in the same way that video games often do, thus the learning process could be more efficient. Additionally, by exploiting the potential of these virtual worlds, it is possible to experience situations that would otherwise be very difficult to experience in the real world, mainly due to reasons of cost, safety and time. Serious Games research and development is still very scarse. However, nowadays there is a large number of available platforms and tools, which can be used to develop Serious Games and video games in general. For instance, web browsers can now provide easy access to realistic 3D virtual worlds. This grants video game developers the tools to create compelling and rich environments that can be accessed by anyone with an internet connection. Additionnaly, other development platforms can be used to achieve different goals. Desktop technologies provide greater processing power and achieve greater results in terms of visual quality, as well as in terms of creating more accurate simulations. This disseration describes the design and development of two Serious Games, one for PC, developed with XNA, and another for the web, developed with WebGL.O crescimento da indústria dos jogos de vídeo, despoletou um maior interesse no estudo deste fenómeno, o que consequentemente levou ao estudo de Jogos Sérios. Jogos Sérios são normalmente considerados jogos de vídeo que são desenvolvidos para outros fins para além do entretenimento. Estes fins incluem a educação e o treino, entre outros. Ao utilizar Jogos Sérios para a educação, os docentes poderiam conseguir captar a atenção dos alunos da mesma forma que os jogos de vídeo normalmente conseguem. Desta forma o processo de aprendizagem poderia ser mais eficiente. Adicionalmente, ao explorar o potencial destes mundos virtuais, é possível experienciar situações que de outra forma seriam difíceis de experienciar na vida real, devido ao seu custo, a razões de segurança e também ao tempo dispendido para as realizar. O estudo de Jogos Sérios é ainda bastante disperso. No entanto, hoje em dia existe já um grande número de plataformas e ferramentas disponíveis que podem ser usadas para desenvolver Jogos Sérios. Por exemplo, os web browsers podem agora fornecer acesso fácil a mundos virtuais 3D. Isto permite que os criadores de jogos de vídeo tenham acesso às ferramentas necessárias para criar ambientes ricos, que possam ser acedidos por qualquer pessoa através de uma ligacção à internet. Adicionalmente, existem outras plataformas de desenvolvimento que podem ser utilizadas para alcançar objetivos diferentes. Tecnologias desktop fornecem um maior poder de processamento e permitem alcançar melhores resultados em termos de qualidade visual, bem como em termos de criação de simulações mais precisas. Nesta dissertação descreve-se a criação e o desenvolvimento de dois Jogos Sérios, um para PC, desenvolvido em XNA e outro outro para a web, desenvolvido em WebGL

Designing the Learning Experiences in Serious Games: The Overt and the Subtle—The Virtual Clinic Learning Environment

: Serious Games are becoming more common in the educational setting and must pass muster with both students and instructors for their learning experience and knowledge building. The Virtual Clinic Learning Environment has recently been developed and implemented at East Carolina University using a design framework based on Bloom’s variables, and in the process of refining those design questions, identifies the methods of how serious games provide an overt and subtle learning experience. The overt learning experience is based in the design questions defined and the subtle experience was derived by examining the idea of sense of place as it relates to the virtual environment. By considering these two streams of learning, designers can avoid pitfalls and build on these design elements of a virtual learning environment

Audio-visual football video analysis, from structure detection to attention analysis

Sport video is an important video genre. Content-based sports video analysis attracts great interest from both industry and academic fields. A sports video is characterised by repetitive temporal structures, relatively plain contents, and strong spatio-temporal variations, such as quick camera switches and swift local motions. It is necessary to develop specific techniques for content-based sports video analysis to utilise these characteristics. For an efficient and effective sports video analysis system, there are three fundamental questions: (1) what are key stories for sports videos; (2) what incurs viewer’s interest; and (3) how to identify game highlights. This thesis is developed around these questions. We approached these questions from two different perspectives and in turn three research contributions are presented, namely, replay detection, attack temporal structure decomposition, and attention-based highlight identification. Replay segments convey the most important contents in sports videos. It is an efficient approach to collect game highlights by detecting replay segments. However, replay is an artefact of editing, which improves with advances in video editing tools. The composition of replay is complex, which includes logo transitions, slow motions, viewpoint switches and normal speed video clips. Since logo transition clips are pervasive in game collections of FIFA World Cup 2002, FIFA World Cup 2006 and UEFA Championship 2006, we take logo transition detection as an effective replacement of replay detection. A two-pass system was developed, including a five-layer adaboost classifier and a logo template matching throughout an entire video. The five-layer adaboost utilises shot duration, average game pitch ratio, average motion, sequential colour histogram and shot frequency between two neighbouring logo transitions, to filter out logo transition candidates. Subsequently, a logo template is constructed and employed to find all transition logo sequences. The precision and recall of this system in replay detection is 100% in a five-game evaluation collection. An attack structure is a team competition for a score. Hence, this structure is a conceptually fundamental unit of a football video as well as other sports videos. We review the literature of content-based temporal structures, such as play-break structure, and develop a three-step system for automatic attack structure decomposition. Four content-based shot classes, namely, play, focus, replay and break were identified by low level visual features. A four-state hidden Markov model was trained to simulate transition processes among these shot classes. Since attack structures are the longest repetitive temporal unit in a sports video, a suffix tree is proposed to find the longest repetitive substring in the label sequence of shot class transitions. These occurrences of this substring are regarded as a kernel of an attack hidden Markov process. Therefore, the decomposition of attack structure becomes a boundary likelihood comparison between two Markov chains. Highlights are what attract notice. Attention is a psychological measurement of “notice ”. A brief survey of attention psychological background, attention estimation from vision and auditory, and multiple modality attention fusion is presented. We propose two attention models for sports video analysis, namely, the role-based attention model and the multiresolution autoregressive framework. The role-based attention model is based on the perception structure during watching video. This model removes reflection bias among modality salient signals and combines these signals by reflectors. The multiresolution autoregressive framework (MAR) treats salient signals as a group of smooth random processes, which follow a similar trend but are filled with noise. This framework tries to estimate a noise-less signal from these coarse noisy observations by a multiple resolution analysis. Related algorithms are developed, such as event segmentation on a MAR tree and real time event detection. The experiment shows that these attention-based approach can find goal events at a high precision. Moreover, results of MAR-based highlight detection on the final game of FIFA 2002 and 2006 are highly similar to professionally labelled highlights by BBC and FIFA

New data analytics and visualization methods in personal data mining, cancer data analysis and sports data visualization

In this dissertation, we discuss a reading profiling system, a biological data visualization system and a sports visualization system. Self-tracking is getting increasingly popular in the field of personal informatics. Reading profiling can be used as a personal data collection method. We present UUAT, an unintrusive user attention tracking system. In UUAT, we used user interaction data to develop technologies that help to pinpoint a users reading region (RR). Based on computed RR and user interaction data, UUAT can identify a readers reading struggle or interest. A biomarker is a measurable substance that may be used as an indicator of a particular disease. We developed CancerVis for visual and interactive analysis of cancer data and demonstrate how to apply this platform in cancer biomarker research. CancerVis provides interactive multiple views from different perspectives of a dataset. The views are synchronized so that users can easily link them to a same data entry. Furthermore, CancerVis supports data mining practice in cancer biomarker, such as visualization of optimal cutpoints and cutthrough exploration. Tennis match summarization helps after-live sports consumers assimilate an interested match. We developed TennisVis, a comprehensive match summarization and visualization platform. TennisVis offers chart- graph for a client to quickly get match facts. Meanwhile, TennisVis offers various queries of tennis points to satisfy diversified client preferences (such as volley shot, many-shot rally) of tennis fans. Furthermore, TennisVis offers video clips for every single tennis point and a recommendation rating is computed for each tennis play. A case study shows that TennisVis identifies more than 75% tennis points in full time match