4,211 research outputs found
On Data-driven systems analyzing, supporting and enhancing users’ interaction and experience
Tesis doctoral en inglés y resumen extendido en español[EN] The research areas of Human-Computer Interaction and Software Architectures have been traditionally treated separately, but in the literature, many authors made efforts to merge them to build better software systems. One of the common gaps between software engineering and usability is the lack of strategies to apply usability principles in the initial design of software architectures. Including these principles since the early phases of software design would help to avoid later architectural changes to include user experience requirements. The combination of both fields (software architectures and Human-Computer Interaction) would contribute to building better interactive software that should include the best from both the systems and user-centered designs. In that combination, the software architectures should enclose the fundamental structure and ideas of the system to offer the desired quality based on sound design decisions.
Moreover, the information kept within a system is an opportunity to extract knowledge about the system itself, its components, the software included, the users or the interaction occurring inside. The knowledge gained from the information generated in a software environment can be used to improve the system itself, its software, the users’ experience, and the results. So, the combination of the areas of Knowledge Discovery and Human-Computer Interaction offers ideal conditions to address Human-Computer-Interaction-related challenges. The Human-Computer Interaction focuses on human intelligence, the Knowledge Discovery in computational intelligence, and the combination of both can raise the support of human intelligence with machine intelligence to discover new insights in a world crowded of data.
This Ph.D. Thesis deals with these kinds of challenges: how approaches like data-driven software architectures (using Knowledge Discovery techniques) can help to improve the users' interaction and experience within an interactive system. Specifically, it deals with how to improve the human-computer interaction processes of different kind of stakeholders to improve different aspects such as the user experience or the easiness to accomplish a specific task.
Several research actions and experiments support this investigation. These research actions included performing a systematic literature review and mapping of the literature that was aimed at finding how the software architectures in the literature have been used to support, analyze or enhance the human-computer interaction. Also, the actions included work on four different research scenarios that presented common challenges in the Human-Computer Interaction knowledge area. The case studies that fit into the scenarios selected were chosen based on the Human-Computer Interaction challenges they present, and on the authors’ accessibility to them. The four case studies were: an educational laboratory virtual world, a Massive Open Online Course and the social networks where the students discuss and learn, a system that includes very large web forms, and an environment where programmers develop code in the context of quantum computing. The development of the experiences involved the review of more than 2700 papers (only in the literature review phase), the analysis of the interaction of 6000 users in four different contexts or the analysis of 500,000 quantum computing programs.
As outcomes from the experiences, some solutions are presented regarding the minimal software artifacts to include in software architectures, the behavior they should exhibit, the features desired in the extended software architecture, some analytic workflows and approaches to use, or the different kinds of feedback needed to reinforce the users’ interaction and experience.
The results achieved led to the conclusion that, despite this is not a standard practice in the literature, the software environments should embrace Knowledge Discovery and data-driven principles to analyze and respond appropriately to the users’ needs and improve or support the interaction. To adopt Knowledge Discovery and data-driven principles, the software environments need to extend their software architectures to cover also the challenges related to Human-Computer Interaction. Finally, to tackle the current challenges related to the users’ interaction and experience and aiming to automate the software response to users’ actions, desires, and behaviors, the interactive systems should also include intelligent behaviors through embracing the Artificial Intelligence procedures and techniques
On data-driven systems analyzing, supporting and enhancing users’ interaction and experience
[EN]The research areas of Human-Computer Interaction and Software Architectures have
been traditionally treated separately, but in the literature, many authors made efforts to
merge them to build better software systems. One of the common gaps between software
engineering and usability is the lack of strategies to apply usability principles in the initial
design of software architectures. Including these principles since the early phases of software
design would help to avoid later architectural changes to include user experience
requirements. The combination of both fields (software architectures and Human-Computer
Interaction) would contribute to building better interactive software that should include the
best from both the systems and user-centered designs. In that combination, the software
architectures should enclose the fundamental structure and ideas of the system to offer the
desired quality based on sound design decisions.
Moreover, the information kept within a system is an opportunity to extract knowledge
about the system itself, its components, the software included, the users or the interaction
occurring inside. The knowledge gained from the information generated in a software
environment can be used to improve the system itself, its software, the users’ experience, and
the results. So, the combination of the areas of Knowledge Discovery and Human-Computer
Interaction offers ideal conditions to address Human-Computer-Interaction-related
challenges. The Human-Computer Interaction focuses on human intelligence, the Knowledge
Discovery in computational intelligence, and the combination of both can raise the support
of human intelligence with machine intelligence to discover new insights in a world crowded
of data.
This Ph.D. Thesis deals with these kinds of challenges: how approaches like data-driven
software architectures (using Knowledge Discovery techniques) can help to improve the users'
interaction and experience within an interactive system. Specifically, it deals with how to
improve the human-computer interaction processes of different kind of stakeholders to
improve different aspects such as the user experience or the easiness to accomplish a specific
task.
Several research actions and experiments support this investigation. These research
actions included performing a systematic literature review and mapping of the literature that
was aimed at finding how the software architectures in the literature have been used to
support, analyze or enhance the human-computer interaction. Also, the actions included work
on four different research scenarios that presented common challenges in the Human-
Computer Interaction knowledge area. The case studies that fit into the scenarios selected
were chosen based on the Human-Computer Interaction challenges they present, and on the
authors’ accessibility to them. The four case studies were: an educational laboratory virtual world, a Massive Open Online Course and the social networks where the students discuss
and learn, a system that includes very large web forms, and an environment where
programmers develop code in the context of quantum computing. The development of the
experiences involved the review of more than 2700 papers (only in the literature review
phase), the analysis of the interaction of 6000 users in four different contexts or the analysis
of 500,000 quantum computing programs.
As outcomes from the experiences, some solutions are presented regarding the minimal
software artifacts to include in software architectures, the behavior they should exhibit, the
features desired in the extended software architecture, some analytic workflows and
approaches to use, or the different kinds of feedback needed to reinforce the users’ interaction
and experience.
The results achieved led to the conclusion that, despite this is not a standard practice in
the literature, the software environments should embrace Knowledge Discovery and datadriven
principles to analyze and respond appropriately to the users’ needs and improve or
support the interaction. To adopt Knowledge Discovery and data-driven principles, the
software environments need to extend their software architectures to cover also the challenges
related to Human-Computer Interaction. Finally, to tackle the current challenges related to
the users’ interaction and experience and aiming to automate the software response to users’
actions, desires, and behaviors, the interactive systems should also include intelligent
behaviors through embracing the Artificial Intelligence procedures and techniques
A Software Framework to Create 3D Browser-Based Speech Enabled Applications
The advances in automatic speech recognition have pushed the humancomputer interface researchers to adopt speech as one mean of input data. It is natural to humans, and complements very well other input interfaces. However, integrating an automatic speech recognizer into a complex system (such as a 3D visualization system or a Virtual Reality system) can be a difficult and time consuming task. In this paper we present our approach to the problem, a software framework requiringminimum additional coding from the application developer. The framework combines voice commands with existing interaction code, automating the task of creating a new speech grammar (to be used by the recognizer). A new listener component for theXj3D was created, which makes transparent to the user the integration between the 3D browser and the recognizer. We believe this is a desirable feature for virtual reality system developers, and also to be used as a rapid prototyping tool when experimenting with speech technology
Metaverse and education: the pioneering case of Minecraft in immersive digital learning
The metaverse is presented as a possible new technological iteration for the Internet. The generation of virtual universes in which the physical and the digital converge raises the question of how education will be addressed in these new systems. We find, however, pioneering exercises such as Minecraft: Education Edition. This platform is a version based on the popular sandbox video game, which was originally created by a community of teachers. The aim of this research is to analyze and describe the idiosyncratic characteristics of Minecraft as an educational platform, framing it as one of the pioneering exercises in the metaverse. To this end, we have employed a methodology that combines Multimodal Discourse Analysis with Grounded Theory and the Constant Comparative Method. As conclusions, we observe how the Minecraft Education platform reinforces from its approach pre-existing aspects from the physical world, resizing them to adapt them to its connected digital environment. These are key elements such as the identity of the participants, their ability to act within the system, creativity through lessons as a guide to the educational objectives and the community as the backbone of the process. At the same time, it presents differential components, such as the use of avatars, the transition from textual literacy to multimodal literacy, game mechanics that boost creativity or transhuman capabilities that defy physical space-time. All in all, the platform is designed for teachers, parents and managers, to whom it offers a series of benefits. Therefore, the pedagogical action will depend on their judgment and execution, especially through the elaboration of lessons and worlds, the management of the sessions and their interaction in community environments. It is their responsibility to ensure that the educational experience is truly empowering or, on the contrary, that it ends up being governed by reproductive criteria linked to symbolic violence
A Proposal to Create Learning Environments in Virtual Worlds Integrating Advanced Educative Resources
Social Networking has been a global consumer phenomenon during the last few years. Online communities are changing the way people behave, share and interact within their daily lives. Most of such communities are mainly focused on sharing contents and communicating using a traditional web interface. However, social virtual worlds are computer-simulated environments that the users can "inhabit" and in which they can interact and create objects. Education is one of the most interesting applications of virtual worlds, as their flexibility can be exploited in order to create heterogeneous groups from all over the world who can collaborate synchronously in different virtual spaces. In this paper, we highlight the potential of virtual worlds as an educative tool and propose a model to create learning environments within Second Life or OpenSimulator combining the Moodle learning management system, embodied conversational metabots, and programmable 3D objects. We have implemented the proposal in a learning system for several subjects of the Computer Science degree in our university and show that it fostered engagement and collaboration and helped the students to better understand complex concepts.Research funded by projects CICYT TIN 2011-28620-C02-01, CICYT TEC 2011-28626 C02-02, CAM CONTEXTS (S2009/TIC-1485), and DPS 2008-07029-C02-02.Enviad
Software Product Line for Metaverse: Preliminary Results
The Metaverse is a network of eXtended Reality applications (XR apps)
connected to each other, over the Internet infrastructure, allowing network
users, systems, and devices to access them. It is very challenging to implement
solutions for XR apps, due to the combination of complex concerns that should
be addressed: multiple users with non-traditional input and output devices,
different hardware platforms that should be addressed, forceful interactive
rates, and experimental interaction techniques, among other issues. Therefore,
this work aims to present a Software Product Line (SPL)-based approach to
support the development of Web XR apps. More specifically, we define a features
model that represents similarities and variables (domain analysis); we defined
a core composed of generic and reusable software artifacts (domain project);
and we developed an interface to support the instantiation of a Web XR app
family, named MetaSee Features Model Editor (domain implementation). This
approach integrates with a component of the MetaSEE architecture (Metaverse for
Software Engineering Education). A preliminary assessment found that Features
Model has conceptual consistency from the point of view of the complexity of
Web XR Apps multimodal interaction. As future work, features model and
artifacts will be increased with improvements and an evaluation with a
significant number of participants will be made
Agents for educational games and simulations
This book consists mainly of revised papers that were presented at the Agents for Educational Games and Simulation (AEGS) workshop held on May 2, 2011, as part of the Autonomous Agents and MultiAgent Systems (AAMAS) conference in Taipei, Taiwan. The 12 full papers presented were carefully reviewed and selected from various submissions. The papers are organized topical sections on middleware applications, dialogues and learning, adaption and convergence, and agent applications
Sonic Interactions in Virtual Environments: the Egocentric Audio Perspective of the Digital Twin
The relationships between the listener, physical world and virtual
environment (VE) should not only inspire the design of natural multimodal
interfaces but should be discovered to make sense of the mediating action of VR
technologies. This chapter aims to transform an archipelago of studies related
to sonic interactions in virtual environments (SIVE) into a research field
equipped with a first theoretical framework with an inclusive vision of the
challenges to come: the egocentric perspective of the auditory digital twin. In
a VE with immersive audio technologies implemented, the role of VR simulations
must be enacted by a participatory exploration of sense-making in a network of
human and non-human agents, called actors. The guardian of such locus of agency
is the auditory digital twin that fosters intra-actions between humans and
technology, dynamically and fluidly redefining all those configurations that
are crucial for an immersive and coherent experience. The idea of entanglement
theory is here mainly declined in an egocentric-spatial perspective related to
emerging knowledge of the listener's perceptual capabilities. This is an
actively transformative relation with the digital twin potentials to create
movement, transparency, and provocative activities in VEs. The chapter contains
an original theoretical perspective complemented by several bibliographical
references and links to the other book chapters that have contributed
significantly to the proposal presented here.Comment: 46 pages, 5 figures. Pre-print version of the introduction to the
book "Sonic Interactions in Virtual Environments" in press for Springer's
Human-Computer Interaction Series, Open Access license. The pre-print
editors' copy of the book can be found at
https://vbn.aau.dk/en/publications/sonic-interactions-in-virtual-environments
- full book info: https://sive.create.aau.dk/index.php/sivebook
An infrastructure for experience centered agile prototyping of ambient intelligence
Ubiquitous computing poses new usability challenges that cut across design and development. We are particularly interested in "spaces" enhanced with sensors, public displays and personal devices. How can prototypes be used to explore the user's mobility and interaction, both explicitly and implicitly, to access services within these environments? Because of the potential cost of development and design failure, the characteristics of such systems must be explored using early versions of the system that could disrupt if used in the target environment. Being able to evaluate these systems early in the process is crucial to their successful development. This paper reports on an effort to develop a framework for the rapid prototyping and analysis of ambient intelligence systems
- …