Investigating human-perceptual properties of "shapes" using 3D shapes and 2D fonts

Shapes are generally used to convey meaning. They are used in video games, films and other multimedia, in diverse ways. 3D shapes may be destined for virtual scenes or represent objects to be constructed in the real-world. Fonts add character to an otherwise plain block of text, allowing the writer to make important points more visually prominent or distinct from other text. They can indicate the structure of a document, at a glance. Rather than studying shapes through traditional geometric shape descriptors, we provide alternative methods to describe and analyse shapes, from a lens of human perception. This is done via the concepts of Schelling Points and Image Specificity. Schelling Points are choices people make when they aim to match with what they expect others to choose but cannot communicate with others to determine an answer. We study whole mesh selections in this setting, where Schelling Meshes are the most frequently selected shapes. The key idea behind image Specificity is that different images evoke different descriptions; but ‘Specific’ images yield more consistent descriptions than others. We apply Specificity to 2D fonts. We show that each concept can be learned and predict them for fonts and 3D shapes, respectively, using a depth image-based convolutional neural network. Results are shown for a range of fonts and 3D shapes and we demonstrate that font Specificity and the Schelling meshes concept are useful for visualisation, clustering, and search applications. Overall, we find that each concept represents similarities between their respective type of shape, even when there are discontinuities between the shape geometries themselves. The ‘context’ of these similarities is in some kind of abstract or subjective meaning which is consistent among different people

Telethrone : a situated display using retro-reflection basedmulti-view toward remote collaboration in small dynamic groups

This research identifies a gap in the tele-communication technology. Several novel technology demonstrators are tested experimentally throughout the research. The presented final system allows a remote participant in a conversation to unambiguously address individual members of a group of 5 people using non-verbal cues. The capability to link less formal groups through technology is the primary contribution. Technology-mediated communication is first reviewed, with attention to different supported styles of meetings. A gap is identified for small informal groups. Small dynamic groups which are convened on demand for the solution of specific problems may be called “ad-hoc”. In these meetings it is possible to ‘pull up a chair’. This is poorly supported by current tele-communication tools, that is, it is difficult for one or more members to join such a meeting from a remote location. It is also difficult for physically located parties to reorient themselves in the meeting as goals evolve. As the major contribution toward addressing this the ’Telethrone’ is introduced. Telethrone projects a remote user onto a chair, bringing them into your space. The chair seems to act as a situated display, which can support multi party head gaze, eye gaze, and body torque. Each observer knows where the projected user is looking. It is simpler to implement and cheaper than current comparable systems. The underpinning approach is technology and systems development, with regard to HCI and psychology throughout. Prototypes, refinements, and novel engineered systems are presented. Two experiments to test these systems are peer-reviewed, and further design & experimentation undertaken based on the positive results. The final paper is pending. An initial version of the new technology approach combined retro-reflective material with aligned pairs of cameras, and projectors, connected by IP video. A counterbalanced repeated measures experiment to analyse gaze interactions was undertaken. Results suggest that the remote user is not excluded from triadic poker game-play. Analysis of the multi-view aspect of the system was inconclusive as to whether it shows advantage over a set-up which does not support multi-view. User impressions from the questionnaires suggest that the current implementation still gives the impression of being a display despite its situated nature, although participants did feel the remote user was in the space with them. A refinement of the system using models generated by visual hull reconstruction can better connect eye gaze. An exploration is made of its ability to allow chairs to be moved around the meeting, and what this might enable for the participants of the meeting. The ability to move furniture was earlier identified as an aid to natural interaction, but may also affect highly correlated subgroups in an ad-hoc meeting. This is unsupported by current technologies. Repositioning of several onlooking chairs seems to support ’fault lines’. Performance constraints of the current system are explored. An experiment tests whether it is possible to judge remote participant eye gaze as the viewer changes location, attempting to address concerns raised by the first experiment in which the physical offsets of the IP cameras lenses from the projected eyes of the remote participants (in both directions), may have influenced perception of attention. A third experiment shows that five participants viewing a remote recording, presented through the Telethrone, can judge the attention of the remote participant accurately when the viewpoint is correctly rendered for their location in the room. This is compared to a control in which spatial discrimination is impossible. A figure for how many optically seperate retro-reflected segments is obtained through spatial anlysis and testing. It is possible to render the optical maximum of 5 independent viewpoints supporting an ’ideal’ meeting of 6 people. The tested system uses one computer at the meeting side of the exchange making it potentially deployable from a small flight case. The thesis presents and tests the utility of elements toward a system, and finds that remote users are in the conversation, spatially segmented with a view for each onlooker, that eye gaze can be reconnected through the system using 3D video, and that performance supports scalability up to the theoretical maximum for the material and an ideal meeting size

MediaSync: Handbook on Multimedia Synchronization

This book provides an approachable overview of the most recent advances in the fascinating field of media synchronization (mediasync), gathering contributions from the most representative and influential experts. Understanding the challenges of this field in the current multi-sensory, multi-device, and multi-protocol world is not an easy task. The book revisits the foundations of mediasync, including theoretical frameworks and models, highlights ongoing research efforts, like hybrid broadband broadcast (HBB) delivery and users' perception modeling (i.e., Quality of Experience or QoE), and paves the way for the future (e.g., towards the deployment of multi-sensory and ultra-realistic experiences). Although many advances around mediasync have been devised and deployed, this area of research is getting renewed attention to overcome remaining challenges in the next-generation (heterogeneous and ubiquitous) media ecosystem. Given the significant advances in this research area, its current relevance and the multiple disciplines it involves, the availability of a reference book on mediasync becomes necessary. This book fills the gap in this context. In particular, it addresses key aspects and reviews the most relevant contributions within the mediasync research space, from different perspectives. Mediasync: Handbook on Multimedia Synchronization is the perfect companion for scholars and practitioners that want to acquire strong knowledge about this research area, and also approach the challenges behind ensuring the best mediated experiences, by providing the adequate synchronization between the media elements that constitute these experiences

Liveness: an interactional account

PhDLive performances involve complex interactions between a large number of co-present people. Performance has been defined in terms of these performer–audience dynamics, but little is known about how they work. A series of live performance experiments investigate these dynamics, through teaching a humanoid robot some stagecraft, contrasting live and recorded performance, and spotlighting the audience. This requires the development of methods capable of capturing the fleeting responses of people within an audience and making sense of the resulting massed multi-modal data. The results show that in live events interaction matters. Extending the idea that our experience of performance is shaped by interactions with others, namely by talking with people afterwards, analogous social patterns are identified within the event. Specifically, some of the interactional dynamics well established for close, dyadic encounters extend to performers and audience members, despite the somewhat anonymised nature of massed audiences. While individual performer–audience effects were identified, the primary axis of social interaction is shown to be between audience members. This emphasises how it is being in an audience – common across diverse performance genres – that shapes the experience of live events. This work argues that the term liveness is ill-defined, but need not be. These interactional dynamics have a functional basis and depend solely on what is externally manifest. Understanding liveness in this way allows a perspicuous account – relating the perceptual environment within the event to the social contingency of experience – and can provide a systematic basis for design.Research Councils UK’s Digital Economy funding Queen Mary University of London Media and Arts Technology programm

Internet Daemons: Digital Communications Possessed

We’re used to talking about how tech giants like Google, Facebook, and Amazon rule the internet, but what about daemons? Ubiquitous programs that have colonized the Net’s infrastructure—as well as the devices we use to access it—daemons are little known. Fenwick McKelvey weaves together history, theory, and policy to give a full account of where daemons come from and how they influence our lives—including their role in hot-button issues like network neutrality. Going back to Victorian times and the popular thought experiment Maxwell’s Demon, McKelvey charts how daemons evolved from concept to reality, eventually blossoming into the pandaemonium of code-based creatures that today orchestrates our internet. Digging into real-life examples like sluggish connection speeds, Comcast’s efforts to control peer-to-peer networking, and Pirate Bay’s attempts to elude daemonic control (and skirt copyright), McKelvey shows how daemons have been central to the internet, greatly influencing everyday users. Internet Daemons asks important questions about how much control is being handed over to these automated, autonomous programs, and the consequences for transparency and oversight. Table of Contents Abbreviations and Technical Terms Introduction 1. The Devil We Know: Maxwell’s Demon, Cyborg Sciences, and Flow Control 2. Possessing Infrastructure: Nonsynchronous Communication, IMPs, and Optimization 3. IMPs, OLIVERs, and Gateways: Internetworking before the Internet 4. Pandaemonium: The Internet as Daemons 5. Suffering from Buffering? Affects of Flow Control 6. The Disoptimized: The Ambiguous Tactics of the Pirate Bay 7. A Crescendo of Online Interactive Debugging? Gamers, Publics and Daemons Conclusion Acknowledgments Appendix: Internet Measurement and Mediators Notes Bibliography Index Reviews Beneath social media, beneath search, Internet Daemons reveals another layer of algorithms: deeper, burrowed into information networks. Fenwick McKelvey is the best kind of intellectual spelunker, taking us deep into the infrastructure and shining his light on these obscure but vital mechanisms. What he has delivered is a precise and provocative rethinking of how to conceive of power in and among networks. —Tarleton Gillespie, author of Custodians of the Internet Internet Daemons is an original and important contribution to the field of digital media studies. Fenwick McKelvey extensively maps and analyzes how daemons influence data exchanges across Internet infrastructures. This study insightfully demonstrates how daemons are transformative entities that enable particular ways of transferring information and connecting up communication, with significant social and political consequences. —Jennifer Gabrys, author of Program Eart

Supporting Serendipity through Interactive Recommender Systems in Higher Education

Serendipiteetin käsite viittaa onnekkaisiin sattumuksiin, jossa hyödyllistä tietoa tai muita arvokkaita asioita löydetään yllättäen. Suosittelujärjestelmien tutkimuksessa serendipiteetistä on tullut keskeinen kokemuksellinen tavoite. Ihmisen ja tietokoneen vuorovaikutuksen kannalta olennainen kysymys siitä, kuinka käyttöliittymäsuunnittelu suosittelujärjestelmissä voisi tukea serendipiteetin kokemusta, on kuitenkin saanut vain vähän huomiota. Tässä työssä tutkitaan, kuinka suosittelijajärjestelmän mahdollistamaa serendipiteetin kokemusta voidaan soveltaa tutkimusartikkelien suositteluihin korkeakouluopetuksen kontekstissa. Erityisesti työ tarkastelee suositusjärjestelmäsovellusten käyttöä kehittyvissä maissa, sillä suurin osa kehittyvissä maissa tehdyistä tutkimuksista on keskittynyt pelkästään järjestelmien toteutukseen. Tässä väitöskirjassa kuvataan suosittelujärjestelmien käyttöliittymien suunnittelua ja kehittämistä, tavoitteena ymmärtää paremmin serendipiteetin kokemuksen tukemista käyttöliittymäratkaisuilla. Tutkimalla näitä järjestelmiä kehittyvässä maassa (Pakistan), tämä väitöskirja asettaa suosittelujärjestelmien käytön vastakkain aikaisempien teollisuusmaissa tehtyjen tutkimusten kanssa, ja siten mahdollistaa suositusjärjestelmien soveltamiseen liittyvien kontekstuaalisten ja kulttuuristen haasteiden tarkastelua. Väitöskirja koostuu viidestä empiirisestä käyttäjätutkimuksesta ja kirjallisuuskatsausartikkelista, ja työ tarjoaa uusia käyttöliittymäideoita, avoimen lähdekoodin ohjelmistoratkaisuja sekä empiirisiä analyyseja suositusjärjestelmiin liittyvistä käyttäjäkokemuksista pakistanilaisessa korkeakoulussa. Onnekkaita löytöjä tarkastellaan liittyen tutkimusartikkelien löytämiseen suositusjärjestelmän avulla. Väitöstyö kattaa sekä konstruktiivista että kokeellista tutkimusta. Väitöskirjan artikkelit esittelevät alkuperäistä tutkimusta, jossa kokeillaan erilaisia käyttöliittymämalleja, pohditaan sidosryhmien vaatimuksia, arvioidaan käyttäjien kokemuksia suositelluista artikkeleista ja esitellään tutkimusta suositusjärjestelmien tehtäväkuormitusanalyysistä.Serendipity is defined as the surprising discovery of useful information or other valuable things. In recommender systems research, serendipity has become an essential experiential goal. However, relevant to Human-Computer Interaction, the question of how the user interfaces of recommender systems could facilitate serendipity has received little attention. This work investigates how recommender system-facilitated serendipity can be applied to research article recommendation processes in the context of higher education. In particular, this work investigates the use of recommender system applications in developing countries as most studies in developing countries have focused solely on implementation, rather than user experiences. This dissertation describes the design and development of several user interfaces for recommender systems in an attempt to improve our understanding of serendipity facilitation with the help of user interfaces. By studying these systems in a developing country, this dissertation contrasts the study of recommender systems in developed countries, examining the contextual and cultural challenges associated with the application of recommender systems. This dissertation consists of five empirical user studies and a literature review article, contributing novel user interface designs, open-source software, and empirical analyses of user experiences related to recommender systems in a Pakistani higher education institution. The fortunate discoveries of recommendations are studied in the context of exploring research articles with the help of a recommender system. This dissertation covers both constructive and experimental research. The articles included in this dissertation present original research experimenting with different user interface designs in recommender systems facilitating serendipity, discuss stakeholder requirements, assess user experiences with recommended articles, and present a study on task load analysis of recommender systems. The key findings of this research are that serendipity of recommendations can be facilitated to users with the user interface. Recommender systems can become an instrumental technology in the higher education research and developing countries can benefit from recommender systems applications in higher education institutions