ADD-up:Visual analytics for augmented deliberative democracy

We demonstrate the first prototype of the ADD-up visual analytics system. The Augmented Deliberative Democracy (ADD-up) project aims to enhance public deliberations by providing argument analytics in real time. The system will ultimately take a stenographic feed of a public deliberation meeting, automatically extract the arguments therein and project visual analytics intended to improve the deliberative quality of the event.publishe

An IoT Endpoint System-on-Chip for Secure and Energy-Efficient Near-Sensor Analytics

Near-sensor data analytics is a promising direction for IoT endpoints, as it minimizes energy spent on communication and reduces network load - but it also poses security concerns, as valuable data is stored or sent over the network at various stages of the analytics pipeline. Using encryption to protect sensitive data at the boundary of the on-chip analytics engine is a way to address data security issues. To cope with the combined workload of analytics and encryption in a tight power envelope, we propose Fulmine, a System-on-Chip based on a tightly-coupled multi-core cluster augmented with specialized blocks for compute-intensive data processing and encryption functions, supporting software programmability for regular computing tasks. The Fulmine SoC, fabricated in 65nm technology, consumes less than 20mW on average at 0.8V achieving an efficiency of up to 70pJ/B in encryption, 50pJ/px in convolution, or up to 25MIPS/mW in software. As a strong argument for real-life flexible application of our platform, we show experimental results for three secure analytics use cases: secure autonomous aerial surveillance with a state-of-the-art deep CNN consuming 3.16pJ per equivalent RISC op; local CNN-based face detection with secured remote recognition in 5.74pJ/op; and seizure detection with encrypted data collection from EEG within 12.7pJ/op.Comment: 15 pages, 12 figures, accepted for publication to the IEEE Transactions on Circuits and Systems - I: Regular Paper

GENERATING DYNAMIC EMOTIVE ANIMATIONS FOR AUGMENTED REALITY

The method may include receiving, at a user interface generated for the electronic device, an indication to access an augmented reality fitting environment associated with at least one shopping item; receiving a selected image of a location in which to display the augmented reality fitting environment; obtaining user measurement data, shopping item data, and emotions analytics data associated with the augmented reality fitting environment; and generating, based on the obtained user measurement data, a plurality of three-dimensional avatars representing a user accessing the augmented reality fitting environment on the electronic device. For each avatar, the method may include generating, using the shopping item data and the user measurement data, a unique three-dimensional representation of the at least one shopping item, generating emotive content based at least in part on the emotions analytics data and on the respective generated representation of the at least one shopping item, and triggering, in the user interface, display of the plurality of three-dimensional avatars in the augmented reality fitting environment and within the selected image of the location, each avatar being depicted with the respective generated emotive content and wearing the respective generated representation of the at least one shopping item

Interactive product browsing and configuration using remote augmented reality sales services

Real-time remote sales assistance is an underdeveloped component of online sales services. Solutions involving web page text chat, telephony and video support prove problematic when seeking to remotely guide customers in their sales processes, especially with configurations of physically complex artefacts. Recently, there has been great interest in the application of virtual worlds and augmented reality to create synthetic environments for remote sales of physical artefacts. However, there is a lack of analysis and development of appropriate software services to support these processes. We extend our previous work with the detailed design of configuration context services to support the management of an interactive sales session using augmented reality. We detail the context and configuration services required, presenting a novel data service streaming configuration information to the vendor for business analytics. We expect that a fully implemented configuration management service, based on our design, will improve the remote sales experience for both customers and vendors alike via analysis of the streamed information

Exploring the Design Space of Immersive Urban Analytics

Recent years have witnessed the rapid development and wide adoption of immersive head-mounted devices, such as HTC VIVE, Oculus Rift, and Microsoft HoloLens. These immersive devices have the potential to significantly extend the methodology of urban visual analytics by providing critical 3D context information and creating a sense of presence. In this paper, we propose an theoretical model to characterize the visualizations in immersive urban analytics. Further more, based on our comprehensive and concise model, we contribute a typology of combination methods of 2D and 3D visualizations that distinguish between linked views, embedded views, and mixed views. We also propose a supporting guideline to assist users in selecting a proper view under certain circumstances by considering visual geometry and spatial distribution of the 2D and 3D visualizations. Finally, based on existing works, possible future research opportunities are explored and discussed.Comment: 23 pages,11 figure

Learning Analytics in Augmented Reality

Learning Analytics in flat web platforms is rather commonplace, but recording learner performance from immersive real-world experience still poses a challenge. With this study, we break ground and show that Learning Analytics for Augmented Reality are possible and we outline how an according system can be implemented. We describe a novel framework for competency-based workplace Learning Analytics and document the required components with regards to software, hardware, and their configuration. Thereby, we discuss key design decisions and lessons learned from the implementation of the framework, drawing from the experience of the EU project Learning Analytics in Augmented Reality (LAAR), which provided the environment and context for this work. Most notably, this included testing the technologies in realistic scenarios in vocational training of stage technicians. Finally, we conclude the paper with a summary of the work done and an outlook on possible extensions for researchers wishing to build on our work