Pseudo-Dolly-In Video Generation Combining 3D Modeling and Image Reconstruction

This paper proposes a pseudo-dolly-in video generation method that reproduces motion parallax by applying image reconstruction processing to multi-view videos. Since dolly-in video is taken by moving a camera forward to reproduce motion parallax, we can present a sense of immersion. However, at a sporting event in a large-scale space, moving a camera is difficult. Our research generates dolly-in video from multi-view images captured by fixed cameras. By applying the Image-Based Modeling technique, dolly-in video can be generated. Unfortunately, the video quality is often damaged by the 3D estimation error. On the other hand, Bullet-Time realizes high-quality video observation. However, moving the virtual-viewpoint from the capturing positions is difficult. To solve these problems, we propose a method to generate a pseudo-dolly-in image by installing 3D estimation and image reconstruction techniques into Bullet-Time and show its effectiveness by applying it to multi-view videos captured at an actual soccer stadium. In the experiment, we compared the proposed method with digital zoom images and with the dolly-in video generated from the Image-Based Modeling and Rendering method.Published in: 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct) Date of Conference: 9-13 Oct. 2017 Conference Location: Nantes, Franc

A Theoretical and Qualitative Approach to Evaluating Children’s Robot-Mediated Levels of Presence.

Each year, 2.5 million children in the US are homebound due to illness (NHIS, 2016; US Census Bureau, 2016). This paper explores the possible implications of being homebound for child development and well-being, drawing on Bronfenbrenner’s bioecological systems theory  of human development and Ryan and Deci’s self-determination theory. This paper also explores the potential role of robotic avatars and robot-mediated presence to provide homebound children with more appropriate developmental experiences. To better understand their robot-mediated developmental experiences, what is known about human development and human psychology in organic environments (i.e., bioecological systems theory, self-determination theory) is synthesized with concepts of presence theory from virtual environments. These theoretical supports form the foundation of a framework to evaluate the robot-mediated presence of homebound children. Findings from the first systematic, multi-case study on the robot-mediated presence of homebound children in schools provide empirical data to inform three identified levels of presence: co-present, cooperating, collaborating. This framework provides a first step to consistent evaluation of robot-mediated presence and engagement for this population. Understanding the social contexts and developmental needs of homebound children and how they can be achieved via robotic avatars will aid in developing more effective interventions for improved social supports and technological systems

Comparing video, avatar, and robot mediated communication: Pros and cons of embodiment

Abstract. In recent years, studies have begun on robot conferencing as a new telecommunication medium. In robot conferencing, people talk with a remote conversation partner through teleoperated robots which present the bodily motions of the partner with a physical embodiment. However, the effects of physical embodiment on distant communication had not yet been demonstrated. In this study, to find the effects, we conducted an experiment in which subjects talked with a partner through robots and various existing communication media (e.g. voice, avatar and video chats). As a result, we found that the physical embodiment enhanced social telepresence, i.e., the sense of resembling face-toface interaction. Furthermore, the result implied that physical embodiment built the sense of tension as in the case of a first face-to-face meeting

User-centered design of a dynamic-autonomy remote interaction concept for manipulation-capable robots to assist elderly people in the home

In this article, we describe the development of a human-robot interaction concept for service robots to assist elderly people in the home with physical tasks. Our approach is based on the insight that robots are not yet able to handle all tasks autonomously with sufficient reliability in the complex and heterogeneous environments of private homes. We therefore employ remote human operators to assist on tasks a robot cannot handle completely autonomously. Our development methodology was user-centric and iterative, with six user studies carried out at various stages involving a total of 241 participants. The concept is under implementation on the Care-O-bot 3 robotic platform. The main contributions of this article are (1) the results of a survey in form of a ranking of the demands of elderly people and informal caregivers for a range of 25 robot services, (2) the results of an ethnography investigating the suitability of emergency teleassistance and telemedical centers for incorporating robotic teleassistance, and (3) a user-validated human-robot interaction concept with three user roles and corresponding three user interfaces designed as a solution to the problem of engineering reliable service robots for home environments

A 360 VR and Wi-Fi Tracking Based Autonomous Telepresence Robot for Virtual Tour

This study proposes a novel mobile robot teleoperation interface that demonstrates the applicability of a robot-aided remote telepresence system with a virtual reality (VR) device to a virtual tour scenario. To improve realism and provide an intuitive replica of the remote environment for the user interface, the implemented system automatically moves a mobile robot (viewpoint) while displaying a 360-degree live video streamed from the robot to a VR device (Oculus Rift). Upon the user choosing a destination location from a given set of options, the robot generates a route based on a shortest path graph and travels along that the route using a wireless signal tracking method that depends on measuring the direction of arrival (DOA) of radio signals. This paper presents an overview of the system and architecture, and discusses its implementation aspects. Experimental results show that the proposed system is able to move to the destination stably using the signal tracking method, and that at the same time, the user can remotely control the robot through the VR interface

The 21st Century School : Transforming Schools through Connected Learning

Transforming Schools through connected learning means that changing the way we work, live, play, and learn. The 21st Century School will shape the future of the Internet by creating unprecedented value and opportunity for our customers, employees, investors and ecosystem that addresses every student’s individual learning style with online curriculum. There are four steps to do transformation. Step 1: Connect all buildings and provide access to critical information Step 2: Implement network-based applications to improve administrative efficiency Step 3: Put teacher proficiency and productivity Step 4: Create a student-centered learning environment to achieve academic excellence.The images from security cameras can be viewed by authorized users over that connects the internet, where bells, alarms, heating, AC, lighting, and other building systems can be centralized and monitored from any location, that provides teachers and staff with the information they need around the clock, from anywhere that automatically communicates with parents about homework, attendance, and school events, that connects the internet classes and experts from around the world. By implementing this concept, it will move to a studentcentered learning environment, learning centers, lecture theaters, group rooms, quiet areas, anytime, anywhere access, interactive whiteboard, web tablets, wireless schools and flexible furniture. It will also create in-school environments that are similar to the outside world, offer learning 24/7, train teachers and professors and give access from anywhere anytime and provide automate administrative tasks

Meaningful Engagement via Robotic Telepresence: An Exploratory Case Study

Recent advances in robotic telepresence have created new opportunities for students that are unable to engage in traditional classroom environments physically. Although these technologies are still being tested in application, early indicators support the idea that robotic telepresence enhances the learning experience by allowing greater autonomy and depth of engagement with peers. This exploratory case study examines the experiences of a fifth-grade student who was limited in her ability to attend school due to illness. It utilizes a qualitative investigation into the experiences of robotic-telepresence from the perspectives of the remote student, peer students in the classroom context, and the teacher. Four central themes emerged from the analysis indicating A) improvements for relational normalcy and autonomy, B) personal agency in learning, C) rapid acceptance and normalization of the robotic device, and D) prescription for future use

Planning and Design Considerations for Computer Supported Collaboration Spaces

Architects have long been aware of the need to design for the behaviors a space is meant to support. However, neither the seminal works on architectural programming or collaborative engineering address the linkages between physical environment design and collaborative work practice. This paper posits that the design of collaboration environments should stand as a third pillar of collaboration engineering, suggests four ways in which physical environment design and collaboration engineering might mutually inform the other, and specifies several dimensions of physical environment affordance collaboration engineers might consider when developing requirements for collaboration space

Periscope: A Robotic Camera System to Support Remote Physical Collaboration

We investigate how robotic camera systems can offer new capabilities to computer-supported cooperative work through the design, development, and evaluation of a prototype system called Periscope. With Periscope, a local worker completes manipulation tasks with guidance from a remote helper who observes the workspace through a camera mounted on a semi-autonomous robotic arm that is co-located with the worker. Our key insight is that the helper, the worker, and the robot should all share responsibility of the camera view--an approach we call shared camera control. Using this approach, we present a set of modes that distribute the control of the camera between the human collaborators and the autonomous robot depending on task needs. We demonstrate the system's utility and the promise of shared camera control through a preliminary study where 12 dyads collaboratively worked on assembly tasks. Finally, we discuss design and research implications of our work for future robotic camera systems that facilitate remote collaboration.Comment: This is a pre-print of the article accepted for publication in PACM HCI and will be presented at CSCW 202