Combining Image Processing Techniques and Mobile Sensor Information for Marker-less Augmented Reality Based Reconstruction

Marker-less Augmented Reality(AR) based recon- struction using mobile devices, is a near impossible task. When considering vision based tracking approaches, it is due to the lack of processing power in mobile devices and when considering mobile sensor based tracking approaches, it is due to the lack of accuracy in mobile Global Positioning System(GPS). In order to address this problem this research presents a novel approach which combines image processing techniques and mobile sensor information which can be used to perform precise position localization in order to perform augmented reality based reconstruction using mobile devices. The core of this proposed methodology is tightly bound with the image processing technique which is used to identify the object scale in a given image, which is taken from the user’s mobile device. Use of mobile sensor information was to classify the most optimal locations for a given particular user location. This proposed methodology has been evaluated against the results obtained using 10cm accurate Real-Time Kinematic(RTK) device and against the results obtained using only the Assisted Global  Positioning  System(A-GPS)  chips  in  mobile  devices. Though  this  proposed  methodology  require  more  processing time than A-GPS chips, the accuracy level of this proposed methodology outperforms that of A-GPS chips and the results of the experiments carried out further convince that this proposed methodology facilitates improving the accuracy of position local- ization for augmented reality based reconstruction using mobile devices under certain limitations

Designing mobile augmented reality art applications:addressing the views of the galleries and the artists

The utilization of mobile augmented reality to display gallery artworks or museum content in novel ways is a well-established concept in the augmented reality research community. However, the focus of these systems is generally technologically driven or only addresses the end user and not the views of the gallery or the original artist. In this paper we discuss the design and development of the mobile application ?Taking the Artwork Home?, which allows people to digitally curate their own augmented reality art exhibitions in their own homes by digitally ?replacing? the pictures they have on their walls with content from the Peter Scott Gallery in Lancaster. In particular, we present the insights gained from a research through design methodology that allowed us to consider how the views of the gallery and artists impacted on the system design and therefore the user experience. Thus the final artifact is the result of an iterative evaluation process with over 100 users representing a broad range of demographics and continues to be evaluated/enhanced by observing its operation ?in the wild?. Further, we consider the effect the project has had on gallery practices to enable both augmented reality designers, and galleries and museums to maximize the potential application of the technology when working together on such project

Mixed marker-based/marker-less visual odometry system for mobile robots

When moving in generic indoor environments, robotic platforms generally rely solely on information provided by onboard sensors to determine their position and orientation. However, the lack of absolute references often leads to the introduction of severe drifts in estimates computed, making autonomous operations really hard to accomplish. This paper proposes a solution to alleviate the impact of the above issues by combining two vision‐based pose estimation techniques working on relative and absolute coordinate systems, respectively. In particular, the unknown ground features in the images that are captured by the vertical camera of a mobile platform are processed by a vision‐based odometry algorithm, which is capable of estimating the relative frame‐to‐frame movements. Then, errors accumulated in the above step are corrected using artificial markers displaced at known positions in the environment. The markers are framed from time to time, which allows the robot to maintain the drifts bounded by additionally providing it with the navigation commands needed for autonomous flight. Accuracy and robustness of the designed technique are demonstrated using an off‐the‐shelf quadrotor via extensive experimental test

Using Infra-Red Beacons as Unobtrusive Markers for Mobile Augmented Reality

The main two approaches for vision based mobile augmented reality systems are either those employing fiducial markers or those which track natural features in the environment to estimate camera pose information. Whilst marker based systems are relatively simple to implement and are robust they present difficulties for wide scale deployment as they are obtrusive and their size is proportional to the distance from which they need to be used. However, the alternate approaches of marker less systems present significant computational challenges, can be highly problematic in poor light conditions, and are independent of scale. In the paper we present a novel solution using Infra Red LED’s as markers that overcomes many of these limitations in that they are: invisible to the human sight but can tracked by phone camera optics; can be used in varied light conditions; structured to provide scale; and significantly reduce the computational overhead