MusA: Using Indoor Positioning and Navigation to Enhance Cultural Experiences in a museum

In recent years there has been a growing interest into the use of multimedia mobile guides in museum environments. Mobile devices have the capabilities to detect the user context and to provide pieces of information suitable to help visitors discovering and following the logical and emotional connections that develop during the visit. In this scenario, location based services (LBS) currently represent an asset, and the choice of the technology to determine users' position, combined with the definition of methods that can effectively convey information, become key issues in the design process. In this work, we present MusA (Museum Assistant), a general framework for the development of multimedia interactive guides for mobile devices. Its main feature is a vision-based indoor positioning system that allows the provision of several LBS, from way-finding to the contextualized communication of cultural contents, aimed at providing a meaningful exploration of exhibits according to visitors' personal interest and curiosity. Starting from the thorough description of the system architecture, the article presents the implementation of two mobile guides, developed to respectively address adults and children, and discusses the evaluation of the user experience and the visitors' appreciation of these application

Smart environment monitoring through micro unmanned aerial vehicles

In recent years, the improvements of small-scale Unmanned Aerial Vehicles (UAVs) in terms of flight time, automatic control, and remote transmission are promoting the development of a wide range of practical applications. In aerial video surveillance, the monitoring of broad areas still has many challenges due to the achievement of different tasks in real-time, including mosaicking, change detection, and object detection. In this thesis work, a small-scale UAV based vision system to maintain regular surveillance over target areas is proposed. The system works in two modes. The first mode allows to monitor an area of interest by performing several flights. During the first flight, it creates an incremental geo-referenced mosaic of an area of interest and classifies all the known elements (e.g., persons) found on the ground by an improved Faster R-CNN architecture previously trained. In subsequent reconnaissance flights, the system searches for any changes (e.g., disappearance of persons) that may occur in the mosaic by a histogram equalization and RGB-Local Binary Pattern (RGB-LBP) based algorithm. If present, the mosaic is updated. The second mode, allows to perform a real-time classification by using, again, our improved Faster R-CNN model, useful for time-critical operations. Thanks to different design features, the system works in real-time and performs mosaicking and change detection tasks at low-altitude, thus allowing the classification even of small objects. The proposed system was tested by using the whole set of challenging video sequences contained in the UAV Mosaicking and Change Detection (UMCD) dataset and other public datasets. The evaluation of the system by well-known performance metrics has shown remarkable results in terms of mosaic creation and updating, as well as in terms of change detection and object detection

The Exploitation of Data from Remote and Human Sensors for Environment Monitoring in the SMAT Project

In this paper, we outline the functionalities of a system that integrates and controls a fleet of Unmanned Aircraft Vehicles (UAVs). UAVs have a set of payload sensors employed for territorial surveillance, whose outputs are stored in the system and analysed by the data exploitation functions at different levels. In particular, we detail the second level data exploitation function whose aim is to improve the sensors data interpretation in the post-mission activities. It is concerned with the mosaicking of the aerial images and the cartography enrichment by human sensors—the social media users. We also describe the software architecture for the development of a mash-up (the integration of information and functionalities coming from the Web) and the possibility of using human sensors in the monitoring of the territory, a field in which, traditionally, the involved sensors were only the hardware ones.JRC.H.6-Digital Earth and Reference Dat

Automated mapping of oblique imagery collected with unmanned vehicles in coastal and marine environments

Recent technological advances in unmanned observational platforms, including remotely operated vehicles (ROVs) and small unmanned aerial systems (sUAS), have made them highly effective tools for research and monitoring within marine and coastal environments. One of the primary types of data collected by these systems is video imagery, which is often captured at an angle oblique to the Earth’s surface, rather than normal to it (e.g., downward looking). This thesis presents a newly developed suite of tools designed to digitally map oblique imagery data collected with ROV and sUAS in coastal and marine environments and quantitatively evaluates the accuracy of the resultant maps. Results indicate that maps generated from oblique imagery collected with unmanned vehicles have highly variable accuracy relative to maps generated with imagery data collected with conventional mapping platforms. These results suggest that resultant maps have the potential to match or even surpass the accuracy of maps generated with imagery data collected with conventional mapping platforms but realizing that potential is largely dependent upon careful survey design

A four-step ortho-rectification procedure for geo-referencing video streams from a low-cost UAV

In this paper, we present a four-step ortho-rectification procedure for real-time geo-referencing of video data from a low-cost UAV equipped with a multi-sensor system. The basic procedures for the real-time ortho-rectification are: (1) decompilation of the video stream into individual frames; (2) establishing the interior camera orientation parameters; (3) determining the relative orientation parameters for each video frame with respect to each other; (4) finding the absolute orientation parameters, using a self-calibration bundle and adjustment with the aid of a mathematical model. Each ortho-rectified video frame is then mosaicked together to produce a mosaic image of the test area, which is then merged with a well referenced existing digital map for the purpose of geo-referencing and aerial surveillance. A test field located in Abuja, Nigeria was used to evaluate our method. Video and telemetry data were collected for about fifteen minutes, and they were processed using the four-step ortho-rectification procedure. The results demonstrated that the geometric measurement of the control field from ortho-images is more accurate when compared with those from original perspective images when used to pin point the exact location of targets on the video imagery acquired by the UAV. The 2-D planimetric accuracy when compared with the 6 control points measured by a GPS receiver is between 3 to 5 metres

UNMANNED AERIAL VEHICLE APPLICATIONS OF 3D MODELLING, VISUALIZATION AND PARAMETER CALCULATIONS

Photogrammetric surveying with the use of Unmanned Aerial Vehicles (UAV) have gained vast popularity in short span. UAV have the potential to provide imagery at an extraordinary spatial and temporal resolution when coupled with remote sensing. Currently, UAV platforms are fastest and easiest source of data for mapping and 3D modelling. It is to be considered as a low-cost substitute to the traditional airborne photogrammetry. In the present study, UAV applications are explored in terms of 3D modelling, visualization and parameter calculations. National Institute of Technology Raipur, Raipur is chosen as study area and high resolution images are acquired from the UAV with 85% overlap. 3D model is processed through the point cloud generated for the UAV images. The results are compared with traditional methods for validation. The average accuracy obtained for elevation points and area is 97.99% and 97.75%. The study proves that UAV based surveying is an economical alternative in terms of money, time and resources, when compared to the classical aerial photogrammetry methods

Application of UAV BVLOS remote sensing data for multi-faceted analysis of Antarctic ecosystem

A photogrammetric flight was performed in December 2016 as BVLOS (Beyond Visual Line of Sight) operation over Penguin Island (South Shetland Islands, Western Antarctica). Images were taken by the PW-ZOOM fixed-wing UAV equipped with a digital SLR Canon 700D camera. The flight was performed at 550 m ASL and covered a total distance of 231.58 km. The plane takeoff and landing site was near the H. Arctowski Polish Antarctic Station (Arctowski) on King George Island, South Shetlands. The main aim of the mission was to collect environmental data to estimate the size of penguin and pinniped breeding populations and to map vegetation cover and landforms. The plane returned to Arctowski with 1630 images of Penguin Island with the ground sample distance (GSD) lower than 0.07 m. The analysis of developed ortophoto allowed us to locate and identify individuals of two penguin species (Adélie and chinstrap), and individuals of two species of pinnipeds (Southern elephant seal and Weddell seal). Three types of tundra communities were mapped together with numerous landforms such as: volcanic, mass movement, fluvial, coastal and aeolian ones. The UAV BVLOS photogram-metric operation proved to be very robust in gathering valuable qualitative and quantitative data necessary for monitoring distant and isolated polar environments

Point Cloud Generation from Aerial Image Data Acquired by a Quadrocopter Type Micro Unmanned Aerial Vehicle and a Digital Still Camera

The objective of this investigation was to develop and investigate methods for point cloud generation by image matching using aerial image data collected by quadrocopter type micro unmanned aerial vehicle (UAV) imaging systems. Automatic generation of high-quality, dense point clouds from digital images by image matching is a recent, cutting-edge step forward in digital photogrammetric technology. The major components of the system for point cloud generation are a UAV imaging system, an image data collection process using high image overlaps, and post-processing with image orientation and point cloud generation. Two post-processing approaches were developed: one of the methods is based on Bae Systems’ SOCET SET classical commercial photogrammetric software and another is built using Microsoft®’s Photosynth™ service available in the Internet. Empirical testing was carried out in two test areas. Photosynth processing showed that it is possible to orient the images and generate point clouds fully automatically without any a priori orientation information or interactive work. The photogrammetric processing line provided dense and accurate point clouds that followed the theoretical principles of photogrammetry, but also some artifacts were detected. The point clouds from the Photosynth processing were sparser and noisier, which is to a large extent due to the fact that the method is not optimized for dense point cloud generation. Careful photogrammetric processing with self-calibration is required to achieve the highest accuracy. Our results demonstrate the high performance potential of the approach and that with rigorous processing it is possible to reach results that are consistent with theory. We also point out several further research topics. Based on theoretical and empirical results, we give recommendations for properties of imaging sensor, data collection and processing of UAV image data to ensure accurate point cloud generation