TOWARDS DEEP LEARNING FOR ARCHITECTURE: A MONUMENT RECOGNITION MOBILE APP

Abstract. In recent years, the diffusion of large image datasets and an unprecedented computational power have boosted the development of a class of artificial intelligence (AI) algorithms referred to as deep learning (DL). Among DL methods, convolutional neural networks (CNNs) have proven particularly effective in computer vision, finding applications in many disciplines. This paper introduces a project aimed at studying CNN techniques in the field of architectural heritage, a still to be developed research stream. The first steps and results in the development of a mobile app to recognize monuments are discussed. While AI is just beginning to interact with the built environment through mobile devices, heritage technologies have long been producing and exploring digital models and spatial archives. The interaction between DL algorithms and state-of-the-art information modeling is addressed, as an opportunity to both exploit heritage collections and optimize new object recognition techniques.</p

A Navigation and Augmented Reality System for Visually Impaired People

In recent years, we have assisted with an impressive advance in augmented reality systems and computer vision algorithms, based on image processing and artificial intelligence. Thanks to these technologies, mainstream smartphones are able to estimate their own motion in 3D space with high accuracy. In this paper, we exploit such technologies to support the autonomous mobility of people with visual disabilities, identifying pre-defined virtual paths and providing context information, reducing the distance between the digital and real worlds. In particular, we present ARIANNA+, an extension of ARIANNA, a system explicitly designed for visually impaired people for indoor and outdoor localization and navigation. While ARIANNA is based on the assumption that landmarks, such as QR codes, and physical paths (composed of colored tapes, painted lines, or tactile pavings) are deployed in the environment and recognized by the camera of a common smartphone, ARIANNA+ eliminates the need for any physical support thanks to the ARKit library, which we exploit to build a completely virtual path. Moreover, ARIANNA+ adds the possibility for the users to have enhanced interactions with the surrounding environment, through convolutional neural networks (CNNs) trained to recognize objects or buildings and enabling the possibility of accessing contents associated with them. By using a common smartphone as a mediation instrument with the environment, ARIANNA+ leverages augmented reality and machine learning for enhancing physical accessibility. The proposed system allows visually impaired people to easily navigate in indoor and outdoor scenarios simply by loading a previously recorded virtual path and providing automatic guidance along the route, through haptic, speech, and sound feedback

Simple identification tools in FishBase

Simple identification tools for fish species were included in the FishBase information system from its inception. Early tools made use of the relational model and characters like fin ray meristics. Soon pictures and drawings were added as a further help, similar to a field guide. Later came the computerization of existing dichotomous keys, again in combination with pictures and other information, and the ability to restrict possible species by country, area, or taxonomic group. Today, www.FishBase.org offers four different ways to identify species. This paper describes these tools with their advantages and disadvantages, and suggests various options for further development. It explores the possibility of a holistic and integrated computeraided strategy

Review of remote sensing for land administration: Origins, debates, and selected cases

Conventionally, land administration—incorporating cadastres and land registration—uses ground-based survey methods. This approach can be traced over millennia. The application of photogrammetry and remote sensing is understood to be far more contemporary, only commencing deeper into the 20th century. This paper seeks to counter this view, contending that these methods are far from recent additions to land administration: successful application dates back much earlier, often complementing ground-based methods. Using now more accessible historical works, made available through archive digitisation, this paper presents an enriched and more complete synthesis of the developments of photogrammetric methods and remote sensing applied to the domain of land administration. Developments from early phototopography and aerial surveys, through to analytical photogrammetric methods, the emergence of satellite remote sensing, digital cameras, and latterly lidar surveys, UAVs, and feature extraction are covered. The synthesis illustrates how debates over the benefits of the technique are hardly new. Neither are well-meaning, although oft-flawed, comparative analyses on criteria relating to time, cost, coverage, and quality. Apart from providing this more holistic view and a timely reminder of previous work, this paper brings contemporary practical value in further demonstrating to land administration practitioners that remote sensing for data capture, and subsequent map production, are an entirely legitimate, if not essential, part of the domain. Contemporary arguments that the tools and approaches do not bring adequate accuracy for land administration purposes are easily countered by the weight of evidence. Indeed, these arguments may be considered to undermine the pragmatism inherent to the surveying discipline, traditionally an essential characteristic of the profession. That said, it is left to land administration practitioners to determine the relevance of these methods for any specific country context. © 2021 by the authors. Licensee MDPI, Basel, Switzerland

Context-Based Cultural Visits

Over the last two decades, there have been tremendous advances in mobile technologies, which have increased the interest in studying and developing mobile augmented reality systems, especially in the field of Cultural Heritage. Nowadays, people rely even more on smartphones, for example, when visiting a new city to search for information about monuments and landmarks, and the visitor expects precise and tailored information to his needs. Therefore, researchers started to investigate innovative approaches for presenting and suggesting digital content related to cultural and historical places around the city, incorporating contextual information about the visitor and his needs. This document presents a novel mobile augmented reality application, NearHeritage, that was developed within the scope of the master's thesis on Electrical and Computers Engineering from the Faculty of Engineering of Porto University (FEUP), in collaboration with INESC TEC. The research carried out was focused on the importance of utilising modern technologies to assist the visitors in finding and exploring Cultural Heritage. In this way, it is provided not only the nearby points-of-interest of a city but also detailed information about each POI. The solution presented uses built-in sensors and hardware of Android devices and takes advantage of various APIs (Foursquare API, Google Maps API and IntelContextSensing) to retrieve information about the landmarks and the visitor context. Also, these are crucial hardware components for implementing the full potential of augmented reality tools to create innovative contents that increase the overall user experience. All the experiments were conducted in Porto, Portugal, and the final results showcase that the concept of a MAR application can improve the user experience in discovering and learning more about Cultural Heritage around the world, creating an interactive, enjoyable and unforgettable adventure

Monument Monitor: using citizen science to preserve heritage

This research demonstrates how data collected by citizen scientists can act as a valuable resource for heritage managers. It establishes to what extent visitors’ photographs can be used to assist in aspects of condition monitoring focusing on biological and plant growth, erosion, stone/mortar movement, water ingress/pooling and antisocial behaviour. This thesis describes the methodology and outcomes of Monument Monitor (MM), a project set up in collaboration with Historic Environment Scotland (HES) that requested visitors at selected Scottish heritage sites to submit photographs of their visit. Across twenty case study sites participants were asked to record evidence of a variety of conservation issues. Patterns of contributions to the project are presented alongside key stakeholder feedback, which show how MM was received and where data collection excelled. Alongside this, the software built to manage and sort submissions is presented as a scalable methodology for the collection of citizen generated data of heritage sites. To demonstrate the applicability of citizen generated data for in depth monitoring and analysis, an environmental model is created using the submissions from one case study which predicts the effect of the changing climate at the site between 1980 - 2080. Machine Learning (ML) is used to analyse submitted data in both classification and segmentation tasks. This application demonstrates the validity of utilising ML tools to assist in the analysis and categorising of volunteer submitted photographs. The outcome of this PhD is a scalable methodology with which conservation staff can use visitor submitted images as an evidence-base to support them in the management of heritage sites

International Conference on Mechatronics, System Engineering and Robotics & Information System and Engineering

UBT Annual International Conference is the 8th international interdisciplinary peer reviewed conference which publishes works of the scientists as well as practitioners in the area where UBT is active in Education, Research and Development. The UBT aims to implement an integrated strategy to establish itself as an internationally competitive, research-intensive university, committed to the transfer of knowledge and the provision of a world-class education to the most talented students from all background. The main perspective of the conference is to connect the scientists and practitioners from different disciplines in the same place and make them be aware of the recent advancements in different research fields, and provide them with a unique forum to share their experiences. It is also the place to support the new academic staff for doing research and publish their work in international standard level. This conference consists of sub conferences in different fields like: – Computer Science and Communication Engineering– Management, Business and Economics– Mechatronics, System Engineering and Robotics– Energy Efficiency Engineering– Information Systems and Security– Architecture – Spatial Planning– Civil Engineering , Infrastructure and Environment– Law– Political Science– Journalism , Media and Communication– Food Science and Technology– Pharmaceutical and Natural Sciences– Design– Psychology– Education and Development– Fashion– Music– Art and Digital Media– Dentistry– Applied Medicine– Nursing This conference is the major scientific event of the UBT. It is organizing annually and always in cooperation with the partner universities from the region and Europe. We have to thank all Authors, partners, sponsors and also the conference organizing team making this event a real international scientific event. Edmond Hajrizi, President of UBT UBT – Higher Education Institutio