Indoor Semantic Modelling for Routing: The Two-Level Routing Approach for Indoor Navigation

Humans perform many activities indoors and they show a growing need for indoor navigation, especially in unfamiliar buildings such as airports, museums and hospitals. Complexity of such buildings poses many challenges for building managers and visitors. Indoor navigation services play an important role in supporting these indoor activities. Indoor navigation covers extensive topics such as: 1) indoor positioning and localization; 2) indoor space representation for navigation model generation; 3) indoor routing computation; 4) human wayfinding behaviours; and 5) indoor guidance (e.g., textual directories). So far, a large number of studies of pedestrian indoor navigation have presented diverse navigation models and routing algorithms/methods. However, the major challenge is rarely referred to: how to represent the complex indoor environment for pedestrians and conduct routing according to the different roles and sizes of users. Such complex buildings contain irregular shapes, large open spaces, complicated obstacles and different types of passages. A navigation model can be very complicated if the indoors are accurately represented. Although most research demonstrates feasible indoor navigation models and related routing methods in regular buildings, the focus is still on a general navigation model for pedestrians who are simplified as circles. In fact, pedestrians represent different sizes, motion abilities and preferences (e.g., described in user profiles), which should be reflected in navigation models and be considered for indoor routing (e.g., relevant Spaces of Interest and Points of Interest). In order to address this challenge, this thesis proposes an innovative indoor modelling and routing approach – two-level routing. It specially targets the case of routing in complex buildings for distinct users. The conceptual (first) level uses general free indoor spaces: this is represented by the logical network whose nodes represent the spaces and edges stand for their connectivity; the detailed (second) level focuses on transition spaces such as openings and Spaces of Interest (SOI), and geometric networks are generated regarding these spaces. Nodes of a geometric network refers to locations of doors, windows and subspaces (SOIs) inside of the larger spaces; and the edges represent detailed paths among these geometric nodes. A combination of the two levels can represent complex buildings in specified spaces, which avoids maintaining a largescale complete network. User preferences on ordered SOIs are considered in routing on the logical network, and preferences on ordered Points of Interest (POI) are adopted in routing on geometric networks. In a geometric network, accessible obstacle-avoiding paths can be computed for users with different sizes. To facilitate automatic generation of the two types of network in any building, a new data model named Indoor Navigation Space Model (INSM) is proposed to store connectivity, semantics and geometry of indoor spaces for buildings. Abundant semantics of building components are designed in INSM based on navigational functionalities, such as VerticalUnit(VU) and HorizontalConnector(HC) as vertical and horizontal passages for pedestrians. The INSM supports different subdivision ways of a building in which indoor spaces can be assigned proper semantics. A logical and geometric network can be automatically derived from INSM, and they can be used individually or together for indoor routing. Thus, different routing options are designed. Paths can be provided by using either the logical network when some users are satisfied with a rough description of the path (e.g., the name of spaces), or a geometric path is automatically computed for a user who needs only a detailed path which shows how obstacles can be avoided. The two-level routing approach integrates both logical and geometric networks to obtain paths, when a user provides her/his preferences on SOIs and POIs. For example, routing results for the logical network can exclude unrelated spaces and then derive geometric paths more efficiently. In this thesis, two options are proposed for routing just on the logical network, three options are proposed for routing just on the geometric networks, and seven options for two-level routing. On the logical network, six routing criteria are proposed and three human wayfinding strategies are adopted to simulate human indoor behaviours. According to a specific criterion, space semantics of logical nodes is utilized to assign different weights to logical nodes and edges. Therefore, routing on the logical network can be accomplished by applying the Dijkstra algorithm. If multiple criteria are adopted, an order of criteria is applied for routing according to a specific user. In this way, logical paths can be computed as a sequence of indoor spaces with clear semantics. On geometric networks, this thesis proposes a new routing method to provide detailed paths avoiding indoor obstacles with respect to pedestrian sizes. This method allows geometric networks to be derived for individual users with different sizes for any specified spaces. To demonstrate the use of the two types of network, this thesis tests routing on one level (the logical or the geometric network). Four case studies about the logical network are presented in both simple and complex buildings. In the simple building, no multiple paths lie between spaces A and B, but in the complex buildings, multiple logical paths exist and the candidate paths can be reduced by applying these routing criteria in an order for a user. The relationships of these criteria to user profiles are assumed in this thesis. The proposed geometric routing regarding user sizes is tested with three case studies: 1) routing for pedestrians with two distinct sizes in one space; 2) routing for pedestrians with changed sizes in one space; and 3) a larger geometric network formed by the ones in a given sequence of spaces. The first case shows that a small increase of user size can largely change the accessible path; the second case shows different path segments for distinct sizes can be combined into one geometric path; the third case demonstrates a geometric network can be created ’on the fly’ for any specified spaces of a building. Therefore, the generation and routing of geometric networks are very flexible and fit to given users. To demonstrate the proposed two-level routing approach, this thesis designs five cases. The five cases are distinguished according to the method of model creation (pre-computed or ’on-the-fly’) and model storage (on the client or server). Two of them are realized in this thesis: 1) Case 1 just in the client pre-computes the logical network and derives geometric networks ’on the fly’; 2) Case 2 just in the client pre-computes and stores the logical and geometric networks for certain user sizes. Case 1 is implemented in a desktop application for building managers, and Case 2 is realized as a mobile mock-up for mobile users without an internet connection. As this thesis shows, two-level routing is powerful enough to effectively provide indicative logical paths and/or comprehensive geometric paths, according to different user requirements on path details. In the desktop application, three of the proposed routing options for two-level routing are tested for the simple OTB building and the complex Schiphol Airport building. These use cases demonstrate that the two-level routing approach includes the following merits: It supports routing in different abstraction forms of a building. The INSM model can describe different subdivision results of a building, and it allows two types of routing network to be derived – pure logical and geometric ones. The logical network contains the topology and semantics of indoor spaces, and the geometric network provides accurate geometry for paths. A consistent navigation model is formed with the two networks, i.e., the conceptual and detailed levels. On the conceptual level, it supports routing on a logical network and assists the derivation of a conceptual path (i.e., logical path) for a user in terms of space sequence. Routing criteria are designed based on the INSM semantics of spaces, which can generate logical paths similar to human wayfinding results such as minimizing VerticalUnit or HorizontalConnector. On the detailed level, it considers the size of users and results in obstacle-avoiding paths. By using this approach, geometric networks can be generated to avoid obstacles for the given users and accessible paths are flexibly provided for user demands. This approach can process changes of user size more efficiently, in contrast to routing on a complete geometric network. It supports routing on both the logical and the geometric networks, which can generate geometric paths based on user-specific logical paths, or re-compute logical paths when geometric paths are inaccessible. This computation method is very useful for complex buildings. The two-level routing approach can flexibly provide logical and geometric paths according to user preferences and sizes, and can adjust the generated paths in limited time. Based on the two-level routing approach, this thesis also provides a vision on possible cooperation with other methods. A potential direction is to design more routing options according to other indoor scenarios and user preferences. Extensions of the two-level routing approach, such as other types of semantics, multi-level networks and dynamic obstacles, will make it possible to deal with other routing cases. Last but not least, it is also promising to explore its relationships with indoor guidance, different building subdivisions and outdoor navigation. &nbsp

Indoor Semantic Modelling for Routing:

Humans perform many activities indoors and they show a growing need for indoor navigation, especially in unfamiliar buildings such as airports, museums and hospitals. Complexity of such buildings poses many challenges for building managers and visitors. Indoor navigation services play an important role in supporting these indoor activities. Indoor navigation covers extensive topics such as: 1) indoor positioning and localization; 2) indoor space representation for navigation model generation; 3) indoor routing computation; 4) human wayfinding behaviours; and 5) indoor guidance (e.g., textual directories). So far, a large number of studies of pedestrian indoor navigation have presented diverse navigation models and routing algorithms/methods. However, the major challenge is rarely referred to: how to represent the complex indoor environment for pedestrians and conduct routing according to the different roles and sizes of users. Such complex buildings contain irregular shapes, large open spaces, complicated obstacles and different types of passages. A navigation model can be very complicated if the indoors are accurately represented. Although most research demonstrates feasible indoor navigation models and related routing methods in regular buildings, the focus is still on a general navigation model for pedestrians who are simplified as circles. In fact, pedestrians represent different sizes, motion abilities and preferences (e.g., described in user profiles), which should be reflected in navigation models and be considered for indoor routing (e.g., relevant Spaces of Interest and Points of Interest). In order to address this challenge, this thesis proposes an innovative indoor modelling and routing approach – two-level routing. It specially targets the case of routing in complex buildings for distinct users. The conceptual (first) level uses general free indoor spaces: this is represented by the logical network whose nodes represent the spaces and edges stand for their connectivity; the detailed (second) level focuses on transition spaces such as openings and Spaces of Interest (SOI), and geometric networks are generated regarding these spaces. Nodes of a geometric network refers to locations of doors, windows and subspaces (SOIs) inside of the larger spaces; and the edges represent detailed paths among these geometric nodes. A combination of the two levels can represent complex buildings in specified spaces, which avoids maintaining a largescale complete network. User preferences on ordered SOIs are considered in routing on the logical network, and preferences on ordered Points of Interest (POI) are adopted in routing on geometric networks. In a geometric network, accessible obstacle-avoiding paths can be computed for users with different sizes. To facilitate automatic generation of the two types of network in any building, a new data model named Indoor Navigation Space Model (INSM) is proposed to store connectivity, semantics and geometry of indoor spaces for buildings. Abundant semantics of building components are designed in INSM based on navigational functionalities, such as VerticalUnit(VU) and HorizontalConnector(HC) as vertical and horizontal passages for pedestrians. The INSM supports different subdivision ways of a building in which indoor spaces can be assigned proper semantics. A logical and geometric network can be automatically derived from INSM, and they can be used individually or together for indoor routing. Thus, different routing options are designed. Paths can be provided by using either the logical network when some users are satisfied with a rough description of the path (e.g., the name of spaces), or a geometric path is automatically computed for a user who needs only a detailed path which shows how obstacles can be avoided. The two-level routing approach integrates both logical and geometric networks to obtain paths, when a user provides her/his preferences on SOIs and POIs. For example, routing results for the logical network can exclude unrelated spaces and then derive geometric paths more efficiently. In this thesis, two options are proposed for routing just on the logical network, three options are proposed for routing just on the geometric networks, and seven options for two-level routing. On the logical network, six routing criteria are proposed and three human wayfinding strategies are adopted to simulate human indoor behaviours. According to a specific criterion, space semantics of logical nodes is utilized to assign different weights to logical nodes and edges. Therefore, routing on the logical network can be accomplished by applying the Dijkstra algorithm. If multiple criteria are adopted, an order of criteria is applied for routing according to a specific user. In this way, logical paths can be computed as a sequence of indoor spaces with clear semantics. On geometric networks, this thesis proposes a new routing method to provide detailed paths avoiding indoor obstacles with respect to pedestrian sizes. This method allows geometric networks to be derived for individual users with different sizes for any specified spaces. To demonstrate the use of the two types of network, this thesis tests routing on one level (the logical or the geometric network). Four case studies about the logical network are presented in both simple and complex buildings. In the simple building, no multiple paths lie between spaces A and B, but in the complex buildings, multiple logical paths exist and the candidate paths can be reduced by applying these routing criteria in an order for a user. The relationships of these criteria to user profiles are assumed in this thesis. The proposed geometric routing regarding user sizes is tested with three case studies: 1) routing for pedestrians with two distinct sizes in one space; 2) routing for pedestrians with changed sizes in one space; and 3) a larger geometric network formed by the ones in a given sequence of spaces. The first case shows that a small increase of user size can largely change the accessible path; the second case shows different path segments for distinct sizes can be combined into one geometric path; the third case demonstrates a geometric network can be created ’on the fly’ for any specified spaces of a building. Therefore, the generation and routing of geometric networks are very flexible and fit to given users. To demonstrate the proposed two-level routing approach, this thesis designs five cases. The five cases are distinguished according to the method of model creation (pre-computed or ’on-the-fly’) and model storage (on the client or server). Two of them are realized in this thesis: 1) Case 1 just in the client pre-computes the logical network and derives geometric networks ’on the fly’; 2) Case 2 just in the client pre-computes and stores the logical and geometric networks for certain user sizes. Case 1 is implemented in a desktop application for building managers, and Case 2 is realized as a mobile mock-up for mobile users without an internet connection. As this thesis shows, two-level routing is powerful enough to effectively provide indicative logical paths and/or comprehensive geometric paths, according to different user requirements on path details. In the desktop application, three of the proposed routing options for two-level routing are tested for the simple OTB building and the complex Schiphol Airport building. These use cases demonstrate that the two-level routing approach includes the following merits: It supports routing in different abstraction forms of a building. The INSM model can describe different subdivision results of a building, and it allows two types of routing network to be derived – pure logical and geometric ones. The logical network contains the topology and semantics of indoor spaces, and the geometric network provides accurate geometry for paths. A consistent navigation model is formed with the two networks, i.e., the conceptual and detailed levels. On the conceptual level, it supports routing on a logical network and assists the derivation of a conceptual path (i.e., logical path) for a user in terms of space sequence. Routing criteria are designed based on the INSM semantics of spaces, which can generate logical paths similar to human wayfinding results such as minimizing VerticalUnit or HorizontalConnector. On the detailed level, it considers the size of users and results in obstacle-avoiding paths. By using this approach, geometric networks can be generated to avoid obstacles for the given users and accessible paths are flexibly provided for user demands. This approach can process changes of user size more efficiently, in contrast to routing on a complete geometric network. It supports routing on both the logical and the geometric networks, which can generate geometric paths based on user-specific logical paths, or re-compute logical paths when geometric paths are inaccessible. This computation method is very useful for complex buildings. The two-level routing approach can flexibly provide logical and geometric paths according to user preferences and sizes, and can adjust the generated paths in limited time. Based on the two-level routing approach, this thesis also provides a vision on possible cooperation with other methods. A potential direction is to design more routing options according to other indoor scenarios and user preferences. Extensions of the two-level routing approach, such as other types of semantics, multi-level networks and dynamic obstacles, will make it possible to deal with other routing cases. Last but not least, it is also promising to explore its relationships with indoor guidance, different building subdivisions and outdoor navigation

Integrating BIM with ArcGIS for Indoor Navigation

With increasing demand for indoor navigation and rapid developments in Building Information Modeling (BIM), indoor routing and analysis attracts attention from both the GIS and architecture worlds. This project’s goal was to integrate BIM with GIS and utilize it for indoor navigation use. It aimed to provide executable methods in ArcGIS for indoor path generation and to explore the possibilities for further applications. In this project, Data Interoperability Extension was used to operating the transformation from Industry Foundation Classes (IFC) to geodatabase. After importing the data, two methods were proposed: Mesh and TIN. The Mesh method used a standard-sized grid graph as the referencing network for a floor and subsequently mapping the movement on a 2D plane to the movement along grid edges. TIN method utilized the TIN network as the base; it maps the movement on a 2D plane to the movement along TIN edges. Both of the methods were achieved by using tools and functions in ArcGIS. In conclusion, the result shows that the Mesh approach provided a very precise network for the building floor, whereas the TIN approach was efficient on the generating process side

Implementación de tecnologías RFID e IoT inalámbricas en el Modelado de información de construcción (BIM)

ABSTRACT: The integration and installation of innovative Radio Frequency Identification (RFID) technologies in combination with wireless Internet of Things (IoT) technologies in Building Information Modelling (BIM), assigned building elements, can create connectivity between the physical- and the virtual world. Beyond the identification of physical objects, further information can be connected, which can be made available to different user groups during the entire life cycle of the building structure. This provides a high level of transparency, in that by scanning the tagged building elements, complete associated information can be accessed and presented to users via applications, in visual and audio form. One use of an RFID and BIM-supported electronic guidance system, namely for the visually impaired, has already been investigated in my bachelor thesis at the University of Applied Sciences (Technische Hochschule Mittelhessen, THM). This Master’s Thesis focuses on the implementation of passive RFID technology into BIM models in combining them with open-source software applications. BIM represents the digital twin of building models in the digital world and can be linked to physical structures (buildings, roads, sewer systems and such others) and building materials (e.g. textiles, mineral and plastic floor coverings, concrete components) by integrating RFID tags. Connecting the parametric BIM models with the physical building elements by using RFID and wireless IoT technologies in a multi-platform application enables the BIM building models to be actively used throughout the life cycle of a building, not only by the facility management, but also by the public for various use cases. During the literature review, suitable software and hardware components were selected, and a prototype multi-platform application for a navigation and positioning system was developed as proof of concept for the Industry Foundation Classes (IFC) file. (See Demo Version at https://opennavibim.herokuapp.com/ ). The challenge was to read the RFID tags in different installation scenarios. Depending on the installation situations (under, over or in the material), various requirements were specified for RFID tags and readers (RFID, handhold personal digital assistant “PDA”). In this field, further hardware developments are necessary.RESUMEN: Mediante la integración e instalación de la innovadora tecnología de identificación por radiofrecuencia (RFID, Radio Frequency Identification) en el modelado digital de información de construcción (BIM, Building Information Modelling), con la interconexión inalámbrica del internet de las cosas (IoT, Internet of Things), es posible crear una conectividad entre el mundo físico y el virtual. Más allá de la mera identificación de objetos existentes, esta conectividad permite incorporar información adicional, que puede ponerse en disposición de los diferentes grupos de usuarios que intervienen durante el ciclo completo de vida de la estructura de la edificación. Se consigue un alto de nivel de transparencia en ese traspaso de información, accesible por medio del escaneado de los elementos etiquetados en la edificación, al tener una completa información asociada que es presentada a los usuarios vía aplicaciones en formato visual o de audio. Una investigación en la aplicación de tecnología RFID basada en BIM para un sistema de navegación electrónica, destinada a personas con discapacidad visual, ha sido desarrollada en mi trabajo fin de grado en la Universidad de Ciencias Aplicadas de Mittelhessen (THM). El presente Trabajo Fin de Master se centra en la implementación de tecnología RFID pasiva en modelos BIM combinados con aplicaciones de software libre. El modelo BIM representa el gemelo digital de los elementos de construcción en el mundo virtual, permitiendo establecer una relación del modelo con estructuras físicas (edificios, carreteras o sistemas de alcantarillado, entre otros) y materiales de construcción (por ejemplo, textiles, cubiertas de suelo minerales o plásticas, componentes de hormigón, …) por medio de la integración de etiquetas RFID. La conexión de los modelos paramétricos BIM con los elementos físicos del edificio, mediante el uso de tecnologías RFID e IoT inalámbricas en una aplicación multiplataforma, permite que los modelos de construcción BIM se utilicen activamente a lo largo del ciclo de vida de un edificio, no solo por la gestión de las instalaciones, sino también por el público para diversos casos de uso. Durante la revisión bibliográfica, se seleccionaron los componentes de software y hardware adecuados, y se desarrolló un prototipo de aplicación multiplataforma para un sistema de navegación y posicionamiento como prueba de viabilidad del concepto del modelo Industry Foundation Classes (IFC). (Véase la versión de demostración en https://opennavibim.herokuapp.com/ ). La lectura de las etiquetas RFID en diferentes en diferentes situaciones de instalación presenta un desafío, dependiendo de la instalación (debajo, encima o en el material) los requisitos impuestos a las etiquetas y lectores RFID son diferentes. Por lo tanto, es necesario seguir desarrollando el hardware en este ámbito.Máster en Ingeniería de Caminos, Canales y Puertos (Plan 2020

Survey on indoor map standards and formats

With the adoption of indoor positioning solutions, which enable for a variety of location-based spatial services, a number of indoor map standards and formats have been proposed in the last decade. As each of these indoor map standard has its own purpose, the strengths and weaknesses are necessary to be understood and analyzed before selecting one of them for a given application. The Indoor Map Subcommittee has been established under IPIN/ISC in 2017. Among others, the goal of this working group is to compare available indoor map standards, provide a guideline for their application and advise on changes to their standardization development organizations if necessary. In this paper we present a survey of indoor map standards as an achievement of the subcommittee. The scope of the survey covers official standards such as IFC of BuildingSmart, IndoorGML and CityGML of OGC, and Indoor OpenStreetMap. We present several use-cases to show and discuss how to build indoor maps.The work of K.-J. Li was supported by a grant (19NSIP-B135746-03) from National Spatial Information Research Program (NSIP) funded by MOLIT of Korean government. The work of C. Laoudias has been supported by the European Union's Horizon 2020 research and innovation programme under grant agreement No. 739551 (KIOS CoE) and from the Republic of Cyprus through the Directorate General for European Programmes, Coordination and Development. Torres-Sospedra and Perez-Navarro want to thank the Spanish network of excellence, REPNIN+,TEC2017-90808-REDT. The work of A. Moreira has been supported by FCT -Fundacao para a Ciencia e Tecnologia within the Project Scope: UID/CEC/00319/2019

Fireground location understanding by semantic linking of visual objects and building information models

This paper presents an outline for improved localization and situational awareness in fire emergency situations based on semantic technology and computer vision techniques. The novelty of our methodology lies in the semantic linking of video object recognition results from visual and thermal cameras with Building Information Models (BIM). The current limitations and possibilities of certain building information streams in the context of fire safety or fire incident management are addressed in this paper. Furthermore, our data management tools match higher-level semantic metadata descriptors of BIM and deep-learning based visual object recognition and classification networks. Based on these matches, estimations can be generated of camera, objects and event positions in the BIM model, transforming it from a static source of information into a rich, dynamic data provider. Previous work has already investigated the possibilities to link BIM and low-cost point sensors for fireground understanding, but these approaches did not take into account the benefits of video analysis and recent developments in semantics and feature learning research. Finally, the strengths of the proposed approach compared to the state-of-the-art is its (semi -)automatic workflow, generic and modular setup and multi-modal strategy, which allows to automatically create situational awareness, to improve localization and to facilitate the overall fire understanding

CityGML in the Integration of BIM and the GIS: Challenges and Opportunities

CityGML (City Geography Markup Language) is the most investigated standard in the integration of building information modeling (BIM) and the geographic information system (GIS), and it is essential for digital twin and smart city applications. The new CityGML 3.0 has been released for a while, but it is still not clear whether its new features bring new challenges or opportunities to this research topic. Therefore, the aim of this study is to understand the state of the art of CityGML in BIM/GIS integration and to investigate the potential influence of CityGML3.0 on BIM/GIS integration. To achieve this aim, this study used a systematic literature review approach. In total, 136 papers from Web of Science (WoS) and Scopus were collected, reviewed, and analyzed. The main findings of this review are as follows: (1) There are several challenging problems in the IFC-to-CityGML conversion, including LoD (Level of Detail) mapping, solid-to-surface conversion, and semantic mapping. (2) The ‘space’ concept and the new LoD concept in CityGML 3.0 can bring new opportunities to LoD mapping and solid-to-surface conversion. (3) The Versioning module and the Dynamizer module can add dynamic semantics to the CityGML. (4) Graph techniques and scan-to-BIM offer new perspectives for facilitating the use of CityG

스캔 도면을 활용한 이동약자용 실내 그래프 데이터베이스 구축

학위논문(박사) -- 서울대학교대학원 : 공과대학 건설환경공학부, 2021.8. 박슬아.사람들의 실내 활동이 다양해지면서 건물의 규모가 커지고 구조가 복잡해지고 있다. 이러한 실내 환경의 변화는 교통약자의 이동성 보장에 대한 사회적 관심을 증가시켰으며, 교통약자 맞춤형 실내 라우팅 서비스에 대한 수요 또한 증가시켰다. 특히 많은 이동 제약을 가지는 이동약자 대상 서비스의 경우에는, 최적 경로를 계획하는 과정에서 개인의 선호나 경험이 반영된 개인화된 서비스로 범위가 확장되고 있다. 이러한 배경에서, 스키마가 유연하고 데이터의 가공 및 처리가 효율적인 데이터베이스의 구축이 필요하다. 본 연구에서는 스캔한 도면 이미지를 활용한 이동약자용 실내 그래프데이터베이스 구축 기법을 제안하였다. 먼저, 국내외 실내 공간 관련 표준 및 설계 기준들의 검토를 통해 이동약자의 통행과 관련된 실내 공간 및 객체, 영향 요인들을 도출하여 개념적 데이터 모델을 설계하였다. 또한, 실내의 각 공간과 시설물의 기하정보와 위상정보를 기반으로 이동약자의 접근성 및 통행 가능성을 정량화하기 위한 접근성 지수를 설계하였다. 다음으로, 스캔 도면을 입력하여 이동약자용 실내 그래프 데이터베이스 구축을 위한 프로세스를 제안하였다. 제안한 프로세스는 전이학습 기반 접근 방식을 통해 스캔 도면에서 공간의 구조 정보를 추출하고, 토폴로지 추출 및 접근성 평가를 통해 이동약자용 네트워크 모델을 생성하며, 생성한 네트워크 모델을 그래프 데이터베이스로 자동 변환하는 과정을 포함한다. 구체적으로, 제안 프로세스는 수정된 ResNet 기반의 모델을 새롭게 라벨링한 도면으로 미세 조정하여 사용함으로써 실내 구조맵을 생성한다. 이후 추출된 객체들의 공간 관계를 기반으로 각 공간을 노드와 링크로 표현한 실내 네트워크 모델을 구축한다. 각 공간의 접근성 정보는 제안된 접근성 지수와 임계값을 사용하여 생성된 후 데이터베이스에 저장되어, 이동약자를 위한 접근 가능한 그래프 추출에 활용될 수 있다. 본 연구에서는 제안한 기법을 서울대학교 도면 데이터 셋에 적용하여 이동약자용 실내 그래프 데이터베이스를 구축하고 평가하였다. 구축한 실내 그래프 데이터베이스를 활용하여 다층 경로 계획과 실내외 연계 경로 계획의 2가지 시나리오에 따라 최적 경로를 도출하였다. 그 결과, 일반 보행자의 최적 경로와 비교하여 이동약자용 최적 경로는 가까운 계단이 아닌 엘리베이터를 통한 수직 이동을 포함하였을 뿐만 아니라 접근 불가능한 공간을 회피하도록 도출되었다. 즉, 제안한 기법을 통해 이동약자 측면에서 통행 장애 정보를 포함하여 실내 환경을 적절하게 묘사하는 데이터베이스의 구축이 가능함을 확인할 수 있었다. 또한, 출입로로 명명된 관계 생성만으로 스케일이나 좌표 변환 없이 실내외 연계 경로 계획이 가능하였는데, 이는 독립적인 데이터 간 연계 사용에 적합한 그래프 데이터베이스의 특성을 반영한 결과로 판단할 수 있다. 본 연구의 주요 기여는 스캔한 도면을 사용하여 이동약자용 실내 그래프 데이터베이스를 구축하기 위한 프로세스를 개발한 것이다. 구체적으로, 이동약자의 이동에 초점을 두고 설계한 데이터 모델을 기반으로 한 데이터베이스 구축이 가능하므로 이동약자용 실내 길안내 서비스에 활용될 수 있다. 또한, 토폴로지 구축 및 그래프 데이터베이스로의 변환을 위한 하위 프로시져를 개발하였으며, 제안 프로세스는 해당 프로시져들로 구성되어 도면 입력을 통해 이동약자용 실내 그래프 데이터베이스 구축을 가능하게 한다. 해당 하위 프로시져들은 자동으로 수행될 수 있어 데이터베이스 구축 시 소요되는 시간과 비용을 절감할 수 있다. 또한, 다양한 정형 및 비정형 데이터의 연계에 적합한 그래프 데이터베이스의 특징에 의해, 제안한 프로세스를 통해 구축한 실내 데이터베이스는 기존 공간 모델의 기능을 포함하면서 다양한 유형의 길안내 서비스에 활용될 수 있을 것으로 기대된다.Changes to the indoor environment have increased social interest in ensuring the mobility of people with disabilities. Therefore, the demand for customized indoor routing services for people with mobility disabilities (PWMD), who have many travel restrictions, is increasing. These services have progressed from spatial routing to personalized routing, which reflects personal preferences and experiences in planning an optimal path. In this regard, it is necessary to generate a database for PWMD with a flexible schema suitable for the efficient manipulation and processing of data. This study aims to propose a technique of generating an indoor graph database for PWMD using scanned floor plans. First, a conceptual data model was developed by deriving relevant indoor features and influential factors, considering various international regulations on indoor environments. Also, the accessibility index was designed based on the data model to quantify the difficulties in accessing spaces based on each indoor spaces geometric characteristics. Next, a three-stage process was proposed: retrieving the structure of spaces from scanned floor plans through a transfer learning-based approach, retrieving topology and assessing accessibility for creating an indoor network model for PWMD, and converting the network model into a graph database. Specifically, an indoor structure map is created by fine-tuning the modified Resnet-based model with newly annotated floor plans for extracting structure information. Also, based on the spatial relationship of the extracted features, the indoor network model was created by abstracting indoor spaces with nodes and links. The accessibility of each space is determined by the proposed indices and thresholds; thereby, a feasible network for PWMD could be derived. Then, a process was developed for automatically converting an indoor network model, including accessibility property, into a graph database. The proposed technique was applied to the Seoul National University dataset to generate an indoor graph database for PWMD. Two scenario-based routing tests were conducted using the generated database to verify the utility of results: multi-floor routing and integrated indoor-outdoor routing. As a result, compared with the path for general pedestrians, the optimal path for PWMD was derived by avoiding inaccessible spaces, including vertical movement using elevators rather than the nearest stairs. In other words, applying the proposed technique, a database that adequately described an indoor environment in terms of PWMD with sufficient mobile constraint information could be constructed. Moreover, an integrated indoor-outdoor routing could be conducted by only creating an entrance-labeled relationship, without scale and coordinate transformation. This result reflects the usability of the generated graph database and its suitability regarding the incorporation of multiple individual data sources. The main contribution lies in the development of the process for generating an indoor graph database for PWMD using scanned floor plans. In particular, the database for PWMD routing can be generated based on the proposed data model with PWMD-related features and factors. Also, sub-procedures for topology retrieval and graph database conversion are developed to generate the indoor graph database by the end-to-end process. The developed sub-procedures are performed automatically, thereby reducing the required times and costs. It is expected that the target database of the proposed process can be generated considering utilization for various types of routing since the graph database is easily integrated with multiple types of information while covering the existing spatial models function.1. Introduction 1 1.1 Objectives and contributions 1 1.2 Related works 7 1.2.1 Indoor environment conceptualization 7 1.2.2 Indoor data construction 11 1.2.3 Accessibility assessment 19 1.3 Research scope and flow 22 2. Conceptual modeling 26 2.1 Relevant features and factors 28 2.2 Proposed data model 30 2.3 Space accessibility for PWMD 36 2.3.1 Influential factors within indoor environments 37 2.3.2 Accessibility index 41 3. Indoor graph database for PWMD from scanned floor plans 43 3.1 Retrieving structure of indoor spaces 43 3.1.1 Pre-trained model for detecting indoor geometry 45 3.1.2 Dataset with new annotation 47 3.1.3 Transfer learning-based approach 52 3.2 Generating the indoor network model for PWMD 56 3.2.1 Definition of nodes and links in the network model 60 3.2.2 The classification rule of space polygons 63 3.2.3 Connection between general spaces and doors 68 3.2.4 Node-link generation for horizontal transition spaces 71 3.2.5 Vertical link generation 75 3.2.6 Connectivity and accessibility information generation 79 3.3 Indoor graph database for PWMD 80 3.3.1 Graph representation of indoor environments 80 3.3.2 Conversion of network model into graph database 83 3.4 Entire process 87 4. Experiment and results 89 4.1 Experimental setup and test data 89 4.2 Evaluation for retrieved information 92 4.2.1 Results of structure retrieval 92 4.2.2 Results of topology retrieval 99 4.3 Generated indoor graph database for PWMD 128 4.3.1 Results of the indoor graph database for PWMD 128 4.3.2 Query-based routing 136 5. Conclusion 147 References 150 Appendix 166 국문초록 178박