SURVEY TEKNIK PENGKLASIFIKASIAN GAYA ARSITEKTUR PADA FASAD BANGUNAN MENGGUNAKAN PENDEKATAN DEEP LEARNING CNN

Teknik pengklasifikasian gaya arsitektur pada fasad bangunan menjadi bagian penting pada dunia perancangan, guna mempercepat proses dalam melakukan kajian tipologinya. Dewasa ini dengan semakin berkembangnya teknologi informasi, sangat memungkinkan bila seiring waktu dengan berbagai kemajuan metode dalam mengekstraksi obyek bangunan utamanya fasad bangunan. Penelitian dalam pengklasifikasian fasad bangunan banyak dilakukan untuk menelusuri jenis bangunan maupun aspek estetika lainnya. Demi tujuan tersebut studi survey ini dimaksudkan untuk mengetahui teknik komputasi Deep Learning (DL) yang dapat digunakan dalam mengidentifikasi fasad bangunan secara lebih akurat dengan membedakan dan mengelompokkannya agar lebih mudah dikenali tipe bangunannya. Metode yang digunakan dalam melakukan penelitian ini menggunakan teknik seleksi dan eliminasi, berasal dari penelitian di berbagai jurnal yang relevan terhadap pengklasifikasian gaya arsitektur bangunan. Hasil survey literatur menunjukkan bahwa terdapat  kesenjangan, hasil akurasi dari yang tertinggi ke terendah sebesar 48,19 % sehingga diperlukan adanya inovasi pada perangkat sistemnya. Teknik DL paling banyak digunakan dengan pendekatan Convolutional Neural Network (CNN) yang dikombinasikan dengan sistem perangkat lain, daripada fiturnya sendiri guna meningkatkan nilai akurasi

Developing a 3D geometry for Urban energy modelling of Indian cities

The advancement in the field of Urban Building Energy Modelling (UBEM) is assisting urban planners and managers to design and operate cities to meet environmental emission targets. The usefulness of the UBEM depends upon the quality and level of details (LoD) of the inputs to the model. The inadequacy and quality of relevant input data pose challenges. This paper analyses the usefulness of different methodologies for developing a 3D building stock model of Ahmedabad, India, recognizing data gaps and heterogenous development of the city over time. It evaluates the potentials, limitations, and challenges of remote sensing techniques namely (a) Satellite imagery (b) LiDAR and (c) Photogrammetry for this application. Further, the details and benefits of data capturing through UAV assisted Photogrammetry technique for the development of the 3D city model are discussed. The research develops potential techniques for feature detection and model reconstruction using Computer vision on the Photogrammetry reality mesh. Preliminary results indicate that the use of supervised learning for Image based segmentation on the reality mesh detects building footprints with higher accuracy as compared to geometrybased segmentation of the point cloud. This methodology has the potential to detect complex building features and remove redundant objects to develop the semantic model at different LoDs for urban simulations. The framework deployed and demonstrated for the part of Ahmedabad has a potential for scaling up to other parts of the city and other Indian cities having similar urban morphology and no previous data for developing a UBEM

DAMAGE DETECTION ON BUILDING FAÇADES USING MULTI-TEMPORAL AERIAL OBLIQUE IMAGERY

Over the past decades, a special interest has been given to remote-sensing imagery to automate the detection of damaged buildings. Given the large areas it may cover and the possibility of automation of the damage detection process, when comparing with lengthy and costly ground observations. Currently, most image-based damage detection approaches rely on Convolutional Neural Networks (CNN). These are used to determine if a given image patch shows damage or not in a binary classification approach. However, such approaches are often trained using image samples containing only debris and rubble piles. Since such approaches often aim at detecting partial or totally collapsed buildings from remote-sensing imagery. Hence, such approaches might not be applicable when the aim is to detect façade damages. This is due to the fact that façade damages also include spalling, cracks and other small signs of damage. Only a few studies focus their damage analysis on the façade and a multi-temporal approach is still missing. In this paper, a multi-temporal approach specifically designed for the image classification of façade damages is presented. To this end, three multi-temporal approaches are compared with two mono-temporal approaches. Regarding the multi-temporal approaches the objective is to understand the optimal fusion between the two imagery epochs within a CNN. The results show that the multi-temporal approaches outperform the mono-temporal ones by up to 22% in accuracy

The TUM-DLR Multimodal Earth Observation Evaluation Benchmark

We present a new dataset for development, benchmarking, and evaluation of remote sensing and earth observation approaches with special focus on converging perspectives. In order to provide data with different modalities, we observed the same scene using satellites, airplanes, unmanned aerial vehicles (UAV), and smartphones. The dataset is further complemented by ground-truth information and baseline results for different application scenarios. The provided data can be freely used by anybody interested in remote sensing and earth observation and will be continuously augmented and updated

A Pipeline of 3D Scene Reconstruction from Point Clouds

3D technologies are becoming increasingly popular as their applications in industrial, consumer, entertainment, healthcare, education, and governmental increase in number. According to market predictions, the total 3D modeling and mapping market is expected to grow from $1.1 billion in 2013 to$7.7 billion by 2018. Thus, 3D modeling techniques for different data sources are urgently needed. This thesis addresses techniques for automated point cloud classification and the reconstruction of 3D scenes (including terrain models, 3D buildings and 3D road networks). First, georeferenced binary image processing techniques were developed for various point cloud classifications. Second, robust methods for the pipeline from the original point cloud to 3D model construction were proposed. Third, the reconstruction for the levels of detail (LoDs) of 1-3 (CityGML website) of 3D models was demonstrated. Fourth, different data sources for 3D model reconstruction were studied. The strengths and weaknesses of using the different data sources were addressed. Mobile laser scanning (MLS), unmanned aerial vehicle (UAV) images, airborne laser scanning (ALS), and the Finnish National Land Survey’s open geospatial data sources e.g. a topographic database, were employed as test data. Among these data sources, MLS data from three different systems were explored, and three different densities of ALS point clouds (0.8, 8 and 50 points/m2) were studied. The results were compared with reference data such as an orthophoto with a ground sample distance of 20cm or measured reference points from existing software to evaluate their quality. The results showed that 74.6% of building roofs were reconstructed with the automated process. The resulting building models provided an average height deviation of 15 cm. A total of 6% of model points had a greater than one-pixel deviation from laser points. A total of 2.5% had a deviation of greater than two pixels. The pixel size was determined by the average distance of input laser points. The 3D roads were reconstructed with an average width deviation of 22 cm and an average height deviation of 14 cm. The results demonstrated that 93.4% of building roofs were correctly classified from sparse ALS and that 93.3% of power line points are detected from the six sets of dense ALS data located in forested areas. This study demonstrates the operability of 3D model construction for LoDs of 1-3 via the proposed methodologies and datasets. The study is beneficial to future applications, such as 3D-model-based navigation applications, the updating of 2D topographic databases into 3D maps and rapid, large-area 3D scene reconstruction. 3D-teknologiat ovat tulleet yhä suositummiksi niiden sovellusalojen lisääntyessä teollisuudessa, kuluttajatuotteissa, terveydenhuollossa, koulutuksessa ja hallinnossa. Ennusteiden mukaan 3D-mallinnus- ja -kartoitusmarkkinat kasvavat vuoden 2013 1,1 miljardista dollarista 7,7 miljardiin vuoteen 2018 mennessä. Erilaisia aineistoja käyttäviä 3D-mallinnustekniikoita tarvitaankin yhä enemmän. Tässä väitöskirjatutkimuksessa kehitettiin automaattisen pistepilviaineiston luokittelutekniikoita ja rekonstruoitiin 3D-ympäristöja (maanpintamalleja, rakennuksia ja tieverkkoja). Georeferoitujen binääristen kuvien prosessointitekniikoita kehitettiin useiden pilvipisteaineistojen luokitteluun. Työssä esitetään robusteja menetelmiä alkuperäisestä pistepilvestä 3D-malliin eri CityGML-standardin tarkkuustasoilla. Myös eri aineistolähteitä 3D-mallien rekonstruointiin tutkittiin. Eri aineistolähteiden käytön heikkoudet ja vahvuudet analysoitiin. Testiaineistona käytettiin liikkuvalla keilauksella (mobile laser scanning, MLS) ja ilmakeilauksella (airborne laser scanning, ALS) saatua laserkeilausaineistoja, miehittämättömillä lennokeilla (unmanned aerial vehicle, UAV) otettuja kuvia sekä Maanmittauslaitoksen avoimia aineistoja, kuten maastotietokantaa. Liikkuvalla laserkeilauksella kerätyn aineiston osalta tutkimuksessa käytettiin kolmella eri järjestelmällä saatua dataa, ja kolmen eri tarkkuustason (0,8, 8 ja 50 pistettä/m2) ilmalaserkeilausaineistoa. Tutkimuksessa saatuja tulosten laatua arvioitiin vertaamalla niitä referenssiaineistoon, jona käytettiin ortokuvia (GSD 20cm) ja nykyisissä ohjelmistoissa olevia mitattuja referenssipisteitä. 74,6 % rakennusten katoista saatiin rekonstruoitua automaattisella prosessilla. Rakennusmallien korkeuksien keskipoikkeama oli 15 cm. 6 %:lla mallin pisteistä oli yli yhden pikselin poikkeama laseraineiston pisteisiin verrattuna. 2,5 %:lla oli yli kahden pikselin poikkeama. Pikselikoko määriteltiin kahden laserpisteen välimatkan keskiarvona. Rekonstruoitujen teiden leveyden keskipoikkeama oli 22 cm ja korkeuden keskipoikkeama oli 14 cm. Tulokset osoittavat että 93,4 % rakennuksista saatiin luokiteltua oikein harvasta ilmalaserkeilausaineistosta ja 93,3 % sähköjohdoista saatiin havaittua kuudesta tiheästä metsäalueen ilmalaserkeilausaineistosta. Tutkimus demonstroi 3D-mallin konstruktion toimivuutta tarkkuustasoilla (LoD) 1-3 esitetyillä menetelmillä ja aineistoilla. Tulokset ovat hyödyllisiä kehitettäessä tulevaisuuden sovelluksia, kuten 3D-malleihin perustuvia navigointisovelluksia, topografisten 2D-karttojen ajantasaistamista 3D-kartoiksi, ja nopeaa suurten alueiden 3D-ympäristöjen rekonstruktiota