CMIR-NET : A Deep Learning Based Model For Cross-Modal Retrieval In Remote Sensing

We address the problem of cross-modal information retrieval in the domain of remote sensing. In particular, we are interested in two application scenarios: i) cross-modal retrieval between panchromatic (PAN) and multi-spectral imagery, and ii) multi-label image retrieval between very high resolution (VHR) images and speech based label annotations. Notice that these multi-modal retrieval scenarios are more challenging than the traditional uni-modal retrieval approaches given the inherent differences in distributions between the modalities. However, with the growing availability of multi-source remote sensing data and the scarcity of enough semantic annotations, the task of multi-modal retrieval has recently become extremely important. In this regard, we propose a novel deep neural network based architecture which is considered to learn a discriminative shared feature space for all the input modalities, suitable for semantically coherent information retrieval. Extensive experiments are carried out on the benchmark large-scale PAN - multi-spectral DSRSID dataset and the multi-label UC-Merced dataset. Together with the Merced dataset, we generate a corpus of speech signals corresponding to the labels. Superior performance with respect to the current state-of-the-art is observed in all the cases

Forward method for vertical air motion estimation from frequency modulated continuous wave radar rain measurements

Vertically-pointed Frequency-Modulated Continuous-Wave (FMCW) radar measurements of rain are greatly influenced by strong vertical winds (vertical air motion, VAM) in convective rain scenarios. Particularly, 2nd order products such as rain rate (RR) and drop size distribution (DSD) experience high estimation errors due to VAM. In this work, we consider the estimation of VAM from vertically-pointed FMCW radar measurements in order to correct VAM-corrupted rain 2nd order products. We present preliminary research on a forward method to estimate VAM velocity at a particular height from S-band FMCW radar measurements in convective rain scenarios. The method relies on the parameterization of the DSD as a gamma distribution. It estimates the VAM along with the constitutive parameters of the gamma distribution by means of a parametric solver. The methodology is tested over long-duration, high-resolution measurements by the University of Massachussetts FMCW radar and validated against a ground-based disdrometer in the context of the Verification of the Origins of Rotation in Tornadoes Experiment-Southeast (VORTEX-SE).Peer ReviewedPostprint (published version

Gas Pressure Measurement Device and Medical Vacuum Design

Two methods are used in a digital pressure meter available in the market, namely positive pressure, and negative pressure. The positive one is used to measure the air pressure on a sphygmomanometer and medical gas pressure at an outlet in the treatment room so that operators can easily check medical gas pressure for the safety of the patient, or they can routinely check to find out how much pressure of the medical gas. Based on the background, the research aimed to design a digital pressure meter equipped with a medical gas measurement mode so that the device can be used to calibrate the sphygmomanometer, suction pump, and measure the medical gas pressure available at the medical gas outlet in each treatment room

A comprehensive system for detection of flammable and toxic gases using IoT

The majority of the existing gases constitute a risk to the health of humans and the environment in general. There is a wide range of diseases that can arise as a result of exposure to toxic and dangerous gases, which can be a cause of death or serious health problems. More so, deadly explosions may occur as a result of leakages of such gases. However, such consequences can be avoided when these dangerous gases are not detected early. Many researchers have proposed different kinds of systems for the detection of gas leakage, but most of the proposed systems were mainly designed to detect LPG gas. Therefore, in this study, a system is proposed for detecting different kinds of flammable and toxic gases. The gases that are detectable by the proposed system include smoke, Ethanol, CNG Gas, Methane, toluene, propane, Carbon Monoxide, acetone, Hydrogen Gas, and Formaldehyde. The system can detect gases efficiently and release evacuation alarms simultaneously, then send SMS for emergencies. The proposed system is ready to use and can be installed at any work location

Analysis of Multiple Scattering Characteristics of Cable-Stayed Bridges with Multi-band SAR

Accurate localization of multi-scattering features of cable-stayed bridges in multi-band Synthetic Aperture Radar (SAR) imagery is crucial for intelligent recognition of bridge targets within images, as well as for precise water level extraction. This study focuses on the Badong Yangtze River Bridge, utilizing Unmanned Aerial Vehicle (UAV) LiDAR data of the bridge, and analyzes the multi-scattering characteristics of different bridge structural targets based on Geometric Optics (GO) methods and the Range-Doppler principle. Furthermore, the study integrates LiDAR data of the bridge's cable-stays to examine their multi-scattering phenomena, finding that the undulations of the Yangtze River's surface waves significantly contribute to the pronounced double scattering features of the bridge's cable-stays. Additionally, statistical analysis of multi-source SAR data indicates that this phenomenon is not directly correlated with radar wavelength, implying no direct connection to surface roughness. Utilizing LiDAR point cloud data from the bridge's street lamps, this paper proposes a novel method for estimating water level elevation by identifying the center position of spots formed by double scattering from lamp posts. The results show that using TerraSAR ascending and descending orbit images, this method achieves a water level elevation accuracy of approximately 0.2 meters

무인비행체 탑재 열화상 및 실화상 이미지를 활용한 야생동물 탐지 가능성 연구

학위논문(석사) -- 서울대학교대학원 : 환경대학원 환경조경학과, 2022.2. 송영근.야생동물의 탐지와 모니터링을 위해, 현장 직접 관찰, 포획-재포획과 같은 전통적 조사 방법이 다양한 목적으로 수행되어왔다. 하지만, 이러한 방법들은 많은 시간과 상대적으로 비싼 비용이 필요하며, 신뢰 가능한 탐지 결과를 얻기 위해선 숙련된 현장 전문가가 필요하다. 게다가, 전통적인 현장 조사 방법은 현장에서 야생동물을 마주치는 등 위험한 상황에 처할 수 있다. 이에 따라, 카메라 트래핑, GPS 추적, eDNA 샘플링과 같은 원격 조사 방법이 기존의 전통적 조사방법을 대체하며 더욱 빈번히 사용되기 시작했다. 하지만, 이러한 방법들은 여전히 목표로 하는 대상의 전체 면적과, 개별 개체를 탐지할 수 없다는 한계를 가지고 있다. 이러한 한계를 극복하기 위해, 무인비행체 (UAV, Unmanned Aerial Vehicle)가 야생동물 탐지의 대중적인 도구로 자리매김하고 있다. UAV의 가장 큰 장점은, 선명하고 촘촘한 공간 및 시간해상도와 함께 전체 연구 지역에 대한 동물 탐지가 가능하다는 것이다. 이에 더해, UAV를 사용함으로써, 접근하기 어려운 지역이나 위험한 곳에 대한 조사가 가능해진다. 하지만, 이러한 이점 외에, UAV의 단점도 명확히 존재한다. 대상지, 비행 속도 및 높이 등과 같이 UAV를 사용하는 환경에 따라, 작은 동물, 울창한 숲속에 있는 개체, 빠르게 움직이는 동물을 탐지하는 것이 제한된다. 또한, 기상환경에 따라서도 비행이 불가할 수 있고, 배터리 용량으로 인한 비행시간의 제한도 존재한다. 하지만, 정밀한 탐지가 불가능하더라도, 이와 관련 연구가 꾸준히 수행되고 있으며, 선행연구들은 육상 및 해상 포유류, 조류, 그리고 파충류 등을 탐지하는 데에 성공하였다. UAV를 통해 얻어지는 가장 대표적인 데이터는 실화상 이미지이다. 이를 사용해 머신러닝 및 딥러닝 (ML-DL, Machine Learning and Deep Learning) 방법이 주로 사용되고 있다. 이러한 방법은 상대적으로 정확한 탐지 결과를 보여주지만, 특정 종을 탐지할 수 있는 모델의 개발을 위해선 최소한 천 장의 이미지가 필요하다. 실화상 이미지 외에도, 열화상 이미지 또한 UAV를 통해 획득 될 수 있다. 열화상 센서 기술의 개발과 센서 가격의 하락은 많은 야생동물 연구자들의 관심을 사로잡았다. 열화상 카메라를 사용하면 동물의 체온과 주변환경과의 온도 차이를 통해 정온동물을 탐지하는 것이 가능하다. 하지만, 새로운 데이터가 사용되더라도, 여전히 ML-DL 방법이 동물 탐지에 주로 사용되고 있으며, 이러한 방법은 UAV를 활용한 야생동물의 실시간 탐지를 제한한다. 따라서, 본 연구는 열화상과 실화상 이미지를 활용한 동물 자동 탐지 방법의 개발과, 개발된 방법이 이전 방법들의 평균 이상의 정확도와 함께 현장에서 실시간으로 사용될 수 있도록 하는 것을 목표로 한다.For wildlife detection and monitoring, traditional methods such as direct observation and capture-recapture have been carried out for diverse purposes. However, these methods require a large amount of time, considerable expense, and field-skilled experts to obtain reliable results. Furthermore, performing a traditional field survey can result in dangerous situations, such as an encounter with wild animals. Remote monitoring methods, such as those based on camera trapping, GPS collars, and environmental DNA sampling, have been used more frequently, mostly replacing traditional survey methods, as the technologies have developed. But these methods still have limitations, such as the lack of ability to cover an entire region or detect individual targets. To overcome those limitations, the unmanned aerial vehicle (UAV) is becoming a popular tool for conducting a wildlife census. The main benefits of UAVs are able to detect animals remotely covering a wider region with clear and fine spatial and temporal resolutions. In addition, by operating UAVs investigate hard to access or dangerous areas become possible. However, besides these advantages, the limitations of UAVs clearly exist. By UAV operating environments such as study site, flying height or speed, the ability to detect small animals, targets in the dense forest, tracking fast-moving animals can be limited. And by the weather, operating UAV is unable, and the flight time is limited by the battery matters. Although detailed detection is unavailable, related researches are developing and previous studies used UAV to detect terrestrial and marine mammals, avian and reptile species. The most common type of data acquired by UAVs is RGB images. Using these images, machine-learning and deep-learning (ML–DL) methods were mainly used for wildlife detection. ML–DL methods provide relatively accurate results, but at least 1,000 images are required to develop a proper detection model for specific species. Instead of RGB images, thermal images can be acquired by a UAV. The development of thermal sensor technology and sensor price reduction has attracted the interest of wildlife researchers. Using a thermal camera, homeothermic animals can be detected based on the temperature difference between their bodies and the surrounding environment. Although the technology and data are new, the same ML–DL methods were typically used for animal detection. These ML-DL methods limit the use of UAVs for real-time wildlife detection in the field. Therefore, this paper aims to develop an automated animal detection method with thermal and RGB image datasets and to utilize it under in situ conditions in real-time while ensuring the average-above detection ability of previous methods.Abstract I Contents IV List of Tables VII List of Figures VIII Chapter 1. Introduction 1 1.1 Research background 1 1.2 Research goals and objectives 10 1.2.1 Research goals 10 1.2.2 Research objectives 11 1.3 Theoretical background 13 1.3.1 Concept of the UAV 13 1.3.2 Concept of the thermal camera 13 Chapter 2. Methods 15 2.1 Study site 15 2.2 Data acquisition and preprocessing 16 2.2.1 Data acquisition 16 2.2.2 RGB lens distortion correction and clipping 19 2.2.3 Thermal image correction by fur color 21 2.2.4 Unnatural object removal 22 2.3 Animal detection 24 2.3.1 Sobel edge creation and contour generation 24 2.3.2 Object detection and sorting 26 Chapter 3. Results 30 3.1 Number of counted objects 31 3.2 Time costs of image types 33 Chapter 4. Discussion 36 4.1 Reference comparison 36 4.2 Instant detection 40 4.3 Supplemental usage 41 4.4 Utility of thermal sensors 42 4.5 Applications in other fields 43 Chapter 5. Conclusions 47 References 49 Appendix: Glossary 61 초록 62석

Estimation of Surface Thermal Emissivity in a Vineyard for UAV Microbolometer Thermal Cameras Using NASA HyTES Hyperspectral Thermal, and Landsat and AggieAir Optical Data

Microbolometer thermal cameras in UAVs and manned aircraft allow for the acquisition of highresolution temperature data, which, along with optical reflectance, contributes to monitoring and modeling of agricultural and natural environments. Furthermore, these temperature measurements have facilitated the development of advanced models of crop water stress and evapotranspiration in precision agriculture and heat fluxes exchanges in small river streams and corridors. Microbolometer cameras capture thermal information at blackbody or radiometric settings (narrowband emissivity equates to unity). While it is customary that the modeler uses assumed emissivity values (e.g. 0.99– 0.96 for agricultural and environmental settings); some applications (e.g. Vegetation Health Index), and complex models such as energy balance-based models (e.g. evapotranspiration) could benefit from spatial estimates of surface emissivity for true or kinetic temperature mapping. In that regard, this work presents an analysis of the spectral characteristics of a microbolometer camera with regard to emissivity, along with a methodology to infer thermal emissivity spatially based on the spectral characteristics of the microbolometer camera. For this work, the MODIS UCBS Emissivity Library, NASA HyTES hyperspectral emissivity, Landsat, and Utah State University AggieAir UAV surface reflectance products are employed. The methodology is applied to a commercial vineyard agricultural setting located in Lodi, California, where HyTES, Landsat, and AggieAir UAV spatial data were collected in the 2014 growing season. Assessment of the microbolometer spectral response with regards to emissivity and emissivity modeling performance for the area of study are presented and discussed