674 research outputs found
Efficient multitemporal change detection techniques for hyperspectral images on GPU
Hyperspectral images contain hundreds of reflectance values for each pixel.
Detecting regions of change in multiple hyperspectral images of the same
scene taken at different times is of widespread interest for a large number of
applications. For remote sensing, in particular, a very common application is
land-cover analysis. The high dimensionality of the hyperspectral images
makes the development of computationally efficient processing schemes
critical. This thesis focuses on the development of change detection
approaches at object level, based on supervised direct multidate
classification, for hyperspectral datasets. The proposed approaches improve
the accuracy of current state of the art algorithms and their projection onto
Graphics Processing Units (GPUs) allows their execution in real-time
scenarios
Spatiotemporal dynamics of stress factors in wheat analysed by multisensoral remote sensing and geostatistics
Plant stresses, in particular fungal diseases, basically show a high variability in space and time with respect to their impact on the host. Recent ‘Precision Agriculture’ techniques allow for a spatially and temporally adjusted pest control that might reduce the amount of cost-intensive and ecologically harmful agrochemicals. Conventional stress detection techniques such as random monitoring do not meet demands of such optimally placed management actions. The prerequisite is a profound knowledge about the controlled phenomena as well as their accurate sensor-based detection. Therefore, the present study focused on spatiotemporal dynamics of stress factors in wheat, Europe’s main crop. Primarily, the spatiotemporal characteristics of the fungal diseases, powdery mildew (Blumeria graminis) and leaf rust (Puccinia recondita), were analysed by remote sensing techniques and geo-statistics on leaf and field scale. Basically, there are two different approaches to sensor-based detection of crop stresses: near-range sensors and airborne-/satellite-borne sensors. In order to assess the potential of both approaches, various experiments in field and laboratory were carried out with the use of multiple sensors operated at different scales. Besides the spatial dimension of crop stresses, all studies focussed on the temporal dimension of these phenomena, since this is the key question for an operational use of these techniques. In addition, a comparison between multispectral and hyperspectral data gave an indication of their suitability for this purpose. The results exhibit very high spatiotemporal dynamics for both fungal diseases. However, powdery mildew and leaf rust showed different characteristics, with leaf rust showing a more systematic temporal progress. The physiological behaviours of the phenomena, which are strongly influenced by various environmental factors, define the optimal disease detection date as well as the temporal resolution required for sensor-based disease detection. Due to the high spatiotemporal dynamics of the investigated diseases, a general recommendation of optimal detection periods can not be given, but critical periods are highlighted for each pathogen. The results indicate that multispectral remote sensing data with high spatial resolution shows a high potential for quantifying crop vigour by using spectral mixture analyses. Simulated endmembers for the identification of stressed wheat areas were utilized, whereby promising results could be achieved. However, due to the low spectral resolution of these data, a discrimination of stress factors or early disease detection is not possible. Hyperspectral data was therefore used to point out the potential of early detection of crop diseases, which is a crucial and restrictive factor for Precision Agriculture applications. In a laboratory experiment, leaf rust infections could be detected by hyperspectral data five days after inoculation. In a field experiment with respect to early stress detection, it could be demonstrated that hyperspectral data outperformed multispectral data. High accuracy for the detection of powdery mildew infections in the field was thereby achieved. Due to the fact that typical spatiotemporal characteristics for each pathogen were found, there is a high potential for decision support systems, considering all variables that affect the disease progress. Besides the further analysis of hyperspectral data for disease detection, the development of a decision support system is the subject of the upcoming last period of the Research Training Group 722
Spectro-temporal heterogeneity measures from dense high spatial resolution satellite image time series: application to grassland species diversity estimation
Grasslands represent a significant source of biodiversity that is important to monitor over large extents. The Spectral Variation Hypothesis (SVH) assumes that the Spectral Heterogeneity(SH) measured from remote sensing data can be used as a proxy for species diversity. Here, we argue the hypothesis that the grassland’s species differ in their phenology and, hence, that the temporal variations can be used in addition to the spectral variations. The purpose of this study is to attempt verifying the SVH in grasslands using the temporal information provided by dense Satellite Image Time Series (SITS) with a high spatial resolution. Our method to assess the spectro-temporal heterogeneity is based on a clustering of grasslands using a robust technique for high dimensional data. We propose new SH measures derived from this clustering and computed at the grassland level. We compare them to the Mean Distance to Centroid (MDC). The method is experimented on 192 grasslands from southwest France using an intra-annual multispectral SPOT5 SITS comprising 18 images and using single images from this SITS. The combination of two of the proposed SH measures—the within-class variability and the entropy—in a multivariate linear model explained the variance of the grasslands’ Shannon index more than the MDC. However, there were no significant differences between the predicted values issued from the best models using multitemporal and monotemporal imagery. We conclude that multitemporal data at a spatial resolution of 10 m do not contribute to estimating the species diversity. The temporal variations may be more related to the effect of management practices
Assessing remote sensing application on rangeland insurance in Canadian prairies
Part of the problem with implementing a rangeland insurance program is that the acreage of different pasture types, which is required in order to determine an indemnity payment, is difficult to measure on the ground over large areas. Remote sensing techniques provide a potential solution to this problem. This study applied single-date SPOT (Satellite Pour I’Observation de la Terre) imagery, field collected data, and geographic information system (GIS) data to study the classification of land cover and vegetation at species level. Two topographic correction models, Minnaert model and C-correction, and two classifying algorithms, maximum likelihood classifier (MLC) and artificial neural network (ANN), were evaluated. The feasibility of discriminating invasive crested wheatgrass from natives was investigated, and an exponential normalized difference vegetation index (ExpNDMI) was developed to increase the separability between crested wheatgrass and natives. Spectral separability index (SSI) was used to select proper bands and vegetation indices for classification. The results show that topographic corrections can be effective to reduce intra-class rediometric variation caused by topographic effect in the study area and improve the classification. An overall accuracy of 90.5% was obtained by MLC using Minnaert model corrected reflectance, and MLC obtained higher classification accuracy (~5%) than back-propagation based ANN. Topographic correction can reduce intra-class variation and improve classification accuracy at about 4% comparing to the original reflectance. The crested wheatgrass was over-estimated in this study, and the result indicated that single-date SPOT 5 image could not classify crested wheatgrass with satisfactory accuracy. However, the proposed ExpNDMI can reduce intra-class variation and enlarge inter-class variation, further, improve the ability to discriminate invasive crested wheatgrass from natives at 4% of overall accuracy. This study revealed that single-date SPOT image may perform an effective classification on land cover, and will provide a useful tool to update the land cover information in order to implement a rangeland insurance program
Mapping And Monitoring Wetland Environment By Analysis Different Satellite Images And Field Spectroscopy
Tez (Doktora) -- İstanbul Teknik Üniversitesi, Fen Bilimleri Enstitüsü, 2010Thesis (PhD) -- İstanbul Technical University, Institute of Science and Technology, 2010Bu çalışmada farklı spektral ve mekansal çözünürlükte uydu görüntülerinin “Terkos Havzası Sulak Alanı” örneğinde; arazi örtüsünde meydana gelen değişimleri ve sulak alan bitki türlerinin belirlenmesinde kullanılabilirlikleri için uygulanabilecek uzaktan algılama yöntemleri ele alınmıştır. Kullanılan yöntemler ile elde edilen yeni işlenmiş görüntülerin performanslarının yersel yansıtım değerleri kullanılarak desteklenmesi ile doğal alanların sürdürülebilir korunma ve yönetimi için uzaktan algılama verilerine dayalı bir altlık rehberin oluşturulması imkanı araştırılmıştır. Elde edilen sonuçlara göre heterojen arazi örtüsü yapısına sahip olan çalışma bölgesinde değişim tespiti için Ana Bileşen Dönüşümüne dayalı değişim tespit yöntemi en iyi sonucu vermiştir. Ayrıca bu çalışmada, hiperspektral Hyperion EO-1 görüntüsü ile sulak alan bitki örtüsünün diğer bitki türlerinden doğru olarak ayırt edilebildiği ortaya konmuştur. Sulak alan bitki türlerinin kendi içinde ayırt edilebilmesi ancak yersel spektroskopi ile mümkün olduğu sonucuna ulaşılmıştır.In this study, different satellite data that has different spectral and spatial resolution and in-situ spectroradiometer measurements were used to analyze hydrophytic vegetation and surrounded land cover for sustainable development and conservation of Terkos wetlands. By supporting performances of processed images with field collected reflectance values, the feasibility of structuring a basic guide based on remote sensing data for sustainable preservation and management of natural lands was searched. According to result, land cover changes in the complex natural area were determined more accurately by using PCA based change detection method Therefore, the performance of spaceborne Hyperion EO-1 hyperspectral data was analyzed to determine the capability of the data for wetland vegetation discrimination than the other vegetated areas. At the last stage of the study, field collected reflectance values that have different wetland flora types were compared by statistical ANOVA method and reflectance differences between vegetation types were put forward through calculations.DoktoraPh
Multitemporal Very High Resolution from Space: Outcome of the 2016 IEEE GRSS Data Fusion Contest
In this paper, the scientific outcomes of the 2016 Data Fusion Contest organized by the Image Analysis and Data Fusion Technical Committee of the IEEE Geoscience and Remote Sensing Society are discussed. The 2016 Contest was an open topic competition based on a multitemporal and multimodal dataset, which included a temporal pair of very high resolution panchromatic and multispectral Deimos-2 images and a video captured by the Iris camera on-board the International Space Station. The problems addressed and the techniques proposed by the participants to the Contest spanned across a rather broad range of topics, and mixed ideas and methodologies from the remote sensing, video processing, and computer vision. In particular, the winning team developed a deep learning method to jointly address spatial scene labeling and temporal activity modeling using the available image and video data. The second place team proposed a random field model to simultaneously perform coregistration of multitemporal data, semantic segmentation, and change detection. The methodological key ideas of both these approaches and the main results of the corresponding experimental validation are discussed in this paper
A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community
In recent years, deep learning (DL), a re-branding of neural networks (NNs),
has risen to the top in numerous areas, namely computer vision (CV), speech
recognition, natural language processing, etc. Whereas remote sensing (RS)
possesses a number of unique challenges, primarily related to sensors and
applications, inevitably RS draws from many of the same theories as CV; e.g.,
statistics, fusion, and machine learning, to name a few. This means that the RS
community should be aware of, if not at the leading edge of, of advancements
like DL. Herein, we provide the most comprehensive survey of state-of-the-art
RS DL research. We also review recent new developments in the DL field that can
be used in DL for RS. Namely, we focus on theories, tools and challenges for
the RS community. Specifically, we focus on unsolved challenges and
opportunities as it relates to (i) inadequate data sets, (ii)
human-understandable solutions for modelling physical phenomena, (iii) Big
Data, (iv) non-traditional heterogeneous data sources, (v) DL architectures and
learning algorithms for spectral, spatial and temporal data, (vi) transfer
learning, (vii) an improved theoretical understanding of DL systems, (viii)
high barriers to entry, and (ix) training and optimizing the DL.Comment: 64 pages, 411 references. To appear in Journal of Applied Remote
Sensin
Kernel-Based Framework for Multitemporal and Multisource Remote Sensing Data Classification and Change Detection
The multitemporal classification of remote sensing images is a challenging problem, in which the efficient combination of different sources of information (e.g., temporal, contextual, or multisensor) can improve the results. In this paper, we present a general framework based on kernel methods for the integration of heterogeneous sources of information. Using the theoretical principles in this framework, three main contributions are presented. First, a novel family of kernel-based methods for multitemporal classification of remote sensing images is presented. The second contribution is the development of nonlinear kernel classifiers for the well-known difference and ratioing change detection methods by formulating them in an adequate high-dimensional feature space. Finally, the presented methodology allows the integration of contextual information and multisensor images with different levels of nonlinear sophistication. The binary support vector (SV) classifier and the one-class SV domain description classifier are evaluated by using both linear and nonlinear kernel functions. Good performance on synthetic and real multitemporal classification scenarios illustrates the generalization of the framework and the capabilities of the proposed algorithms.Publicad
Remote sensing image fusion on 3D scenarios: A review of applications for agriculture and forestry
Three-dimensional (3D) image mapping of real-world scenarios has a great potential to provide the user with a
more accurate scene understanding. This will enable, among others, unsupervised automatic sampling of
meaningful material classes from the target area for adaptive semi-supervised deep learning techniques. This
path is already being taken by the recent and fast-developing research in computational fields, however, some
issues related to computationally expensive processes in the integration of multi-source sensing data remain.
Recent studies focused on Earth observation and characterization are enhanced by the proliferation of Unmanned
Aerial Vehicles (UAV) and sensors able to capture massive datasets with a high spatial resolution. In this scope,
many approaches have been presented for 3D modeling, remote sensing, image processing and mapping, and
multi-source data fusion. This survey aims to present a summary of previous work according to the most relevant
contributions for the reconstruction and analysis of 3D models of real scenarios using multispectral, thermal and
hyperspectral imagery. Surveyed applications are focused on agriculture and forestry since these fields
concentrate most applications and are widely studied. Many challenges are currently being overcome by recent
methods based on the reconstruction of multi-sensorial 3D scenarios. In parallel, the processing of large image
datasets has recently been accelerated by General-Purpose Graphics Processing Unit (GPGPU) approaches that
are also summarized in this work. Finally, as a conclusion, some open issues and future research directions are
presented.European Commission 1381202-GEU
PYC20-RE-005-UJA
IEG-2021Junta de Andalucia 1381202-GEU
PYC20-RE-005-UJA
IEG-2021Instituto de Estudios GiennesesEuropean CommissionSpanish Government UIDB/04033/2020DATI-Digital Agriculture TechnologiesPortuguese Foundation for Science and Technology 1381202-GEU
FPU19/0010
Cloud removal from optical remote sensing images
Optical remote sensing images used for Earth surface observations are constantly contaminated by cloud cover. Clouds dynamically affect the applications of optical data and increase the difficulty of image analysis. Therefore, cloud is considered as one of the sources of noise in optical image data, and its detection and removal need to be operated as a pre-processing step in most remote sensing image processing applications. This thesis investigates the current cloud detection and removal algorithms and develops three new cloud removal methods to improve the accuracy of the results.
A thin cloud removal method based on signal transmission principles and spectral mixture analysis (ST-SMA) for pixel correction is developed in the first contribution. This method considers not only the additive reflectance from the clouds but also the energy absorption when solar radiation passes through them. Data correction is achieved by subtracting the product of the cloud endmember signature and the cloud abundance and rescaling according to the cloud thickness. The proposed method has no requirement for meteorological data and does not rely on reference images. The experimental results indicate that the proposed approach is able to perform effective removal of thin clouds in different scenarios.
In the second study, an effective cloud removal method is proposed by taking advantage of the noise-adjusted principal components transform (CR-NAPCT). It is found that the signal-to-noise ratio (S/N) of cloud data is higher than data without cloud contamination, when spatial correlation is considered and are shown in the first NAPCT component (NAPC1) in the NAPCT data. An inverse transformation with a modified first component is then applied to generate the cloud free image. The effectiveness of the proposed method is assessed by performing experiments on simulated and real data to compare the quantitative and qualitative performance of the proposed approach.
The third study of this thesis deals with both cloud and cloud shadow problems with the aid of an auxiliary image in a clear sky condition. A new cloud removal approach called multitemporal dictionary learning (MDL) is proposed. Dictionaries of the cloudy areas (target data) and the cloud free areas (reference data) are learned separately in the spectral domain. An online dictionary learning method is then applied to obtain the two dictionaries in this method. The removal process is conducted by using the coefficients from the reference image and the dictionary learned from the target image. This method is able to recover the data contaminated by thin and thick clouds or cloud shadows. The experimental results show that the MDL method is effective from both quantitative and qualitative viewpoints
- …