861 research outputs found
Innovative techniques for the hydraulic and hydrological variables assessment
This Thesis focues on two main research topics: (1) the use of innovative techniques for the evaluation of main hydraulic variables of natural rivers (e.g. river bathymetry, discharge, water level) and (2) the monitoring and hydrological modelling of Monate Lake (Varese, Italy)
Remote Sensing for Precision Agriculture: Sentinel-2 Improved Features and Applications
The use of satellites to monitor crops and support their management is gathering increasing attention. The improved temporal, spatial, and spectral resolution of the European Space Agency (ESA) launched Sentinel-2 A + B twin platform is paving the way to their popularization in precision agriculture. Besides the Sentinel-2 A + B constellation technical features the open-access nature of the information they generate, and the available support software are a significant improvement for agricultural monitoring. This paper was motivated by the challenges faced by researchers and agrarian institutions entering this field; it aims to frame remote sensing principles and Sentinel-2 applications in agriculture. Thus, we reviewed the features and uses of Sentinel-2 in precision agriculture, including abiotic and biotic stress detection, and agricultural management. We also compared the panoply of satellites currently in use for land remote sensing that are relevant for agriculture to the Sentinel-2 A + B constellation features. Contrasted with previous satellite image systems, the Sentinel-2 A + B twin platform has dramatically increased the capabilities for agricultural monitoring and crop management worldwide. Regarding crop stress monitoring, Sentinel-2 capacities for abiotic and biotic stresses detection represent a great step forward in many ways though not without its limitations; therefore, combinations of field data and different remote sensing techniques may still be needed. We conclude that Sentinel-2 has a wide range of useful applications in agriculture, yet still with room for further improvements. Current and future ways that Sentinel-2 can be utilized are also discussed.This research was funded by the Spanish projects AGL2016-76527-R and IRUEC PCIN-2017-063 from the Ministerio de EconomÃa y Competividad (MINECO, Spain) and by the support of Catalan Institution for Research and Advanced Studies (ICREA, Generalitat de Catalunya, Spain), through the ICREA Academia Program
Remote Sensing for Precision Agriculture: Sentinel-2 Improved Features and Applications
The use of satellites to monitor crops and support their management is gathering increasing attention. The improved temporal, spatial, and spectral resolution of the European Space Agency (ESA) launched Sentinel-2 A + B twin platform is paving the way to their popularization in precision agriculture. Besides the Sentinel-2 A + B constellation technical features the open-access nature of the information they generate, and the available support software are a significant improvement for agricultural monitoring. This paper was motivated by the challenges faced by researchers and agrarian institutions entering this field; it aims to frame remote sensing principles and Sentinel-2 applications in agriculture. Thus, we reviewed the features and uses of Sentinel-2 in precision agriculture, including abiotic and biotic stress detection, and agricultural management. We also compared the panoply of satellites currently in use for land remote sensing that are relevant for agriculture to the Sentinel-2 A + B constellation features. Contrasted with previous satellite image systems, the Sentinel-2 A + B twin platform has dramatically increased the capabilities for agricultural monitoring and crop management worldwide. Regarding crop stress monitoring, Sentinel-2 capacities for abiotic and biotic stresses detection represent a great step forward in many ways though not without its limitations; therefore, combinations of field data and different remote sensing techniques may still be needed. We conclude that Sentinel-2 has a wide range of useful applications in agriculture, yet still with room for further improvements. Current and future ways that Sentinel-2 can be utilized are also discusse
(Dynamic) Prompting might be all you need to repair Compressed LLMs
Large language models (LLMs), while transformative for NLP, come with
significant computational demands, underlining the need for efficient,
training-free compression. Notably, despite the marked improvement in
training-free compression for the largest of LLMs, our tests using LLaMA-7B and
OPT-6.7b highlight a significant performance drop in several realistic
downstream tasks. Investigation into the trade-off between resource-intensive
post-compression re-training highlights the prospect of prompt-driven recovery
as a lightweight adaption tool. However, existing studies, confined mainly to
perplexity evaluations and simple tasks, fail to offer unequivocal confidence
in the scalability and generalizability of prompting. We tackle this
uncertainty in two key ways. First, we uncover the vulnerability of naive
prompts in LLM compression as an over-reliance on a singular prompt per input.
In response, we propose inference-time dynamic prompting (IDP), a mechanism
that autonomously chooses from a set of curated prompts based on the context of
each individual input. Second, we delve into a scientific understanding of why
"prompting might be all you need post-LLM compression." Our findings suggest
that compression does not irretrievably erase LLM model knowledge but displace
it, necessitating a new inference path. IDP effectively redirects this path,
enabling the model to tap into its inherent yet displaced knowledge and thereby
recover performance. Empirical tests affirm the value of IDP, demonstrating an
average performance improvement of 1.24% across nine varied tasks spanning
multiple knowledge domains
The need for data integration to address the challenges of climate change on the Guyana coast
Guyana's capacity to address the impacts of climate change on its coastal environment requires the ability to monitor, quantify and understand coastal change over short-, medium- and long- term. Understanding the drivers of change in coastal and marine environment can be achieved through the accurate measurement and critical analyses of morphologies, flows, processes and responses. This manuscript presents a strategy developed to create a central resource, database and web-based platform to integrate data and information on the drivers and the changes within Guyana coastal and marine environment. The strategy involves four complimentary work packages including data collection, development of a platform for data integration, application of the data for coastal change analyses and consultation with stakeholders. The last aims to assess the role of the integrated data systems to support strategic governance and sustainable decision-making. It is hoped that the output of this strategy would support the country's climate-focused agencies, organisations, decision-makers, and researchers in their tasks and endeavours
Copernicus Cal/Val Solution - D3.1 Recommendations for R&D activities on Instrumentation Technologies
The Document identifies the gaps in instrumentation technologies for pre-flight characterisation, onboard calibration and Fiducial Reference Measurements (FRM) used for calibration and validation
(Cal/Val) activities for the current Copernicus missions. It also addresses the measurement needs for
future Copernicus missions and gives a prioritised list of recommendations for R&D activities on
instrumentation technologies.
Four types of missions are covered based on the division used in the rest of the CCVS project: optical,
altimetry, radar and microwave and atmospheric composition.
It also gives an overview of some promising instrumentation technologies in each measurement field
for FRM that could fill the gaps for requirements not yet met for the current and future Copernicus
missions and identifies the research and development (R&D) activities needed to mature these
example technologies. The Document does not provide an exhaustive list of all the new technologies
being developed but will give a few examples for each field to show what efforts are being made to fill
the gaps. None of the examples is promoted as the best possible solutions. The selection is based on
the authors' knowledge during the preparation of the Document.
The information included is mainly collected from the deliverables of work packages 1 and 2 in the
CCVS project. The new technologies are primarily from the interviews with various measurement
networks and campaigns carried out in tasks 2.4 and 2.5. Reference documents can be found in section
1.3
Exploitation of satellite A-DInSAR time series for detection, characterization and modelling of land subsidence
In the last two decades, advanced differential interferometric synthetic aperture radar (A-DInSAR) techniques have experienced significant developments, which are mainly related to (i) the progress of satellite SAR data acquired by new missions, such as COSMO-SkyMed and ESA’s Sentinel-1 constellations; and (ii) the development of novel processing algorithms. The improvements in A-DInSAR ground deformation time series need appropriate methodologies to analyse extremely large datasets which consist of huge amounts of measuring points and associated deformation histories with high temporal resolution. This work demonstrates A-DInSAR time series exploitation as valuable tool to support different problems in engineering geology such as detection, characterization and modelling of land subsidence mechanisms. The capabilities and suitability of A-DInSAR time series from an end-user point of view are presented and discussed through the analysis carried out for three test sites in Europe: the Oltrepo Pavese (Po Plain in Italy), the Alto GuadalentÃn (Spain) and the London Basin (United Kingdom). Principal component analysis has been performed for the datasets available for the three case histories, in order to extract the great potential contained in the A-DInSAR time serie
An uncertainty prediction approach for active learning - application to earth observation
Mapping land cover and land usage dynamics are crucial in remote sensing since farmers
are encouraged to either intensify or extend crop use due to the ongoing rise in the world’s
population. A major issue in this area is interpreting and classifying a scene captured in
high-resolution satellite imagery. Several methods have been put forth, including neural
networks which generate data-dependent models (i.e. model is biased toward data) and
static rule-based approaches with thresholds which are limited in terms of diversity(i.e.
model lacks diversity in terms of rules). However, the problem of having a machine learning
model that, given a large amount of training data, can classify multiple classes over different
geographic Sentinel-2 imagery that out scales existing approaches remains open.
On the other hand, supervised machine learning has evolved into an essential part of many
areas due to the increasing number of labeled datasets. Examples include creating classifiers
for applications that recognize images and voices, anticipate traffic, propose products, act
as a virtual personal assistant and detect online fraud, among many more. Since these
classifiers are highly dependent from the training datasets, without human interaction or
accurate labels, the performance of these generated classifiers with unseen observations
is uncertain. Thus, researchers attempted to evaluate a number of independent models
using a statistical distance. However, the problem of, given a train-test split and classifiers
modeled over the train set, identifying a prediction error using the relation between train
and test sets remains open.
Moreover, while some training data is essential for supervised machine learning, what
happens if there is insufficient labeled data? After all, assigning labels to unlabeled datasets
is a time-consuming process that may need significant expert human involvement. When
there aren’t enough expert manual labels accessible for the vast amount of openly available
data, active learning becomes crucial. However, given a large amount of training and
unlabeled datasets, having an active learning model that can reduce the training cost of
the classifier and at the same time assist in labeling new data points remains an open
problem.
From the experimental approaches and findings, the main research contributions, which
concentrate on the issue of optical satellite image scene classification include: building
labeled Sentinel-2 datasets with surface reflectance values; proposal of machine learning
models for pixel-based image scene classification; proposal of a statistical distance based
Evidence Function Model (EFM) to detect ML models misclassification; and proposal of
a generalised sampling approach for active learning that, together with the EFM enables
a way of determining the most informative examples.
Firstly, using a manually annotated Sentinel-2 dataset, Machine Learning (ML) models
for scene classification were developed and their performance was compared to Sen2Cor the reference package from the European Space Agency – a micro-F1 value of 84%
was attained by the ML model, which is a significant improvement over the corresponding
Sen2Cor performance of 59%. Secondly, to quantify the misclassification of the ML models,
the Mahalanobis distance-based EFM was devised. This model achieved, for the labeled
Sentinel-2 dataset, a micro-F1 of 67.89% for misclassification detection. Lastly, EFM was
engineered as a sampling strategy for active learning leading to an approach that attains
the same level of accuracy with only 0.02% of the total training samples when compared
to a classifier trained with the full training set.
With the help of the above-mentioned research contributions, we were able to provide
an open-source Sentinel-2 image scene classification package which consists of ready-touse
Python scripts and a ML model that classifies Sentinel-2 L1C images generating a
20m-resolution RGB image with the six studied classes (Cloud, Cirrus, Shadow, Snow,
Water, and Other) giving academics a straightforward method for rapidly and effectively
classifying Sentinel-2 scene images. Additionally, an active learning approach that uses, as
sampling strategy, the observed prediction uncertainty given by EFM, will allow labeling
only the most informative points to be used as input to build classifiers; Sumário:
Uma Abordagem de Previsão de Incerteza para
Aprendizagem Ativa – Aplicação à Observação da Terra
O mapeamento da cobertura do solo e a dinâmica da utilização do solo são cruciais na
deteção remota uma vez que os agricultores são incentivados a intensificar ou estender as
culturas devido ao aumento contÃnuo da população mundial. Uma questão importante
nesta área é interpretar e classificar cenas capturadas em imagens de satélite de alta resolução.
Várias aproximações têm sido propostas incluindo a utilização de redes neuronais
que produzem modelos dependentes dos dados (ou seja, o modelo é tendencioso em relação
aos dados) e aproximações baseadas em regras que apresentam restrições de diversidade
(ou seja, o modelo carece de diversidade em termos de regras). No entanto, a criação de
um modelo de aprendizagem automática que, dada uma uma grande quantidade de dados
de treino, é capaz de classificar, com desempenho superior, as imagens do Sentinel-2 em
diferentes áreas geográficas permanece um problema em aberto.
Por outro lado, têm sido utilizadas técnicas de aprendizagem supervisionada na resolução
de problemas nas mais diversas áreas de devido à proliferação de conjuntos de dados etiquetados.
Exemplos disto incluem classificadores para aplicações que reconhecem imagem
e voz, antecipam tráfego, propõem produtos, atuam como assistentes pessoais virtuais e
detetam fraudes online, entre muitos outros. Uma vez que estes classificadores são fortemente
dependente do conjunto de dados de treino, sem interação humana ou etiquetas
precisas, o seu desempenho sobre novos dados é incerta. Neste sentido existem propostas
para avaliar modelos independentes usando uma distância estatÃstica. No entanto, o problema
de, dada uma divisão de treino-teste e um classificador, identificar o erro de previsão
usando a relação entre aqueles conjuntos, permanece aberto.
Mais ainda, embora alguns dados de treino sejam essenciais para a aprendizagem supervisionada,
o que acontece quando a quantidade de dados etiquetados é insuficiente? Afinal,
atribuir etiquetas é um processo demorado e que exige perÃcia, o que se traduz num envolvimento
humano significativo. Quando a quantidade de dados etiquetados manualmente por
peritos é insuficiente a aprendizagem ativa torna-se crucial. No entanto, dada uma grande
quantidade dados de treino não etiquetados, ter um modelo de aprendizagem ativa que
reduz o custo de treino do classificador e, ao mesmo tempo, auxilia a etiquetagem de novas
observações permanece um problema em aberto.
A partir das abordagens e estudos experimentais, as principais contribuições deste trabalho,
que se concentra na classificação de cenas de imagens de satélite óptico incluem:
criação de conjuntos de dados Sentinel-2 etiquetados, com valores de refletância de superfÃcie;
proposta de modelos de aprendizagem automática baseados em pixels para classificação de cenas de imagens de satétite; proposta de um Modelo de Função de Evidência (EFM)
baseado numa distância estatÃstica para detetar erros de classificação de modelos de aprendizagem;
e proposta de uma abordagem de amostragem generalizada para aprendizagem
ativa que, em conjunto com o EFM, possibilita uma forma de determinar os exemplos mais
informativos.
Em primeiro lugar, usando um conjunto de dados Sentinel-2 etiquetado manualmente,
foram desenvolvidos modelos de Aprendizagem Automática (AA) para classificação de cenas
e seu desempenho foi comparado com o do Sen2Cor – o produto de referência da
Agência Espacial Europeia – tendo sido alcançado um valor de micro-F1 de 84% pelo classificador,
o que representa uma melhoria significativa em relação ao desempenho Sen2Cor
correspondente, de 59%. Em segundo lugar, para quantificar o erro de classificação dos
modelos de AA, foi concebido o Modelo de Função de Evidência baseado na distância de
Mahalanobis. Este modelo conseguiu, para o conjunto de dados etiquetado do Sentinel-2
um micro-F1 de 67,89% na deteção de classificação incorreta. Por fim, o EFM foi utilizado
como uma estratégia de amostragem para a aprendizagem ativa, uma abordagem
que permitiu atingir o mesmo nÃvel de desempenho com apenas 0,02% do total de exemplos
de treino quando comparado com um classificador treinado com o conjunto de treino
completo.
Com a ajuda das contribuições acima mencionadas, foi possÃvel desenvolver um pacote
de código aberto para classificação de cenas de imagens Sentinel-2 que, utilizando num
conjunto de scripts Python, um modelo de classificação, e uma imagem Sentinel-2 L1C,
gera a imagem RGB correspondente (com resolução de 20m) com as seis classes estudadas
(Cloud, Cirrus, Shadow, Snow, Water e Other), disponibilizando à academia um método
direto para a classificação de cenas de imagens do Sentinel-2 rápida e eficaz. Além disso, a
abordagem de aprendizagem ativa que usa, como estratégia de amostragem, a deteção de
classificacão incorreta dada pelo EFM, permite etiquetar apenas os pontos mais informativos
a serem usados como entrada na construção de classificadores
- …