269 research outputs found
Recommended from our members
Interpretable Machine Learning Architectures for Efficient Signal Detection with Applications to Gravitational Wave Astronomy
Deep learning has seen rapid evolution in the past decade, accomplishing tasks that were previously unimaginable. At the same time, researchers strive to better understand and interpret the underlying mechanisms of the deep models, which are often justifiably regarded as "black boxes". Overcoming this deficiency will not only serve to suggest better learning architectures and training methods, but also extend deep learning to scenarios where interpretability is key to the application. One such scenario is signal detection and estimation, with gravitational wave detection as a specific example, where classic methods are often preferred for their interpretability. Nonetheless, while classic statistical detection methods such as matched filtering excel in their simplicity and intuitiveness, they can be suboptimal in terms of both accuracy and computational efficiency. Therefore, it is appealing to have methods that achieve ``the best of both worlds'', namely enjoying simultaneously excellent performance and interpretability.
In this thesis, we aim to bridge this gap between modern deep learning and classic statistical detection, by revisiting the signal detection problem from a new perspective. First, to address the perceived distinction in interpretability between classic matched filtering and deep learning, we state the intrinsic connections between the two families of methods, and identify how trainable networks can address the structural limitations of matched filtering. Based on these ideas, we propose two trainable architectures that are constructed based on matched filtering, but with learnable templates and adaptivity to unknown noise distributions, and therefore higher detection accuracy. We next turn our attention toward improving the computational efficiency of detection, where we aim to design architectures that leverage structures within the problem for efficiency gains. By leveraging the statistical structure of class imbalance, we integrate hierarchical detection into trainable networks, and use a novel loss function which explicitly encodes both detection accuracy and efficiency. Furthermore, by leveraging the geometric structure of the signal set, we consider using signal space optimization as an alternative computational primitive for detection, which is intuitively more efficient than covering with a template bank. We theoretical prove the efficiency gain by analyzing Riemannian gradient descent on the signal manifold, which reveals an exponential improvement in efficiency over matched filtering. We also propose a practical trainable architecture for template optimization, which makes use of signal embedding and kernel interpolation.
We demonstrate the performance of all proposed architectures on the task of gravitational wave detection in astrophysics, where matched filtering is the current method of choice. The architectures are also widely applicable to general signal or pattern detection tasks, which we exemplify with the handwritten digit recognition task using the template optimization architecture. Together, we hope the this work useful to scientists and engineers seeking machine learning architectures with high performance and interpretability, and contribute to our understanding of deep learning as a whole
La traduzione specializzata all’opera per una piccola impresa in espansione: la mia esperienza di internazionalizzazione in cinese di Bioretics© S.r.l.
Global markets are currently immersed in two all-encompassing and unstoppable processes: internationalization and globalization. While the former pushes companies to look beyond the borders of their country of origin to forge relationships with foreign trading partners, the latter fosters the standardization in all countries, by reducing spatiotemporal distances and breaking down geographical, political, economic and socio-cultural barriers. In recent decades, another domain has appeared to propel these unifying drives: Artificial Intelligence, together with its high technologies aiming to implement human cognitive abilities in machinery. The “Language Toolkit – Le lingue straniere al servizio dell’internazionalizzazione dell’impresa” project, promoted by the Department of Interpreting and Translation (Forlì Campus) in collaboration with the Romagna Chamber of Commerce (Forlì-Cesena and Rimini), seeks to help Italian SMEs make their way into the global market. It is precisely within this project that this dissertation has been conceived. Indeed, its purpose is to present the translation and localization project from English into Chinese of a series of texts produced by Bioretics© S.r.l.: an investor deck, the company website and part of the installation and use manual of the Aliquis© framework software, its flagship product. This dissertation is structured as follows: Chapter 1 presents the project and the company in detail; Chapter 2 outlines the internationalization and globalization processes and the Artificial Intelligence market both in Italy and in China; Chapter 3 provides the theoretical foundations for every aspect related to Specialized Translation, including website localization; Chapter 4 describes the resources and tools used to perform the translations; Chapter 5 proposes an analysis of the source texts; Chapter 6 is a commentary on translation strategies and choices
Synthetic Aperture Radar (SAR) Meets Deep Learning
This reprint focuses on the application of the combination of synthetic aperture radars and depth learning technology. It aims to further promote the development of SAR image intelligent interpretation technology. A synthetic aperture radar (SAR) is an important active microwave imaging sensor, whose all-day and all-weather working capacity give it an important place in the remote sensing community. Since the United States launched the first SAR satellite, SAR has received much attention in the remote sensing community, e.g., in geological exploration, topographic mapping, disaster forecast, and traffic monitoring. It is valuable and meaningful, therefore, to study SAR-based remote sensing applications. In recent years, deep learning represented by convolution neural networks has promoted significant progress in the computer vision community, e.g., in face recognition, the driverless field and Internet of things (IoT). Deep learning can enable computational models with multiple processing layers to learn data representations with multiple-level abstractions. This can greatly improve the performance of various applications. This reprint provides a platform for researchers to handle the above significant challenges and present their innovative and cutting-edge research results when applying deep learning to SAR in various manuscript types, e.g., articles, letters, reviews and technical reports
A Multi-scale Generalized Shrinkage Threshold Network for Image Blind Deblurring in Remote Sensing
Remote sensing images are essential for many earth science applications, but
their quality can be degraded due to limitations in sensor technology and
complex imaging environments. To address this, various remote sensing image
deblurring methods have been developed to restore sharp, high-quality images
from degraded observational data. However, most traditional model-based
deblurring methods usually require predefined hand-craft prior assumptions,
which are difficult to handle in complex applications, and most deep
learning-based deblurring methods are designed as a black box, lacking
transparency and interpretability. In this work, we propose a novel blind
deblurring learning framework based on alternating iterations of shrinkage
thresholds, alternately updating blurring kernels and images, with the
theoretical foundation of network design. Additionally, we propose a learnable
blur kernel proximal mapping module to improve the blur kernel evaluation in
the kernel domain. Then, we proposed a deep proximal mapping module in the
image domain, which combines a generalized shrinkage threshold operator and a
multi-scale prior feature extraction block. This module also introduces an
attention mechanism to adaptively adjust the prior importance, thus avoiding
the drawbacks of hand-crafted image prior terms. Thus, a novel multi-scale
generalized shrinkage threshold network (MGSTNet) is designed to specifically
focus on learning deep geometric prior features to enhance image restoration.
Experiments demonstrate the superiority of our MGSTNet framework on remote
sensing image datasets compared to existing deblurring methods.Comment: 12 pages
Hyperspectral Image Super-Resolution via Dual-domain Network Based on Hybrid Convolution
Since the number of incident energies is limited, it is difficult to directly
acquire hyperspectral images (HSI) with high spatial resolution. Considering
the high dimensionality and correlation of HSI, super-resolution (SR) of HSI
remains a challenge in the absence of auxiliary high-resolution images.
Furthermore, it is very important to extract the spatial features effectively
and make full use of the spectral information. This paper proposes a novel HSI
super-resolution algorithm, termed dual-domain network based on hybrid
convolution (SRDNet). Specifically, a dual-domain network is designed to fully
exploit the spatial-spectral and frequency information among the hyper-spectral
data. To capture inter-spectral self-similarity, a self-attention learning
mechanism (HSL) is devised in the spatial domain. Meanwhile the pyramid
structure is applied to increase the acceptance field of attention, which
further reinforces the feature representation ability of the network. Moreover,
to further improve the perceptual quality of HSI, a frequency loss(HFL) is
introduced to optimize the model in the frequency domain. The dynamic weighting
mechanism drives the network to gradually refine the generated frequency and
excessive smoothing caused by spatial loss. Finally, In order to better fully
obtain the mapping relationship between high-resolution space and
low-resolution space, a hybrid module of 2D and 3D units with progressive
upsampling strategy is utilized in our method. Experiments on a widely used
benchmark dataset illustrate that the proposed SRDNet method enhances the
texture information of HSI and is superior to state-of-the-art methods
CERNAS: Current Evolution and Research Novelty in Agricultural Sustainability
Climate changes pose overwhelming impacts on primary production and, consequently, on
agricultural and animal farming. Additionally, at present, agriculture still depends strongly on
fossil fuels both for energy and production factors ,such as synthetized inorganic fertilizers and
harmful chemicals such as pesticides. The need to feed the growing world population poses many
challenges. The need to reduce environmental impacts to a minimum, maintain healthy ecosystems,
and improve soil microbiota are central to ensuring a promising future for coming generations.
Livestock production under cover crop systems helps to alleviate compaction so that oxygen and
water can sufficiently flow in the soil, add organic matter, and help hold soil in place, reducing
crusting and protecting against erosion. The use of organic plant production practices allied to
the control of substances used in agriculture also decisively contributes to alleviating the pressure
on ecosystems. Some of the goals of this new decade are to use enhanced sustainable production
methodologies to improve the input/output ratios of primary production, reduce environmental
impacts, and rely on new innovative technologies.
This reprint addresses original studies and reviews focused on the current evolution and
research novelty in agricultural sustainability. New developments are discussed on issues related
to quality of soil, natural fertilizers, or the sustainable use of land and water. Also, crop protection
techniques are pivotal for sustainable food production under the challenges of the Sustainable
Development Goals of the United Nations, allied to innovative weed control methodologies as a
way to reduce the utilization of pesticides. The role of precision and smart agriculture is becoming
more pertinent as communication technologies improve at a rapid rate. Waste management, reuse of
agro-industrial residues, extension of shelf life, and use of new technologies are ways to reduce food
waste, all contributing to higher sustainability in food supply chains, leading to a more rational use
of natural resources. The unquestionable role of bees as pollinators and contributors to biodiversity
is adjacent to characterizing beekeeping activities, which in turn contributes, together with the
valorization of endemic varieties of plant foods, to the development of local communities. Finally,
the short circuits and local food markets have a decisive role in the preservation and enhancement of
rural economies.info:eu-repo/semantics/publishedVersio
Using Statistics, Computational Modelling and Artificial Intelligence Methods to Study and Strengthen the Link between Kinematic Impacts and mTBIs
Mild traumatic brain injuries (mTBIs) are frequently occurring, yet poorly understood, injuries in sports (e.g., ice hockey) and other physical recreation activities where head impacts occur. Helmets are essential pieces of equipment used to protect participants’ heads from mTBIs. Evaluating the performance of helmets to prevent mTBIs using simulations on anatomically accurate computational head finite element models is critically important for advancing the development of safer helmets. Advancing the level of detail in, and access to, such models, and their continued validation through state-of-the-art brain imaging methods and traditional head injury assessment procedures, is also essential to improve safety. The significant research contributions in this thesis involve evaluating the decrease in blunt impact-induced brain axon fiber tract strains that various helmets provide by studying outputs of existing finite element brain models and implementing open-source artificial intelligence technology to create a novel pipeline for predicting such strains
CERNAS – Current Evolution and Research Novelty in Agricultural Sustainability
This book addresses original studies and reviews focused on the current evolution and research novelty in agricultural sustainability.
New developments are discussed on issues related with quality of soil, natural fertilizers or the sustainable use of land and water. Also crop protection techniques are pivotal for the sustainable food production under the challenges of the Sustainable Development Goals of the United Nations, allied to innovative weed control methodologies, as a way to reduce the utilization of pesticides. The role of precision and smart agriculture is becoming more pertinent as the communication technologies improve at a high rate. Waste management, reuse of agro industrial residues, extension of shelf life and use of new technologies are ways to reduce food waste, all contributing to a higher sustainability of the food supply chains, leading to a more rational use of natural resources. The unquestionable role of bees as pollinators and contributors for biodiversity is subjacent to the work of characterization of beekeeping activities, which in turn contribute, together with the valorization of endemic varieties of plant foods, for the development of local communities. Finally, the short circuits and local food markets have a decisive role in the preservation and enhancement of rural economies.info:eu-repo/semantics/publishedVersio
Pixel Adaptive Deep Unfolding Transformer for Hyperspectral Image Reconstruction
Hyperspectral Image (HSI) reconstruction has made gratifying progress with
the deep unfolding framework by formulating the problem into a data module and
a prior module. Nevertheless, existing methods still face the problem of
insufficient matching with HSI data. The issues lie in three aspects: 1) fixed
gradient descent step in the data module while the degradation of HSI is
agnostic in the pixel-level. 2) inadequate prior module for 3D HSI cube. 3)
stage interaction ignoring the differences in features at different stages. To
address these issues, in this work, we propose a Pixel Adaptive Deep Unfolding
Transformer (PADUT) for HSI reconstruction. In the data module, a pixel
adaptive descent step is employed to focus on pixel-level agnostic degradation.
In the prior module, we introduce the Non-local Spectral Transformer (NST) to
emphasize the 3D characteristics of HSI for recovering. Moreover, inspired by
the diverse expression of features in different stages and depths, the stage
interaction is improved by the Fast Fourier Transform (FFT). Experimental
results on both simulated and real scenes exhibit the superior performance of
our method compared to state-of-the-art HSI reconstruction methods. The code is
released at: https://github.com/MyuLi/PADUT.Comment: ICCV 202
Semantic Communications for Wireless Sensing: RIS-aided Encoding and Self-supervised Decoding
Semantic communications can reduce the resource consumption by transmitting
task-related semantic information extracted from source messages. However, when
the source messages are utilized for various tasks, e.g., wireless sensing data
for localization and activities detection, semantic communication technique is
difficult to be implemented because of the increased processing complexity. In
this paper, we propose the inverse semantic communications as a new paradigm.
Instead of extracting semantic information from messages, we aim to encode the
task-related source messages into a hyper-source message for data transmission
or storage. Following this paradigm, we design an inverse semantic-aware
wireless sensing framework with three algorithms for data sampling,
reconfigurable intelligent surface (RIS)-aided encoding, and self-supervised
decoding, respectively. Specifically, on the one hand, we propose a novel RIS
hardware design for encoding several signal spectrums into one MetaSpectrum. To
select the task-related signal spectrums for achieving efficient encoding, a
semantic hash sampling method is introduced. On the other hand, we propose a
self-supervised learning method for decoding the MetaSpectrums to obtain the
original signal spectrums. Using the sensing data collected from real-world, we
show that our framework can reduce the data volume by 95% compared to that
before encoding, without affecting the accomplishment of sensing tasks.
Moreover, compared with the typically used uniform sampling scheme, the
proposed semantic hash sampling scheme can achieve 67% lower mean squared error
in recovering the sensing parameters. In addition, experiment results
demonstrate that the amplitude response matrix of the RIS enables the
encryption of the sensing data
- …