11 research outputs found
Adaptive mitigation of the Air-Time pressure in LoRa multi-gateway architectures
LoRa is a promising technology in the current Internet of Things market,
which operates in un-licensed bands achieving long-range communications and
with ultra power devices. In this work we capitalize on the idea introduced in
[1], i.e. balance the Air-Time of the different modulation spreading factors
(SF), and adapt it to operate in a typical metropolitan scenario comprising
multiple gateways (GWs) interconnected to a same network server. Our proposed
approach, named ADaptive Mitigation of the AIr-time pressure in lORa (AD
MAIORA), relies on a suitable measure of the per-spreading-factor load at each
GW - quantified by means of a so-called pressure table -, and on a relevant
heuristic algorithm which attempts to balance such a per-SF-pressure.
Especially in cases of very loaded scenarios, where a high number of nodes
insist on the same GWs, the use of AD MAIORA shows significant performance
gains, up to a factor of 5 improvements with respect to the legacy LoRaWAN's
Adaptive Data Rate
Multimodal Garment Designer: Human-Centric Latent Diffusion Models for Fashion Image Editing
Fashion illustration is used by designers to communicate their vision and to
bring the design idea from conceptualization to realization, showing how
clothes interact with the human body. In this context, computer vision can thus
be used to improve the fashion design process. Differently from previous works
that mainly focused on the virtual try-on of garments, we propose the task of
multimodal-conditioned fashion image editing, guiding the generation of
human-centric fashion images by following multimodal prompts, such as text,
human body poses, and garment sketches. We tackle this problem by proposing a
new architecture based on latent diffusion models, an approach that has not
been used before in the fashion domain. Given the lack of existing datasets
suitable for the task, we also extend two existing fashion datasets, namely
Dress Code and VITON-HD, with multimodal annotations collected in a
semi-automatic manner. Experimental results on these new datasets demonstrate
the effectiveness of our proposal, both in terms of realism and coherence with
the given multimodal inputs. Source code and collected multimodal annotations
will be publicly released at:
https://github.com/aimagelab/multimodal-garment-designer
OpenFashionCLIP: Vision-and-Language Contrastive Learning with Open-Source Fashion Data
The inexorable growth of online shopping and e-commerce demands scalable and
robust machine learning-based solutions to accommodate customer requirements.
In the context of automatic tagging classification and multimodal retrieval,
prior works either defined a low generalizable supervised learning approach or
more reusable CLIP-based techniques while, however, training on closed source
data. In this work, we propose OpenFashionCLIP, a vision-and-language
contrastive learning method that only adopts open-source fashion data stemming
from diverse domains, and characterized by varying degrees of specificity. Our
approach is extensively validated across several tasks and benchmarks, and
experimental results highlight a significant out-of-domain generalization
capability and consistent improvements over state-of-the-art methods both in
terms of accuracy and recall. Source code and trained models are publicly
available at: https://github.com/aimagelab/open-fashion-clip.Comment: International Conference on Image Analysis and Processing (ICIAP)
202
OpenFashionCLIP: Vision-and-Language Contrastive Learning with Open-Source Fashion Data
The inexorable growth of online shopping and e-commerce demands scalable and robust machine learning-based solutions to accommodate customer requirements. In the context of automatic tagging classification and multimodal retrieval, prior works either defined a low generalizable supervised learning approach or more reusable CLIP-based techniques while, however, training on closed source data. In this work, we propose OpenFashionCLIP, a vision-and-language contrastive learning method that only adopts open-source fashion data stemming from diverse domains, and characterized by varying degrees of specificity. Our approach is extensively validated across several tasks and benchmarks, and experimental results highlight a significant out-of-domain generalization capability and consistent improvements over state-of-the-art methods both in terms of accuracy and recall. Source code and trained models are publicly available at: https://github.com/aimagelab/open-fashion-clip
LaDI-VTON: Latent Diffusion Textual-Inversion Enhanced Virtual Try-On
The rapidly evolving fields of e-commerce and metaverse continue to seek
innovative approaches to enhance the consumer experience. At the same time,
recent advancements in the development of diffusion models have enabled
generative networks to create remarkably realistic images. In this context,
image-based virtual try-on, which consists in generating a novel image of a
target model wearing a given in-shop garment, has yet to capitalize on the
potential of these powerful generative solutions. This work introduces
LaDI-VTON, the first Latent Diffusion textual Inversion-enhanced model for the
Virtual Try-ON task. The proposed architecture relies on a latent diffusion
model extended with a novel additional autoencoder module that exploits
learnable skip connections to enhance the generation process preserving the
model's characteristics. To effectively maintain the texture and details of the
in-shop garment, we propose a textual inversion component that can map the
visual features of the garment to the CLIP token embedding space and thus
generate a set of pseudo-word token embeddings capable of conditioning the
generation process. Experimental results on Dress Code and VITON-HD datasets
demonstrate that our approach outperforms the competitors by a consistent
margin, achieving a significant milestone for the task. Source code and trained
models will be publicly released at: https://github.com/miccunifi/ladi-vton
LaDI-VTON: Latent Diffusion Textual-Inversion Enhanced Virtual Try-On
The rapidly evolving fields of e-commerce and metaverse continue to seek innovative approaches to enhance the consumer experience. At the same time, recent advancements in the development of diffusion models have enabled generative networks to create remarkably realistic images. In this context, image-based virtual try-on, which consists in generating a novel image of a target model wearing a given in-shop garment, has yet to capitalize on the potential of these powerful generative solutions. This work introduces LaDI-VTON, the first Latent Diffusion textual Inversion-enhanced model for the Virtual Try-ON task. The proposed architecture relies on a latent diffusion model extended with a novel additional autoencoder module that exploits learnable skip connections to enhance the generation process preserving the model's characteristics. To effectively maintain the texture and details of the in-shop garment, we propose a textual inversion component that can map the visual features of the garment to the CLIP token embedding space and thus generate a set of pseudo-word token embeddings capable of conditioning the generation process. Experimental results on Dress Code and VITON-HD datasets demonstrate that our approach outperforms the competitors by a consistent margin, achieving a significant milestone for the task
Multimodal Garment Designer: Human-Centric Latent Diffusion Models for Fashion Image Editing
Adaptive mitigation of the air-time pressure in LoRa multi-gateway architectures
LoRa is a promising technology in the current Internet of Things market, which operates in un-licensed bands achieving long-range communications and with ultra power devices. In this work we capitalize on the idea introduced in [1], i.e. balance the Air-Time of the different modulation spreading factors (SF), and adapt it to operate in a typical metropolitan scenario comprising multiple gateways (GWs) interconnected to a same network server. Our proposed approach, named ADaptive Mitigation of the AIr-time pressure in lORa (AD MAIORA), relies on a suitable measure of the per-spreading-factor load at each GW - quantified by means of a so-called pressure table -, and on a relevant heuristic algorithm which attempts to balance such a per-SF-pressure. Especially in cases of very loaded scenarios, where a high number of nodes insist on the same GWs, the use of AD MAIORA shows significant performance gains, up to a factor of 5 improvements with respect to the legacy LoRaWAN's Adaptive Data Rate
Subthalamic nucleus deep brain stimulation and impulsivity in Parkinson's disease: a descriptive review
: Standard treatment of Parkinson's disease involves the dopaminergic medications. Deep brain stimulation of the subthalamic nucleus (STN-DBS) is an important neurosurgical intervention often used as alternative treatment to drug therapy; however, it can be associated with increase of impulsive behaviors. This descriptive review focused on studies investigating the correlation between Deep brain stimulation of the subthalamic nucleus and impulsivity in Parkinson's disease patients, arguing, the action's mechanism and the specific role of the subthalamic nucleus. We searched on PubMed and Web of Science databases and screening references of included studies and review articles for additional citations. From initial 106 studies, only 15 met the search criteria. Parkinson's Disease patients with and without Deep Brain Stimulation were compared with healthy controls, through 16 different tasks that assessed some aspects of impulsivity. Both Deep brain stimulation of the subthalamic nucleus and medication were associated with impulsive behavior and influenced decision-making processes. Moreover, findings demonstrated that: Impulse Control Disorders (ICDs) occurred soon after surgery, while, in pharmacological treatment, they appeared mainly after the initiation of treatment or the increase in dosage, especially with dopamine agonists. The subthalamic nucleus plays a part in the fronto-striato-thalamic-cortical loops mediating motor, cognitive, and emotional functions: this could explain the role of the Deep Brain Stimulation in behavior modulation in Parkinson's Disease patients. Indeed, increase impulsivity has been reported also after deep brain stimulation of the subthalamic nucleus independently by dopaminergic medication status