53 research outputs found
On the use of Vision-Language models for Visual Sentiment Analysis: a study on CLIP
This work presents a study on how to exploit the CLIP embedding space to
perform Visual Sentiment Analysis. We experiment with two architectures built
on top of the CLIP embedding space, which we denote by CLIP-E. We train the
CLIP-E models with WEBEmo, the largest publicly available and manually labeled
benchmark for Visual Sentiment Analysis, and perform two sets of experiments.
First, we test on WEBEmo and compare the CLIP-E architectures with
state-of-the-art (SOTA) models and with CLIP Zero-Shot. Second, we perform
cross dataset evaluation, and test the CLIP-E architectures trained with WEBEmo
on other Visual Sentiment Analysis benchmarks. Our results show that the CLIP-E
approaches outperform SOTA models in WEBEmo fine grained categorization, and
they also generalize better when tested on datasets that have not been seen
during training. Interestingly, we observed that for the FI dataset, CLIP
Zero-Shot produces better accuracies than SOTA models and CLIP-E trained on
WEBEmo. These results motivate several questions that we discuss in this paper,
such as how we should design new benchmarks and evaluate Visual Sentiment
Analysis, and whether we should keep designing tailored Deep Learning models
for Visual Sentiment Analysis or focus our efforts on better using the
knowledge encoded in large vision-language models such as CLIP for this task
Genetic data from the extinct giant rat from Tenerife (Canary Islands) points to a recent divergence from mainland relatives
Evolution of vertebrate endemics in oceanic islands follows a predictable pattern, known as the island rule, according to which gigantism arises in originally small-sized species and dwarfism in large ones. Species of extinct insular giant rodents are known from all over the world. In the Canary Islands, two examples of giant rats, †Canariomys bravoi and †Canariomys tamarani, endemic to Tenerife and Gran Canaria, respectively, disappeared soon after human settlement. The highly derived morphological features of these insular endemic rodents hamper the reconstruction of their evolutionary histories. We have retrieved partial nuclear and mitochondrial data from †C. bravoi and used this information to explore its evolutionary affinities. The resulting dated phylogeny confidently places †C. bravoi within the African grass rat clade (Arvicanthis niloticus). The estimated divergence time, 650 000 years ago (95% higher posterior densities: 373 000-944 000), points toward an island colonization during the Günz-Mindel interglacial stage. †Canariomys bravoi ancestors would have reached the island via passive rafting and then underwent a yearly increase of mean body mass calculated between 0.0015 g and 0.0023 g; this corresponds to fast evolutionary rates (in darwins (d), ranging from 7.09 d to 2.78 d) that are well above those observed for non-insular mammals.For technical support, we thank the research service facilities of IJC and IGTP, the Crystallization Facility of the Max Planck Institute of Biochemistry, the ICTS NMR facility from the Scientific and Technological Centres of the University of Barcelona and Biophysics Core Facility of BMC-LMU. I.G. was a fellow of the Marie Skłodowska Curie Training network ‘ChroMe’ (H2020-MSCA-ITN-2015-675610, awarded to M.B. and A.G.L.). The project was further supported by national grants (nos. RTI2018-094005-B-I00 and BFU2015-66559-P from FEDER/Ministerio de Ciencia e Innovación—Agencia Estatal de Investigación to M.B.). Research in the participating labs was further supported by the following grants: the Marie Skłodowska Curie Training network ‘INTERCEPT-MDS’ no. H2020-MSCA-ITN-2020-953407 (to M.B.), MINECO-ISCIII no. PIE16/00011 (to M.B.); the Deutsche José Carreras Leukämie Stiftung DJCLS (no. 14R/2018 to M.B.), AGAUR (no. 2017-SGR-305 to M.B.), Fundació La Marató de TV3 (no. 257/C/2019 to M.B.), German Research Foundation Project (ID 213249687—SFB 1064 and Project ID 325871075—SFB 1309 to A.G.L.), the Spanish Ministry of Science (PID2019-110183RB-C21 to A.R.M.), Community of Madrid (P2018/BAA-4343-ALIBIRD2020-CM to A.R.M), Ramón Areces Foundation (to A.R.M.), National Science Foundation (EF-1921402 to J.M.E.L.), 2015 International Doctoral Fellowship La Caixa-Severo Ochoa (to M.F.V.), Marie Skłodowska-Curie Individual Fellowship (no. 747789 to M.M.L.), Juan de la Cierva-Incorporación (IJC2018-036657-I to M.M.L., ERC-2012-CoG-616960 to I.R.T.), MINECO (BFU2017-90114-P to I.R.T.), AGAUR (2017-SGR-324 to X.S.) and MINECO (BIO2015-70092-R and ERC-2014-CoG-648201 to X.S.). Research at the IJC is supported by the ‘La Caixa’ Foundation, Fundació Internacional Josep Carreras, Celgene Spain and the CERCA Programme/Generalitat de Catalunya
A Common Genetic Origin for Early Farmers from Mediterranean Cardial and Central European LBK Cultures
The spread of farming out of the Balkans and into the rest of Europe followed two distinct routes: An initial expansión represented by the Impressa and Cardial traditions, which followed the Northern Mediterranean coastline; and another expansion represented by the LBK (Linearbandkeramik) tradition, which followed the Danube River into Central Europe. Although genomic data now exist from samples representing the second migration, such data have yet to be successfully generated from the initial Mediterranean migration. To address this, we generated the complete genome of a 7,400-yearold Cardial individual (CB13) from Cova Bonica in Vallirana (Barcelona), as well as partial nuclear data from five others excavated from different sites in Spain and Portugal. CB13 clusters with all previously sequenced early European farmers and modern-day Sardinians. Furthermore, our analyses suggest that both Cardial and LBK peoples derived from a common ancient population located in or around the Balkan Peninsula. The Iberian Cardial genome also carries a discernible huntergatherer genetic signature that likely was not acquired by admixture with local Iberian foragers. Our results indicate that retrieving ancient genomes from similarly warm Mediterranean environments such as the Near East is technically feasible
Fragmentation of Contaminant and Endogenous DNA in Ancient Samples Determined by Shotgun Sequencing; Prospects for Human Palaeogenomics
Despite the successful retrieval of genomes from past remains, the prospects for human palaeogenomics remain unclear because of the difficulty of distinguishing contaminant from endogenous DNA sequences. Previous sequence data generated on high-throughput sequencing platforms indicate that fragmentation of ancient DNA sequences is a characteristic trait primarily arising due to depurination processes that create abasic sites leading to DNA breaks
Design of Autonomous Moving Walls According to Recognized Activity Inside of Living Spaces
This Master’s Thesis has been developed in Keio University, Tokyo (Japan), under the supervision of Professor Akira Mita, as part of the research group on Biofication of Living Spaces that is currently being carried out at Mita Leading-edge Science Technology Laboratory. This research group is investigating smart sensor networks that include robots, along with diagnostic methods, for obtaining information about the environment that surrounds a living space. Inside this framework, a lot has been researched about human recognition through sensors and robots and interpreting the information that they may provide. This Master’s Thesis aims to take a step further the knowledge achieved and develop a computer model that simulates the movement of walls according to the activity being held inside the living space, in a manner that the space adapts to the activity. This way, it becomes possible that small living spaces increase their effective useful area by reducing compartments that are not needed for a specific activity, getting that space back when it is required; as it has already been done manually for centuries in Japanese traditional housing. Therefore, the efficiency of the use of the space is increased, raising comfort with it.Outgoin
Design of Autonomous Moving Walls According to Recognized Activity Inside of Living Spaces
This Master’s Thesis has been developed in Keio University, Tokyo (Japan), under the supervision of Professor Akira Mita, as part of the research group on Biofication of Living Spaces that is currently being carried out at Mita Leading-edge Science Technology Laboratory. This research group is investigating smart sensor networks that include robots, along with diagnostic methods, for obtaining information about the environment that surrounds a living space. Inside this framework, a lot has been researched about human recognition through sensors and robots and interpreting the information that they may provide. This Master’s Thesis aims to take a step further the knowledge achieved and develop a computer model that simulates the movement of walls according to the activity being held inside the living space, in a manner that the space adapts to the activity. This way, it becomes possible that small living spaces increase their effective useful area by reducing compartments that are not needed for a specific activity, getting that space back when it is required; as it has already been done manually for centuries in Japanese traditional housing. Therefore, the efficiency of the use of the space is increased, raising comfort with it.Outgoin
Design of Autonomous Moving Walls According to Recognized Activity Inside of Living Spaces
This Master’s Thesis has been developed in Keio University, Tokyo (Japan), under the supervision of Professor Akira Mita, as part of the research group on Biofication of Living Spaces that is currently being carried out at Mita Leading-edge Science Technology Laboratory. This research group is investigating smart sensor networks that include robots, along with diagnostic methods, for obtaining information about the environment that surrounds a living space. Inside this framework, a lot has been researched about human recognition through sensors and robots and interpreting the information that they may provide. This Master’s Thesis aims to take a step further the knowledge achieved and develop a computer model that simulates the movement of walls according to the activity being held inside the living space, in a manner that the space adapts to the activity. This way, it becomes possible that small living spaces increase their effective useful area by reducing compartments that are not needed for a specific activity, getting that space back when it is required; as it has already been done manually for centuries in Japanese traditional housing. Therefore, the efficiency of the use of the space is increased, raising comfort with it.Outgoin
- …