96 research outputs found

    Vision Transformers Need Registers

    Full text link
    Transformers have recently emerged as a powerful tool for learning visual representations. In this paper, we identify and characterize artifacts in feature maps of both supervised and self-supervised ViT networks. The artifacts correspond to high-norm tokens appearing during inference primarily in low-informative background areas of images, that are repurposed for internal computations. We propose a simple yet effective solution based on providing additional tokens to the input sequence of the Vision Transformer to fill that role. We show that this solution fixes that problem entirely for both supervised and self-supervised models, sets a new state of the art for self-supervised visual models on dense visual prediction tasks, enables object discovery methods with larger models, and most importantly leads to smoother feature maps and attention maps for downstream visual processing

    Strong gender differences in reproductive success variance, and the times to the most recent common ancestors

    Full text link
    The Time To the Most Recent Common Ancestor (TMRCA) based on human mitochondrial DNA (mtDNA) is estimated to be twice that based on the non-recombining part of the Y chromosome (NRY). These TMRCAs have special demographic implications because mtDNA is transmitted only from mother to child, and NRY from father to son. Therefore, mtDNA reflects female history, and NRY, male history. To investigate what caused the two-to-one female-male TMRCA ratio in humans, we develop a forward-looking agent-based model (ABM) with overlapping generations and individual life cycles. We implement two main mating systems: polygynandry and polygyny with different degrees in between. In each mating system, the male population can be either homogeneous or heterogeneous. In the latter case, some males are `alphas' and others are `betas', which reflects the extent to which they are favored by female mates. A heterogeneous male population implies a competition among males with the purpose of signaling as alphas. The introduction of a heterogeneous male population is found to reduce by a factor 2 the probability of finding equal female and male TMRCAs and shifts the distribution of the TMRCA ratio to higher values. We find that high male-male competition is necessary to reproduce a TMRCA ratio of 2: less than half the males can be alphas and betas can have at most half the fitness of alphas. In addition, in the modes that maximize the probability of having a TMRCA ratio between 1.5 and 2.5, the present generation has 1.4 times as many female as male ancestors. We also tested the effect of sex-biased migration and sex-specific death rates and found that these are unlikely to explain alone the sex-biased TMRCA ratio observed in humans. Our results support the view that we are descended from males who were successful in a highly competitive context, while females were facing a much smaller female-female competition

    Apicultura em São Raimundo Nonato, Piauí

    Get PDF
    Pertencente ao Território Integrado da Serra da Capivara, semiárido brasileiro, a economia de São Raimundo Nonato é baseada no setor agropecuário com destaque para produção de mel e criação de pequenos animais. O objetivo do estudo foi realizar uma análise dos aspectos ambiental, social, econômico e técnico do setor apícola no município de São Raimundo Nonato. Foi realizado uma pesquisa direta em campo (in loco) com a aplicação de questionário semiestruturado, aplicado individualmente nas comunidades São Vítor, Nova Jerusalém e Macacos. A produtividade média de mel no ano de 2016 variou entre 15 e 25 kg por colmeia/ano e a produção total foi aproximadamente de 39.000 kg. A atividade apícola nas comunidades colabora de forma expressiva na renda financeira das famílias envolvidas fortalecendo a economia e a permanência do apicultor/agricultor e família no campo, a renda anual líquida de 80% dos apicultores é de 5000 reais com a venda do mel. Sobre o aspecto ambiental, há uma conscientização dos apicultores em que a preservação da flora é substancial para o crescimento da cadeia produtiva. O aumento da produtividade e a exploração de novos produtos apícolas como: própolis, geleia real, pólen, cera e favo de mel no pote são os maiores anseios dos apicultores

    Predicting Decisions in Human Social Interactions Using Real-Time fMRI and Pattern Classification

    Get PDF
    Negotiation and trade typically require a mutual interaction while simultaneously resting in uncertainty which decision the partner ultimately will make at the end of the process. Assessing already during the negotiation in which direction one's counterpart tends would provide a tremendous advantage. Recently, neuroimaging techniques combined with multivariate pattern classification of the acquired data have made it possible to discriminate subjective states of mind on the basis of their neuronal activation signature. However, to enable an online-assessment of the participant's mind state both approaches need to be extended to a real-time technique. By combining real-time functional magnetic resonance imaging (fMRI) and online pattern classification techniques, we show that it is possible to predict human behavior during social interaction before the interacting partner communicates a specific decision. Average accuracy reached approximately 70% when we predicted online the decisions of volunteers playing the ultimatum game, a well-known paradigm in economic game theory. Our results demonstrate the successful online analysis of complex emotional and cognitive states using real-time fMRI, which will enable a major breakthrough for social fMRI by providing information about mental states of partners already during the mutual interaction. Interestingly, an additional whole brain classification across subjects confirmed the online results: anterior insula, ventral striatum, and lateral orbitofrontal cortex, known to act in emotional self-regulation and reward processing for adjustment of behavior, appeared to be strong determinants of later overt behavior in the ultimatum game. Using whole brain classification we were also able to discriminate between brain processes related to subjective emotional and motivational states and brain processes related to the evaluation of objective financial incentives
    corecore