934 research outputs found

    GLIMMER: generalized late-interaction memory reranker

    Full text link
    Memory-augmentation is a powerful approach for efficiently incorporating external information into language models, but leads to reduced performance relative to retrieving text. Recent work introduced LUMEN, a memory-retrieval hybrid that partially pre-computes memory and updates memory representations on the fly with a smaller live encoder. We propose GLIMMER, which improves on this approach through 1) exploiting free access to the powerful memory representations by applying a shallow reranker on top of memory to drastically improve retrieval quality at low cost, and 2) incorporating multi-task training to learn a general and higher quality memory and live encoder. GLIMMER achieves strong gains in performance at faster speeds compared to LUMEN and FiD on the KILT benchmark of knowledge-intensive tasks

    A proof-of-concept Bitter-like HTS electromagnet fabricated from a silver-infiltrated (RE)BCO ceramic bulk

    Get PDF
    A novel concept for a compact high-field magnet coil is introduced. This is based on stacking slit annular discs cut from bulk rare-earth barium cuprate ((RE)BCO) ceramic in a Bitter-like architecture. Finite-element modelling shows that a small 20 turn stack (with a total coil volume of <20 cm3) is capable of generating a central bore magnetic field of >2 T at 77 K and >20 T at 30 K. Unlike resistive Bitter magnets, the high-temperature superconducting (HTS) Bitter stack exhibits significant non-linear field behaviour during current ramping, caused by current filling proceeding from the inner radius outwards in each HTS layer. Practical proof-of-concept for this architecture was then demonstrated through fabricating an uninsulated four-turn prototype coil stack and operating this at 77 K. A maximum central field of 0.382 T was measured at 1.2 kA, with an accompanying 6.1 W of internal heat dissipation within the coil. Strong magnetic hysteresis behaviour was observed within the prototype coil, with ≈30% of the maximum central field still remaining trapped 45 min after the current had been removed. The coil was thermally stable during a 15 min hold at 1 kA, and survived thermal cycling to room temperature without noticeable deterioration in performance. A final test-to-destruction of the coil showed that the limiting weak point in the stack was growth-sector boundaries present in the original (RE)BCO bulk

    MEMORY-VQ: Compression for Tractable Internet-Scale Memory

    Full text link
    Retrieval augmentation is a powerful but expensive method to make language models more knowledgeable about the world. Memory-based methods like LUMEN pre-compute token representations for retrieved passages to drastically speed up inference. However, memory also leads to much greater storage requirements from storing pre-computed representations. We propose MEMORY-VQ, a new method to reduce storage requirements of memory-augmented models without sacrificing performance. Our method uses a vector quantization variational autoencoder (VQ-VAE) to compress token representations. We apply MEMORY-VQ to the LUMEN model to obtain LUMEN-VQ, a memory model that achieves a 16x compression rate with comparable performance on the KILT benchmark. LUMEN-VQ enables practical retrieval augmentation even for extremely large retrieval corpora

    Self-Control in Cyberspace: Applying Dual Systems Theory to a Review of Digital Self-Control Tools

    Get PDF
    Many people struggle to control their use of digital devices. However, our understanding of the design mechanisms that support user self-control remains limited. In this paper, we make two contributions to HCI research in this space: first, we analyse 367 apps and browser extensions from the Google Play, Chrome Web, and Apple App stores to identify common core design features and intervention strategies afforded by current tools for digital self-control. Second, we adapt and apply an integrative dual systems model of self-regulation as a framework for organising and evaluating the design features found. Our analysis aims to help the design of better tools in two ways: (i) by identifying how, through a well-established model of self-regulation, current tools overlap and differ in how they support self-control; and (ii) by using the model to reveal underexplored cognitive mechanisms that could aid the design of new tools.Comment: 11.5 pages (excl. references), 6 figures, 1 tabl

    Management implications of climate change effect on fisheries in Western Australia Part 1: Environmental change and risk assessment FRDC: Project No. 2010/535

    Get PDF
    Objectives: 1. Assess future climate change effects on Western Australia’s marine environment using a suite of IPCC model projections, downscaled to the key shelf regions and the spatial and temporal scales relevant for key fisheries 2. Examine the modeled shelf climate change scenarios on fisheries and implications of historic and future climate change effects 3. Review management arrangements to examine their robustness to possible effects of climate chang
    • …
    corecore