90 research outputs found

    Automatic Network Adaptation for Ultra-Low Uniform-Precision Quantization

    Full text link
    Uniform-precision neural network quantization has gained popularity since it simplifies densely packed arithmetic unit for high computing capability. However, it ignores heterogeneous sensitivity to the impact of quantization errors across the layers, resulting in sub-optimal inference accuracy. This work proposes a novel neural architecture search called neural channel expansion that adjusts the network structure to alleviate accuracy degradation from ultra-low uniform-precision quantization. The proposed method selectively expands channels for the quantization sensitive layers while satisfying hardware constraints (e.g., FLOPs, PARAMs). Based on in-depth analysis and experiments, we demonstrate that the proposed method can adapt several popular networks channels to achieve superior 2-bit quantization accuracy on CIFAR10 and ImageNet. In particular, we achieve the best-to-date Top-1/Top-5 accuracy for 2-bit ResNet50 with smaller FLOPs and the parameter size.Comment: Accepted as a full paper by the TinyML Research Symposium 202

    Confidence-aware Reward Optimization for Fine-tuning Text-to-Image Models

    Full text link
    Fine-tuning text-to-image models with reward functions trained on human feedback data has proven effective for aligning model behavior with human intent. However, excessive optimization with such reward models, which serve as mere proxy objectives, can compromise the performance of fine-tuned models, a phenomenon known as reward overoptimization. To investigate this issue in depth, we introduce the Text-Image Alignment Assessment (TIA2) benchmark, which comprises a diverse collection of text prompts, images, and human annotations. Our evaluation of several state-of-the-art reward models on this benchmark reveals their frequent misalignment with human assessment. We empirically demonstrate that overoptimization occurs notably when a poorly aligned reward model is used as the fine-tuning objective. To address this, we propose TextNorm, a simple method that enhances alignment based on a measure of reward model confidence estimated across a set of semantically contrastive text prompts. We demonstrate that incorporating the confidence-calibrated rewards in fine-tuning effectively reduces overoptimization, resulting in twice as many wins in human evaluation for text-image alignment compared against the baseline reward models.Comment: ICLR 202

    Wearable, Ultrawide-Range, and Bending-Insensitive Pressure Sensor Based on Carbon Nanotube Network-Coated Porous Elastomer Sponges for Human Interface and Healthcare Devices

    Get PDF
    Flexible and wearable pressure sensors have attracted a tremendous amount of attention due to their wider applications in human interfaces and healthcare monitoring. However, achieving accurate pressure detection and stability against external stimuli (in particular, bending deformation) over a wide range of pressures from tactile to body weight levels is a great challenge. Here, we introduce an ultrawide-range, bending-insensitive, and flexible pressure sensor based on a carbon nanotube (CNT) network-coated thin porous elastomer sponge for use in human interface devices. The integration of the CNT networks into three-dimensional microporous elastomers provides high deformability and a large change in contact between the conductive CNT networks due to the presence of micropores, thereby improving the sensitivity compared with that obtained using CNT-embedded solid elastomers. As electrical pathways are continuously generated up to high compressive strain (∼80%), the pressure sensor shows an ultrawide pressure sensing range (10 Pa to 1.2 MPa) while maintaining favorable sensitivity (0.01–0.02 kPa–1) and linearity (R2 ∼ 0.98). Also, the pressure sensor exhibits excellent electromechanical stability and insensitivity to bending-induced deformations. Finally, we demonstrate that the pressure sensor can be applied in a flexible piano pad as an entertainment human interface device and a flexible foot insole as a wearable healthcare and gait monitoring device

    The thalamic mGluR1-PLC??4 pathway is critical in sleep architecture

    Get PDF
    The transition from wakefulness to a nonrapid eye movement (NREM) sleep state at the onset of sleep involves a transition from low-voltage, high-frequency irregular electroencephalography (EEG) waveforms to large-amplitude, low-frequency EEG waveforms accompanying synchronized oscillatory activity in the thalamocortical circuit. The thalamocortical circuit consists of reciprocal connections between the thalamus and cortex. The cortex sends strong excitatory feedback to the thalamus, however the function of which is unclear. In this study, we investigated the role of the thalamic metabotropic glutamate receptor 1 (mGluR1)-phospholipase C ??4 (PLC??4) pathway in sleep control in PLC??4-deficient (PLC??4-/-) mice. The thalamic mGluR1-PLC??4 pathway contains synapses that receive corticothalamic inputs. In PLC??4-/- mice, the transition from wakefulness to the NREM sleep state was stimulated, and the NREM sleep state was stabilized, which resulted in increased NREM sleep. The power density of delta (??) waves increased in parallel with the increased NREM sleep. These sleep phenotypes in PLC??4-/- mice were consistent in TC-restricted PLC??4 knockdown mice. Moreover, in vitro intrathalamic oscillations were greatly enhanced in the PLC??4-/- slices. The results of our study showed that thalamic mGluR1-PLC??4 pathway was critical in controlling sleep architecture.ope

    Analgesic and cardiopulmonary effects of premedication with tramadol in calves anesthetized with the infusion of guaifenesin and thiamylal

    No full text
    This study examined the analgesic and cardiopulmonary effects of intravenous (IV) tramadol during general intravenous anesthesia in calves. Calves were premedicated with diazepam (0.2 mg/kg, IV) with tramadol (2 mg/kg, IV) (group T) or saline (group S). Anesthesia was induced by thiamylal sodium (4 mg/kg, IV) and maintained with an infusion (2 ml/kg/hr) of 5% guaifenesin containing thiamylal sodium (2 mg/ml). Additional thiamylal sodium (1-2 mg/ kg, IV) was administered when interference from the calves was observed during surgery. The total counts of additional thiamylal sodium administration, analgesia score using a visual analog scale, recovery time, and cardiopulmonary function in the different groups were assessed and compared. Group T showed significantly fewer counts of additional drug administration and a significantly higher analgesia score. Tramadol may provide adequate analgesia with minimal cardiopulmonary changes in calves during general anesthesia.N

    Genetic Algorithm-Based Design Optimization of Electromagnetic Valve Actuators in Combustion Engines

    No full text
    In this research, the design of a new electromagnetic engine valve in the limited space of combustion engine is optimized by multidisciplinary simulation using MATLAB and Maxwell. An electromagnetic engine valve actuator using a permanent magnet is a new actuator concept for overcoming the inherent drawbacks of the conventional solenoid-driven electromagnetic engine valve actuator, such as high power consumption and so on. This study aims to maximize the vibration frequency of the armature to reduce the transition time of the engine valve. The higher performance of the new actuator is demonstrated by dynamic finite element analysis

    TC1(C8orf4) is upregulated by IL-1β/TNF-α and enhances proliferation of human follicular dendritic cells

    Get PDF
    AbstractFollicular dendritic cells (FDC) play crucial roles in immune regulation. TNF-α has been shown to be essential to the FDC network. However, the molecular regulation of FDC proliferation has not been characterized. Here, we show that TC1(C8orf4), a novel positive regulator of the Wnt/β-catenin pathway in vertebrates, is upregulated by IL-1β and TNF-α in the human FDC-like line HK. TC1 enhances HK cell proliferation, while TC1-knockdown inhibits the proliferation induced by IL-1β, suggesting a role of TC1 as a regulator of FDC proliferation. The regulation by pro-inflammatory cytokines suggests that TC1 might be implicated in linking local inflammation to immune response by stimulating FDC
    corecore