Voila-A: Aligning Vision-Language Models with User's Gaze Attention

In recent years, the integration of vision and language understanding has led to significant advancements in artificial intelligence, particularly through Vision-Language Models (VLMs). However, existing VLMs face challenges in handling real-world applications with complex scenes and multiple objects, as well as aligning their focus with the diverse attention patterns of human users. In this paper, we introduce gaze information, feasibly collected by AR or VR devices, as a proxy for human attention to guide VLMs and propose a novel approach, Voila-A, for gaze alignment to enhance the interpretability and effectiveness of these models in real-world applications. First, we collect hundreds of minutes of gaze data to demonstrate that we can mimic human gaze modalities using localized narratives. We then design an automatic data annotation pipeline utilizing GPT-4 to generate the VOILA-COCO dataset. Additionally, we innovate the Voila Perceiver modules to integrate gaze information into VLMs while preserving their pretrained knowledge. We evaluate Voila-A using a hold-out validation set and a newly collected VOILA-GAZE Testset, which features real-life scenarios captured with a gaze-tracking device. Our experimental results demonstrate that Voila-A significantly outperforms several baseline models. By aligning model attention with human gaze patterns, Voila-A paves the way for more intuitive, user-centric VLMs and fosters engaging human-AI interaction across a wide range of applications

O2ATH: An OpenMP Offloading Toolkit for the Sunway Heterogeneous Manycore Platform

The next generation Sunway supercomputer employs the SW26010pro processor, which features a specialized on-chip heterogeneous architecture. Applications with significant hotspots can benefit from the great computation capacity improvement of Sunway many-core architectures by carefully making intensive manual many-core parallelization efforts. However, some legacy projects with large codebases, such as CESM, ROMS and WRF, contain numerous lines of code and do not have significant hotspots. The cost of manually porting such applications to the Sunway architecture is almost unaffordable. To overcome such a challenge, we have developed a toolkit named O2ATH. O2ATH forwards GNU OpenMP runtime library calls to Sunway's Athread library, which greatly simplifies the parallelization work on the Sunway architecture.O2ATH enables users to write both MPE and CPE code in a single file, and parallelization can be achieved by utilizing OpenMP directives and attributes. In practice, O2ATH has helped us to port two large projects, CESM and ROMS, to the CPEs of the next generation Sunway supercomputers via the OpenMP offload method. In the experiments, kernel speedups range from 3 to 15 times, resulting in 3 to 6 times whole application speedups.Furthermore, O2ATH requires significantly fewer code modifications compared to manually crafting CPE functions.This indicates that O2ATH can greatly enhance development efficiency when porting or optimizing large software projects on Sunway supercomputers.Comment: 15 pages, 6 figures, 5 tables

Mixed halide perovskites for spectrally stable and high-efficiency blue light-emitting diodes.

Bright and efficient blue emission is key to further development of metal halide perovskite light-emitting diodes. Although modifying bromide/chloride composition is straightforward to achieve blue emission, practical implementation of this strategy has been challenging due to poor colour stability and severe photoluminescence quenching. Both detrimental effects become increasingly prominent in perovskites with the high chloride content needed to produce blue emission. Here, we solve these critical challenges in mixed halide perovskites and demonstrate spectrally stable blue perovskite light-emitting diodes over a wide range of emission wavelengths from 490 to 451 nanometres. The emission colour is directly tuned by modifying the halide composition. Particularly, our blue and deep-blue light-emitting diodes based on three-dimensional perovskites show high EQE values of 11.0% and 5.5% with emission peaks at 477 and 467 nm, respectively. These achievements are enabled by a vapour-assisted crystallization technique, which largely mitigates local compositional heterogeneity and ion migration

Clinical and Immunopathological Features of Moyamoya Disease

Background: Moyamoya disease (MMD) is a cerebrovascular disease characterized by progressive stenosis or occlusion of the terminal portion of internal carotid arteries and the formation of a vascular network at the base of the brain. The pathogenesis of MMD is still unclear. Methodology/Principal Findings: We retrospectively analyzed clinical data for 65 consecutive patients with MMD in our institutions and evaluated the histopathological and immunohistochemical findings of intracranial vessels from 3 patients. The onset age distribution was found to have 1 peak at 40–49 year-old age group, no significant difference was observed in the female-to-male ratio (F/M = 1.2). Intracranial hemorrhage was the predominant disease type (75%). Positive family history was observed in 4.6 % of patients. Histopathological findings were a narrowed lumen due to intimal fibrous thickening without significant inflammatory cell infiltration, and the internal elastic lamina was markedly tortuous and stratified. All 3 autopsy cases showed vacuolar degeneration in the cerebrovascular smooth muscle cells. Immunohistochemical study showed the migration of smooth muscle cells in the thickened intima, and aberrant expression of IgG and S100A4 protein in vascular smooth muscle cells. The Complement C3 immunoreactivity was negative. Conclusion/Significance: This study indicated that aberrant expression of IgG and S100A4 protein in intracranial vascular wall of MMD patients, which suggested that immune-related factors may be involved in the functional and morphologica

Electrical performance analysis of 110 kv GIS terminal extension conducting rod

As GIS terminal is in cooperation with GIS switch, the GIS terminal with 470 mm structure is usually equipped with a 757 mm structure GIS switch. In order to study the influence of the extended conductive pole on the electrical performance of GIS cable terminal, the contact resistance of the extended conductive pole is measured. The measurement results show that the contact resistance meets the requirements of conductive flow. Through finite element simulation calculation of the influence of the extended conducting rod on the GIS terminal electric field distribution, it was found that the maximum field strength of the cable terminal of the extended conducting rod increased by 2 kv/mm, which was smaller than the breakdown field strength of sulfur hexafluoride gas, and the extended conducting rod did not affect the safe and stable operation of the GIS terminal. Extend the conductive rod by finite element simulation calculation interface without air gap and 0.1 mm gap, the distribution of electric field in both cases, contact resistance conforms to the requirements under the premise, extend the conductive rod interface is 0.1 mm gap the maximum field strength of 1.4 kv/mm, less than the sulfur hexafluoride gas breakdown voltage, contact air gap does not affect the safe and stable operation of the GIS terminal

<i>Salix myrtillacea</i> Female Cuttings Performed Better Than Males under Nitrogen Deposition on Leaves and Drought Conditions

Drought and nitrogen (N) deposition are major threats to global forests under climate change. However, investigation into how dioecious woody species acclimate to drought and N deposition and how this is influenced by gender has, so far, been unexplored. We examined the phenotypic and physiological changes in Salix myrtillacea females and males under 60 d drought, and wet N deposition on leaves’ treatments. Drought inhibited their growth by limiting water acquisition, photosynthesis, and increasing oxidative stress, especially in males. However, females exhibited greater drought resistance than males due to their better water acquisition ability and instantaneous water use efficiency (WUEleaf), higher foliar abscisic acid (ABA) and auxin (IAA) levels and greater antioxidase activities. N deposition increased foliar ABA, H2O2 accumulation, and reduced N distribution to the leaves, causing restricted photosynthesis and aerial growth in males. Interestingly, N deposition improved biomass accumulation in both the genders under drought, with greater positive effects on drought-stressed males by increasing their radial growth and causing greater N distribution to the leaves, increased foliar IAA and reduced oxidative stress. Regardless, S. myrtillacea females still showed better growth and drought resistance than males under both drought and N deposition. The females’ superior performance indicated that they are more appropriate for forestation, thus supporting the dominant gender’s selection in the afforestation of unisexual S. myrtillacea in drought and severe N deposition regions