TKwinFormer: Top k Window Attention in Vision Transformers for Feature Matching

Local feature matching remains a challenging task, primarily due to difficulties in matching sparse keypoints and low-texture regions. The key to solving this problem lies in effectively and accurately integrating global and local information. To achieve this goal, we introduce an innovative local feature matching method called TKwinFormer. Our approach employs a multi-stage matching strategy to optimize the efficiency of information interaction. Furthermore, we propose a novel attention mechanism called Top K Window Attention, which facilitates global information interaction through window tokens prior to patch-level matching, resulting in improved matching accuracy. Additionally, we design an attention block to enhance attention between channels. Experimental results demonstrate that TKwinFormer outperforms state-of-the-art methods on various benchmarks. Code is available at: https://github.com/LiaoYun0x0/TKwinFormer.Comment: 11 pages, 7 figure

Data-Centric Financial Large Language Models

Large language models (LLMs) show promise for natural language tasks but struggle when applied directly to complex domains like finance. LLMs have difficulty reasoning about and integrating all relevant information. We propose a data-centric approach to enable LLMs to better handle financial tasks. Our key insight is that rather than overloading the LLM with everything at once, it is more effective to preprocess and pre-understand the data. We create a financial LLM (FLLM) using multitask prompt-based finetuning to achieve data pre-processing and pre-understanding. However, labeled data is scarce for each task. To overcome manual annotation costs, we employ abductive augmentation reasoning (AAR) to automatically generate training data by modifying the pseudo labels from FLLM's own outputs. Experiments show our data-centric FLLM with AAR substantially outperforms baseline financial LLMs designed for raw text, achieving state-of-the-art on financial analysis and interpretation tasks. We also open source a new benchmark for financial analysis and interpretation. Our methodology provides a promising path to unlock LLMs' potential for complex real-world domains

Association of Magnesium Intake With Sleep Duration and Sleep Quality: Findings From the CARDIA Study

OBJECTIVES: As an antagonist of calcium (Ca), magnesium (Mg) has been hypothesized to improve individuals’ sleep disturbances, a common health problem, through regulating the glutamatergic and GABAergic systems. The objectives of this study were to examine the longitudinal associations of Mg intake and Ca-to-Mg intake ratio with sleep quality and duration. METHODS: A total of 5115 American young adults, aged 18–30 years, were enrolled in the Coronary Artery Risk Development in Young Adults (CARDIA) study. Dietary information, including intakes of Mg and other nutrients, was obtained using the CARDIA dietary history at baseline (1985–86), year 7 (1992–93), and year 20 (2005–06). Sleep measures, including self-reported sleep quality and sleep duration, were collected at year 15 (2000–01) and year 20. Sleep quality was assessed on a scale of 1 (very good) to 5 (very bad), whereas sleep duration was grouped into three categories: 9 hours. Generalized estimating equation (GEE) was used to examine the associations of interest. RESULTS: After adjustment for potential demographical, behavioral, and nutritional confounders, Mg intake was associated with better sleep quality [highest intake quartile (Q4) vs. lowest intake quartile (Q1): odds ratio (OR) = 1.23; 95% CI = 1.00, 1.50, P for trend = 0.052]. Participants in Q4 were also less likely to have short sleep (<7 hours) compared to those in Q1 (OR = 0.64; 95% CI = 0.51, 0.81, P for trend = 0.012). The observed association with short sleep persisted among participants without depressive disorders (Q4 vs. Q1: OR = 0.64; 95% CI = 0.49, 0.82, P for trend <0.001), but not among individuals with depressive disorder. Ca-to-Mg intake ratio was not associated with either sleep quality or sleep duration regardless of depression status. CONCLUSIONS: Mg intake was associated with sleep quality and duration in this longitudinal analysis. Randomized controlled trials with objective measures of sleep are warranted to establish the potential causal inference. FUNDING SOURCES: National Institutes of Health (NIH)

Global research trends in benign paroxysmal positional vertigo: a bibliometric analysis

BackgroundBenign paroxysmal positional vertigo is the most common disease in which vertigo is the main clinical manifestation, and it has become a global medical problem, affecting a wide range of areas and seriously affecting the quality of human life.ObjectiveThis article presents an analysis of the current characteristics of BPPV-related research and summarizes the current hot topics and trends, with the goal of inspiring future research into the prevention and treatment of BPPV, thereby improving the differential diagnosis and prevention of peripheral vertigo.MethodsA bibliometric approach was used to collect 1,219 eligible studies on BPPV from four databases—PubMed, Embase, Scopus, and Web of Science—published between 1974 and 2022. The characteristics and status of the accumulated scientific output were processed using R and VOSviewer so that we could visualize any trends or hotspots.ResultsThe results showed a significant increase in the annual number of publications, with an average annual growth rate of 21.58%. A possible reason for the especially pronounced peak in 2021 was an increase in the prevalence of BPPV as a result of COVID-19. The new coronavirus became a focus of research in 2021. A total of 3,876 authors (of whom 1,097 were first authors) published articles in 307 different journals; 15.7% of the articles were published in Acta Oto-Larygologica, Otology and Neurotology, and Frontiers in Neurology. Acta Oto-Laryngologica was well ahead of the other journals in terms of growth rate and number of articles published. American scholars generated the largest number of articles overall, and the USA was involved in the greatest number of international collaborations, followed by Italy and China. The themes of the research centered around three topics, namely the treatment of BPPV, its influencing factors, and diagnosis.ConclusionsThere has been a major increase in BPPV-related research over the last 50 years, leading to an increase in related articles and rapid development of the field. Key directions for future research include the improvement of individualized treatment for residual symptoms after initial treatment of BPPV among the elderly; effective control of comorbidities such as osteoporosis; and secondary inner ear disease, such as Ménière's disease

Non-standard neutrino interactions in IceCube

Non-standard neutrino interactions (NSI) may arise in various types of new physics. Their existence would change the potential that atmospheric neutrinos encounter when traversing Earth matter and hence alter their oscillation behavior. This imprint on coherent neutrino forward scattering can be probed using high-statistics neutrino experiments such as IceCube and its low-energy extension, DeepCore. Both provide extensive data samples that include all neutrino flavors, with oscillation baselines between tens of kilometers and the diameter of the Earth. DeepCore event energies reach from a few GeV up to the order of 100 GeV - which marks the lower threshold for higher energy IceCube atmospheric samples, ranging up to 10 TeV. In DeepCore data, the large sample size and energy range allow us to consider not only flavor-violating and flavor-nonuniversal NSI in the μ−τ sector, but also those involving electron flavor. The effective parameterization used in our analyses is independent of the underlying model and the new physics mass scale. In this way, competitive limits on several NSI parameters have been set in the past. The 8 years of data available now result in significantly improved sensitivities. This improvement stems not only from the increase in statistics but also from substantial improvement in the treatment of systematic uncertainties, background rejection and event reconstruction

IceCube Search for Earth-traversing ultra-high energy Neutrinos

The search for ultra-high energy neutrinos is more than half a century old. While the hunt for these neutrinos has led to major leaps in neutrino physics, including the detection of astrophysical neutrinos, neutrinos at the EeV energy scale remain undetected. Proposed strategies for the future have mostly been focused on direct detection of the first neutrino interaction, or the decay shower of the resulting charged particle. Here we present an analysis that uses, for the first time, an indirect detection strategy for EeV neutrinos. We focus on tau neutrinos that have traversed Earth, and show that they reach the IceCube detector, unabsorbed, at energies greater than 100 TeV for most trajectories. This opens up the search for ultra-high energy neutrinos to the entire sky. We use ten years of IceCube data to perform an analysis that looks for secondary neutrinos in the northern sky, and highlight the promise such a strategy can have in the next generation of experiments when combined with direct detection techniques