UATVR: Uncertainty-Adaptive Text-Video Retrieval

With the explosive growth of web videos and emerging large-scale vision-language pre-training models, e.g., CLIP, retrieving videos of interest with text instructions has attracted increasing attention. A common practice is to transfer text-video pairs to the same embedding space and craft cross-modal interactions with certain entities in specific granularities for semantic correspondence. Unfortunately, the intrinsic uncertainties of optimal entity combinations in appropriate granularities for cross-modal queries are understudied, which is especially critical for modalities with hierarchical semantics, e.g., video, text, etc. In this paper, we propose an Uncertainty-Adaptive Text-Video Retrieval approach, termed UATVR, which models each look-up as a distribution matching procedure. Concretely, we add additional learnable tokens in the encoders to adaptively aggregate multi-grained semantics for flexible high-level reasoning. In the refined embedding space, we represent text-video pairs as probabilistic distributions where prototypes are sampled for matching evaluation. Comprehensive experiments on four benchmarks justify the superiority of our UATVR, which achieves new state-of-the-art results on MSR-VTT (50.8%), VATEX (64.5%), MSVD (49.7%), and DiDeMo (45.8%). The code is available at https://github.com/bofang98/UATVR.Comment: To appear at ICCV202

Huatuo-26M, a Large-scale Chinese Medical QA Dataset

In this paper, we release a largest ever medical Question Answering (QA) dataset with 26 million QA pairs. We benchmark many existing approaches in our dataset in terms of both retrieval and generation. Experimental results show that the existing models perform far lower than expected and the released dataset is still challenging in the pre-trained language model era. Moreover, we also experimentally show the benefit of the proposed dataset in many aspects: (i) trained models for other QA datasets in a zero-shot fashion; and (ii) as external knowledge for retrieval-augmented generation (RAG); and (iii) improving existing pre-trained language models by using the QA pairs as a pre-training corpus in continued training manner. We believe that this dataset will not only contribute to medical research but also facilitate both the patients and clinical doctors. See \url{https://github.com/FreedomIntelligence/Huatuo-26M}

HuatuoGPT, towards Taming Language Model to Be a Doctor

In this paper, we present HuatuoGPT, a large language model (LLM) for medical consultation. The core recipe of HuatuoGPT is to leverage both \textit{distilled data from ChatGPT} and \textit{real-world data from doctors} in the supervised fine-tuned stage. The responses of ChatGPT are usually detailed, well-presented and informative while it cannot perform like a doctor in many aspects, e.g. for integrative diagnosis. We argue that real-world data from doctors would be complementary to distilled data in the sense the former could tame a distilled language model to perform like doctors. To better leverage the strengths of both data, we train a reward model to align the language model with the merits that both data bring, following an RLAIF (reinforced learning from AI feedback) fashion. To evaluate and benchmark the models, we propose a comprehensive evaluation scheme (including automatic and manual metrics). Experimental results demonstrate that HuatuoGPT achieves state-of-the-art results in performing medical consultation among open-source LLMs in GPT-4 evaluation, human evaluation, and medical benchmark datasets. It is worth noting that by using additional real-world data and RLAIF, the distilled language model (i.e., HuatuoGPT) outperforms its teacher model ChatGPT in most cases. Our code, data, and models are publicly available at \url{https://github.com/FreedomIntelligence/HuatuoGPT}. The online demo is available at \url{https://www.HuatuoGPT.cn/}

Terlipressin May Decrease In-Hospital Mortality of Cirrhotic Patients with Acute Gastrointestinal Bleeding and Renal Dysfunction: A Retrospective Multicenter Observational Study

Acute gastrointestinal bleeding (GIB) rapidly reduces effective blood volume, thereby precipitating acute kidney injury (AKI). Terlipressin, which can induce splanchnic vasoconstriction and increase renal perfusion, has been recommended for acute GIB and hepatorenal syndrome in liver cirrhosis. Thus, we hypothesized that terlipressin might be beneficial for cirrhotic patients with acute GIB and renal impairment. In this Chinese multi-center study, 1644 cirrhotic patients with acute GIB were retrospectively enrolled. AKI was defined according to the International Club of Ascites (ICA) criteria. Renal dysfunction was defined as serum creatinine (sCr) > 133 μmol/L at admission and/or any time point during hospitalization. Incidence of renal impairment and in-hospital mortality were the primary end-points. The incidence of any stage ICA-AKI, ICA-AKI stages 1B, 2, and 3, and renal dysfunction in cirrhotic patients with acute GIB was 7.1%, 1.8%, and 5.0%, respectively. The in-hospital mortality was significantly increased by renal dysfunction (14.5% vs. 2.2%, P < 0.001) and ICA-AKI stages 1B, 2, and 3 (11.1% vs. 2.8%, P = 0.011), but not any stage ICA-AKI (5.7% vs. 2.7%, P = 0.083). The in-hospital mortality was significantly decreased by terlipressin in patients with renal dysfunction (3.6% vs. 20.0%, P = 0.044), but not in those with any stage ICA-AKI (4.5% vs. 6.0%, P = 0.799) or ICA-AKI stages 1B, 2, and 3 (0.0% vs. 14.3%, P = 0.326). Renal dysfunction increased the in-hospital mortality of cirrhotic patients with acute GIB. Terlipressin might decrease the in-hospital mortality of cirrhotic patients with acute GIB and renal dysfunction. NCT03846180 ( https://clinicaltrials.gov )

Impact of epicardial adipose tissue volume on hemodynamically significant coronary artery disease in Chinese patients with known or suspected coronary artery disease

BackgroundEpicardial adipose tissue (EAT) is directly related to coronary artery disease (CAD), but little is known about its role in hemodynamically significant CAD. Therefore, our goal is to explore the impact of EAT volume on hemodynamically significant CAD.MethodsPatients who underwent coronary computed tomography angiography (CCTA) and received coronary angiography within 30 days were retrospectively included. Measurements of EAT volume and coronary artery calcium score (CACs) were performed on a semi-automatic software based on CCTA images, while quantitative flow ratio (QFR) was automatically calculated by the AngioPlus system according to coronary angiographic images.ResultsThis study included 277 patients, 112 of whom had hemodynamically significant CAD and showed higher EAT volume. In multivariate analysis, EAT volume was independently and positively correlated with hemodynamically significant CAD [per standard deviation (SD) cm3; odds ratio (OR), 2.78; 95% confidence interval (CI), 1.86–4.15; P &lt; 0.001], but negatively associated with QFRmin (per SD cm3; β coefficient, −0.068; 95% CI, −0.109 to −0.027; P = 0.001) after adjustment for traditional risk factors and CACs. Receiver operating characteristics curve analysis demonstrated a significant improvement in predictive value for hemodynamically significant CAD with the addition of EAT volume to obstructive CAD alone (area under the curve, 0.950 vs. 0.891; P &lt; 0.001).ConclusionIn this study, we found that EAT volume correlated substantially and positively with the existence and severity of hemodynamically significant CAD in Chinese patients with known or suspected CAD, which was independent of traditional risk factors and CACs. In combination with obstructive CAD, EAT volume significantly improved diagnostic performance for hemodynamically significant CAD, suggesting that EAT could be a reliable noninvasive indicator of hemodynamically significant CAD

Mini percutaneous nephrolithotomy is a noninferior modality to standard percutaneous nephrolithotomy for the management of 20-40 mm renal calculi: A Multicenter randomized controlled trial

Background: High quality of evidence comparing mini percutaneous nephrolithotomy (mPNL) with standard percutaneous nephrolithotomy (sPNL) for the treatment of larger-sized renal stones is lacking. Objective: To compare the efficacy and safety of mPNL and sPNL for the treatment of 20–40 mm renal stones. Design, setting, and participants: A parallel, open-label, and noninferior randomized controlled trial was performed at 20 Chinese centers (2016–2019). The inclusion criteria were patients 18–70 yr old, with normal renal function, and 20–40 mm renal stones. Intervention: Percutaneous nephrolithotomy PNL was performed using either 18 F or 24 F percutaneous nephrostomy tracts. Outcome measurements and statistical analysis: The primary outcome was the one-session stone-free rate (SFR). The secondary outcomes included operating time, visual analog pain scale (VAS) score, blood loss, complications as per the Clavien-Dindo grading system, and length of hospitalization. Results and limitations: The 1980 intention-to-treat patients were randomized. The mPNL group achieved a noninferior one-session SFR to the sPNL group by the one-side noninferiority test (0.5% [difference], p < 0.001). The transfusion and embolization rates were comparable; however, the sPNL group had a higher hemoglobin drop (5.2 g/l, p < 0.001). The sPNL yielded shorter operating time (–2.2 min, p = 0.008) but a higher VAS score (0.8, p < 0.001). Patients in the sPNL group also had longer hospitalization (0.6 d, p < 0.001). There was no statistically significant difference in fever or urosepsis occurrences. The study's main limitation was that only 18F or 24F tract sizes were used. Conclusions: Mini mPNL achieves noninferior SFR outcomes to sPNL, but with reduced bleeding, less postoperative pain, and shorter hospitalization. Patient summary: We evaluated the surgical outcomes of percutaneous nephrolithotomy using two different sizes of nephrostomy tracts in a large population. We found that the smaller tract might be a sensible alternative for patients with 20–40 mm renal stones. This multicenter, parallel, open-label, and noninferior randomized controlled trial showed that mini percutaneous nephrolithotomy achieved noninferior stone-free rate with advantages of reduced blood loss, less postoperative pain, and shorter hospitalization. Mini percutaneous nephrolithotomy should be considered a sensible alternative treatment of 20–40 mm renal stones.grants from high-level development funding of Guangzhou Medical Universit

Extraordinary characteristics of one-dimensional -symmetric ring optical waveguide networks with near-isometric and isometric arms

We construct one-dimensional $\cal{PT}$ -symmetric ring optical waveguide networks with near-isometric and isometric arms and investigate their extraordinary optical properties. It is found that the features for the former and the latter are quite different, although extraordinary ultrastrong transmission and reflection exist in both of them. When the former changes to be the latter, the extraordinary optical properties will all change remarkably, and the fitting formulae are obtained. The bidirectional invisibility only exists in the former and the principle is analyzed. This work may be helpful for designing ultra-narrow optical filters, ultra-sensitive optical switches, and resonant component for high-monochromatic lasing