API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMs

Recent research has demonstrated that Large Language Models (LLMs) can enhance their capabilities by utilizing external tools. However, three pivotal questions remain unanswered: (1) How effective are current LLMs in utilizing tools? (2) How can we enhance LLMs' ability to utilize tools? (3) What obstacles need to be overcome to leverage tools? To address these questions, we introduce API-Bank, a groundbreaking benchmark, specifically designed for tool-augmented LLMs. For the first question, we develop a runnable evaluation system consisting of 73 API tools. We annotate 314 tool-use dialogues with 753 API calls to assess the existing LLMs' capabilities in planning, retrieving, and calling APIs. For the second question, we construct a comprehensive training set containing 1,888 tool-use dialogues from 2,138 APIs spanning 1,000 distinct domains. Using this dataset, we train Lynx, a tool-augmented LLM initialized from Alpaca. Experimental results demonstrate that GPT-3.5 exhibits improved tool utilization compared to GPT-3, while GPT-4 excels in planning. However, there is still significant potential for further improvement. Moreover, Lynx surpasses Alpaca's tool utilization performance by more than 26 pts and approaches the effectiveness of GPT-3.5. Through error analysis, we highlight the key challenges for future research in this field to answer the third question.Comment: EMNLP 202

Unique post-translational oxime formation in the biosynthesis of the azolemycin complex of novel ribosomal peptides from Streptomyces sp. FXJ1.264

Streptomycetes are a rich source of bioactive specialized metabolites, including several examples of the rapidly growing class of ribosomally-biosynthesized and post-translationally-modified peptide (RiPP) natural products. Here we report the discovery from Streptomyces sp. FXJ1.264 of azolemycins A–D, a complex of novel linear azole-containing peptides incorporating a unique oxime functional group. Bioinformatics analysis of the Streptomyces sp. FXJ1.264 draft genome sequence identified a cluster of genes that was hypothesized to be responsible for elaboration of the azolemycins from a ribosomally-biosynthesized precursor. Inactivation of genes within this cluster abolished azolemycin production, consistent with this hypothesis. Moreover, mutants lacking the azmE and azmF genes accumulated azolemycin derivatives lacking the O-methyl groups and an amino group in place of the N-terminal oxime (as well as proteolysed derivatives), respectively. Thus AzmE, a putative S-adenosyl methionine-dependent methyl transferase, is responsible for late-stage O-methylation reactions in azolemycin biosynthesis and AzmF, a putative flavin-dependent monooxygenase, catalyzes oxidation of the N-terminal amino group in an azolemycin precursor to the corresponding oxime. To the best of our knowledge, oxime formation is a hitherto unknown posttranslational modification in RiPP biosynthesis

Self-monitoring and self-delivery of self-assembled fluorescent nanoparticles in cancer therapy

Purpose: Due to the shortcomings of nanocarriers, the development of carrier-free nanodelivery systems has attracted more and more attention in cancer treatment. However, there are few studies on carrier-free nanosystems that can simultaneously achieve monitoring functions. Here a multifunctional carrier-free nanosystem loaded with curcumin and irinotecan hydrochloride was established for the treatment and monitoring of gastric cancer. Methods: In this study, an irinotecan hydrochloride-curcumin nanosystem in the early stage (the system is named SICN) was prepared. Based on the fluorescence of curcumin, flow cytometry, laser confocal microscopy, and zebrafish fluorescence imaging were used to study the monitoring function of SICN in vivo and in vitro. In addition, HGC-27 human gastric cancer cells were used to study SICN cytotoxicity. Results: Flow cytometry and zebrafish fluorescence imaging monitoring results showed that the uptake of SICN was significantly higher than free curcumin, and the excretion rate was lower. SICN had higher accumulation and retention in cells and zebrafish. Laser confocal microscopy monitoring results showed that SICN was internalized into HGC-27 cells through multiple pathways, including macropinocytosis, caveolin, and clathrin-mediated and clathrin-independent endocytosis, and distributed intracellularly throughout the whole cytoplasm, including lysosomes and Golgi apparatus. In vitro cell experiments showed that SICN nanoparticles were more toxic than single components, and HGC-27 cells had more absorption and higher toxicity to nanoparticles under slightly acidic conditions. Conclusion: SICN is a promising carrier-free nanoparticle, and the combination of two single-component therapies can exert a synergistic antitumor effect. When exposed to a tumor acidic environment, SICN showed stronger cytotoxicity due to charge conversion. More importantly, the nanoparticles' self-monitoring function has been developed, opening up new ideas for combined tumor therapy.National Natural Science Foundation of China Youth Science Fund Project [81903777]; Ministry of Education, Youth and Sports of the Czech RepublicMinistry of Education, Youth & Sports - Czech Republic [RP/CPS/2020/002]; Sichuan Province Science and Technology Basic Condition Platform Project [2019JDPT0032]; Xinglin Scholars Discipline Talent Research Promotion Plan [CXTD2018012]; Open Research Fund of Chengdu University of Traditional Chinese Medicine Key Laboratory of Systematic Research of Distinctive Chinese Medicine Resources in Southwest China [2020XSGG014]RP/ CPS/2020/002; 2020XSGG014; 2019JDPT0032; CXTD2018012; National Outstanding Youth Science Fund Project of National Natural Science Foundation of China, IUSS: 81903777; Ministerstvo Školství, Mládeže a Tělovýchovy, MŠM

Real-time Monitoring for the Next Core-Collapse Supernova in JUNO

Core-collapse supernova (CCSN) is one of the most energetic astrophysical events in the Universe. The early and prompt detection of neutrinos before (pre-SN) and during the SN burst is a unique opportunity to realize the multi-messenger observation of the CCSN events. In this work, we describe the monitoring concept and present the sensitivity of the system to the pre-SN and SN neutrinos at the Jiangmen Underground Neutrino Observatory (JUNO), which is a 20 kton liquid scintillator detector under construction in South China. The real-time monitoring system is designed with both the prompt monitors on the electronic board and online monitors at the data acquisition stage, in order to ensure both the alert speed and alert coverage of progenitor stars. By assuming a false alert rate of 1 per year, this monitoring system can be sensitive to the pre-SN neutrinos up to the distance of about 1.6 (0.9) kpc and SN neutrinos up to about 370 (360) kpc for a progenitor mass of 30$M_{\odot}$ for the case of normal (inverted) mass ordering. The pointing ability of the CCSN is evaluated by using the accumulated event anisotropy of the inverse beta decay interactions from pre-SN or SN neutrinos, which, along with the early alert, can play important roles for the followup multi-messenger observations of the next Galactic or nearby extragalactic CCSN.Comment: 24 pages, 9 figure

Potential of Core-Collapse Supernova Neutrino Detection at JUNO

JUNO is an underground neutrino observatory under construction in Jiangmen, China. It uses 20kton liquid scintillator as target, which enables it to detect supernova burst neutrinos of a large statistics for the next galactic core-collapse supernova (CCSN) and also pre-supernova neutrinos from the nearby CCSN progenitors. All flavors of supernova burst neutrinos can be detected by JUNO via several interaction channels, including inverse beta decay, elastic scattering on electron and proton, interactions on C12 nuclei, etc. This retains the possibility for JUNO to reconstruct the energy spectra of supernova burst neutrinos of all flavors. The real time monitoring systems based on FPGA and DAQ are under development in JUNO, which allow prompt alert and trigger-less data acquisition of CCSN events. The alert performances of both monitoring systems have been thoroughly studied using simulations. Moreover, once a CCSN is tagged, the system can give fast characterizations, such as directionality and light curve

Detection of the Diffuse Supernova Neutrino Background with JUNO

As an underground multi-purpose neutrino detector with 20 kton liquid scintillator, Jiangmen Underground Neutrino Observatory (JUNO) is competitive with and complementary to the water-Cherenkov detectors on the search for the diffuse supernova neutrino background (DSNB). Typical supernova models predict 2-4 events per year within the optimal observation window in the JUNO detector. The dominant background is from the neutral-current (NC) interaction of atmospheric neutrinos with 12C nuclei, which surpasses the DSNB by more than one order of magnitude. We evaluated the systematic uncertainty of NC background from the spread of a variety of data-driven models and further developed a method to determine NC background within 15\% with {\it{in}} {\it{situ}} measurements after ten years of running. Besides, the NC-like backgrounds can be effectively suppressed by the intrinsic pulse-shape discrimination (PSD) capabilities of liquid scintillators. In this talk, I will present in detail the improvements on NC background uncertainty evaluation, PSD discriminator development, and finally, the potential of DSNB sensitivity in JUNO

Airborne Sound Sensing System Based on DAS and Ultra-Simple Transducer Structure

Fiber-distributed optical fiber acoustic sensor (DAS) is generally used in distributed long-distance acoustic/vibration measurement. Recently, DAS is also used in weak airborne sound detection. To improve the sensitivity of DAS, using a state-of-the-art acoustic transducer or a special enhanced scattering fiber, which are uncommon in the industrial site, is often essential, according to the previous research. In this work, the fading of DAS is suppressed by the multi-frequency probes and polarization-diversity-receiver scheme. The self-noise of DAS is further lowered by the phase averaging of multiple acoustic channels wound on the transducer. We found that, supported by this high-performance DAS, even if the transducer is made with an ultra-simple plastic structure in daily life, the system can achieve high-sensitivity airborne sound sensing. The proposed simple acoustic transducer can reach the sensitivity level of −106.5 dB re. 1 rad/μPa at a sensing range of 5.1 km, which can meet many demands on the industrial site

Airborne Sound Sensing System Based on DAS and Ultra-Simple Transducer Structure

Fiber-distributed optical fiber acoustic sensor (DAS) is generally used in distributed long-distance acoustic/vibration measurement. Recently, DAS is also used in weak airborne sound detection. To improve the sensitivity of DAS, using a state-of-the-art acoustic transducer or a special enhanced scattering fiber, which are uncommon in the industrial site, is often essential, according to the previous research. In this work, the fading of DAS is suppressed by the multi-frequency probes and polarization-diversity-receiver scheme. The self-noise of DAS is further lowered by the phase averaging of multiple acoustic channels wound on the transducer. We found that, supported by this high-performance DAS, even if the transducer is made with an ultra-simple plastic structure in daily life, the system can achieve high-sensitivity airborne sound sensing. The proposed simple acoustic transducer can reach the sensitivity level of −106.5 dB re. 1 rad/μPa at a sensing range of 5.1 km, which can meet many demands on the industrial site