Benchmarking Large Language Models on CMExam -- A Comprehensive Chinese Medical Exam Dataset

Recent advancements in large language models (LLMs) have transformed the field of question answering (QA). However, evaluating LLMs in the medical field is challenging due to the lack of standardized and comprehensive datasets. To address this gap, we introduce CMExam, sourced from the Chinese National Medical Licensing Examination. CMExam consists of 60K+ multiple-choice questions for standardized and objective evaluations, as well as solution explanations for model reasoning evaluation in an open-ended manner. For in-depth analyses of LLMs, we invited medical professionals to label five additional question-wise annotations, including disease groups, clinical departments, medical disciplines, areas of competency, and question difficulty levels. Alongside the dataset, we further conducted thorough experiments with representative LLMs and QA algorithms on CMExam. The results show that GPT-4 had the best accuracy of 61.6% and a weighted F1 score of 0.617. These results highlight a great disparity when compared to human accuracy, which stood at 71.6%. For explanation tasks, while LLMs could generate relevant reasoning and demonstrate improved performance after finetuning, they fall short of a desired standard, indicating ample room for improvement. To the best of our knowledge, CMExam is the first Chinese medical exam dataset to provide comprehensive medical annotations. The experiments and findings of LLM evaluation also provide valuable insights into the challenges and potential solutions in developing Chinese medical QA systems and LLM evaluation pipelines. The dataset and relevant code are available at https://github.com/williamliujl/CMExam

Converting brownmillerite to alternate layers of Oxygen-deficient and conductive nano-sheets with enhanced thermoelectric properties

Introducing large oxygen deficiencies while retaining low resistivity is important for enhancing the overall thermoelectric properties in 3d transition-metal oxides. In this study, a new synthesis route to reconstruct the insulating brownmillerite SrCoO2.5 is adapted. Through a step-by-step nano-blocks modification, a series of highly-conductive layered structures is evolved, which are [Sr2O2H2]0.5CoO2, [Sr2O2]0.4CoO2, and [Sr2CoO3]0.57CoO2, while still retaining considerable Seebeck coefficient (˜100 µV K-1). Coexistence of low resistivity and high oxygen deficiency is realized in the latter two polymorphs by forming a majority of sintered oxygen vacancies in the rock-salt layer and a minority of normal oxygen vacancies in the CoO2 layer. A room-temperature in-plane power factor of 3.6 mW K-2 m-1, power output density of 4.5 W m-2 at a temperature difference of 28 K, and an out-of-plane thermal conductivity of 0.33 W K-1 m-1 are obtained in the [Sr2O2]0.4CoO2 thin film that exhibits the highest oxygen deficiency (d = 2.95), which is on par with Bi2Te3, the benchmark. It is pointed out that proper distribution of oxygen vacancy is essential in tailoring the physical and chemical properties of transition-metal oxides. The sintered/normal oxygen vacancy layer model provides guidance to the exploration of materials with both low electric resistivity and thermal conductivity.Peer ReviewedPostprint (author's final draft

Effects of Different Inducers on Higher Alcohol Dehydrogenase from Galactomyces geotrichum

The inducers of the chemical or physical factors could affect the gene expression and transcription of strain directly or indirectly. In order to explore the inductive effect of higher alcohol on Galactomyces geotrichum, the G. geotrichum S12, derived from the soil, was induced by five higher alcohols, including n-propanol, n-butanol, isobutanol, n-hexanol and isoamyl alcohol. The effects of induction dose and induction time for degradation activity of different higher alcohols by strain S12 and its transforming enzyme were studied. The results showed that the enzyme activity formed by strain S12 was higher when the inducers were chosen as n-hexanol and isobutanol. The optimum induction time was 6 h when n-propanol, n-butanol, isobutanol and n-hexanol were used as inducers. While the optimum induction time of strain S12 and enzyme induced by isoamyl alcohol was 12 h. When n-propanol and n-hexanol were used as inducers, the optimal concentration was 1.5 g/L. While the optimal concentrations of strain S12 and enzyme induced by n-butanol, isobutanol and isoamyl alcohol were 1.0, 0.5 and 2.5 g/L, respectively. The results of native polyacryplamide gel electrophoresis (Native-PAGE) indicated that dehydrogenase formation, molecular weight about 223 kDa, was induced by five higher alcohols. In particular, the strain, induced by hexanol, had much higher capability in degrading five higher alcohols at the same time. The products of the above five higher alcohols after catalyzing by G. geotrichum S12 induced by hexanol were their corresponding acids and esters

A Consumer-tier based Visual-Brain Machine Interface for Augmented Reality Glasses Interactions

Objective.Visual-Brain Machine Interface(V-BMI) has provide a novel interaction technique for Augmented Reality (AR) industries. Several state-of-arts work has demonstates its high accuracy and real-time interaction capbilities. However, most of the studies employ EEGs devices that are rigid and difficult to apply in real-life AR glasseses application sceniraros. Here we develop a consumer-tier Visual-Brain Machine Inteface(V-BMI) system specialized for Augmented Reality(AR) glasses interactions. Approach. The developed system consists of a wearable hardware which takes advantages of fast set-up, reliable recording and comfortable wearable experience that specificized for AR glasses applications. Complementing this hardware, we have devised a software framework that facilitates real-time interactions within the system while accommodating a modular configuration to enhance scalability. Main results. The developed hardware is only 110g and 120x85x23 mm, which with 1 Tohm and peak to peak voltage is less than 1.5 uV, and a V-BMI based angry bird game and an Internet of Thing (IoT) AR applications are deisgned, we demonstrated such technology merits of intuitive experience and efficiency interaction. The real-time interaction accuracy is between 85 and 96 percentages in a commercial AR glasses (DTI is 2.24s and ITR 65 bits-min ). Significance. Our study indicates the developed system can provide an essential hardware-software framework for consumer based V-BMI AR glasses. Also, we derive several pivotal design factors for a consumer-grade V-BMI-based AR system: 1) Dynamic adaptation of stimulation patterns-classification methods via computer vision algorithms is necessary for AR glasses applications; and 2) Algorithmic localization to foster system stability and latency reduction.Comment: 15 pages,10 figure

High-conductive protonated layered oxides from H2O vapor-annealed brownmillerites

Protonated 3d transition-metal oxides often display low electronic conduction, which hampers their application in electric, magnetic, thermoelectric, and catalytic fields. Electronic conduction can be enhanced by co-inserting oxygen acceptors simultaneously. However, the currently used redox approaches hinder protons and oxygen ions co-insertion due to the selective switching issues. Here, a thermal hydration strategy for systematically exploring the synthesis of conductive protonated oxides from 3d transition-metal oxides is introduced. This strategy is illustrated by synthesizing a novel layered-oxide SrCoO3H from the brownmillerite SrCoO2.5. Compared to the insulating SrCoO2.5, SrCoO3H exhibits an unprecedented high electronic conductivity above room temperature, water uptake at 250 °C, and a thermoelectric power factor of up to 1.2 mW K-2 m-1 at 300 K. These findings open up opportunities for creating high-conductive protonated layered oxides by protons and oxygen ions co-doping.CC acknowledges support from the Spanish Ministry of Science, Innovation, and Universities under the “Ramón y Cajal” fellowship RYC2018-024947-I.Peer ReviewedPostprint (author's final draft

Efficacy of intra-arterial chemotherapy with sequential anti-PD-1 antibody in unresectable gastric cancer: A retrospective real-world study

BackgroundThe prognosis of unresectable gastric cancer is poor, while the efficacy of anti-PD antibodies has not been evaluated.MethodsPatients with unresectable gastric cancer who received intra-arterial chemotherapy (IAC) with sequential anti-PD-1 antibody as induction therapy in Jinling Hospital were retrospectively analyzed. The primary outcome is R0 resection rate. The secondary outcomes include safety, conversion surgery rate, overall survival (OS) and progression free survival (PFS) after postoperative IAC and anti-PD-1 treatments. Meanwhile, Tumor immunity in the microenvironment (TIME) before and after IAC was comprehensively dissected with multiplex immunofluorescence in order to detect possible mechanisms favoring anti-PD-1 treatment response.ResultsBetween May 2019 and October 2020, 36 patients received at least one cycle of IAC with sequential anti-PD-1 antibody in our institution. The objective response was achieved in 28 patients (77.8%). Thirty patients (83.3%) successfully underwent conversion surgery, among which R0 resection was managed in 25/30 patients, and 23.3% (7/30) was assessed as pathological complete remission. During the median follow-up period of 19.7 months, patients who underwent R0 resection displayed superior OS (HR 0.14 [95% CI 0.04-0.50], P < 0.0001) and PFS (HR 0.11 [0.03-0.44], P < 0.0001) than those who did not. Grade 3 adverse events (AEs) were only encountered in 19.4% patients, no grade 4 AEs observed. In TIME analysis, the number of tertiary lymphoid structures (TLSs) (P = 0.004) were greatly induced by IAC, as well as CD8+ T cells (P = 0.011) and PD-1+ cells (P = 0.025). Meanwhile, Tumor associated macrophages shifted towards anti-tumor M1-like subtypes, with CD68+CD163+ M2-like subpopulation significantly decreased (P = 0.04).ConclusionPreoperative IAC with sequential anti-PD-1 antibody exhibited promising clinical benefit for unresectable gastric cancer with remarkable conversion rate and R0 resection rate, and also prolonged survival as postoperative regimen. TIME transformation induced by ICA might mediate the additive effect with the immune checkpoint inhibitor

Identification of three species commonly known as “daqingye” by internal leaf anatomy and high-performance liquid chromatography analyses

The macroscopic and microscopic morphologies and indigo and indirubin concentration of the traditional Chinese medicine herbs Isatis indigotica Fort., Polygonum tinctorium Ait., and Baphicacanthus cusia (Nees) Bremek, all commonly known as “daqingye”, were determined and compared. The morphological analyses indicated that I. indigotica has leaves with winged petioles and no glandular hairs or crystals, P. tinctorium has leaves with membranous ocrea and clusters of calcium oxalate, and B. cusia has palisade cells in the mesophyll running over the main vein and single cells containing calcium carbonate crystals. Indigo and indirubin are chemical constituents that have been previously isolated from daqingye and were selected in this study as identification markers for high-performance liquid chromatography analysis due to their pharmacological activities. The chromatographic results showed that indigo and indirubin concentration varied significantly among the three species: high concentration of both indigo and indirubin were observed in I. indigotica, the highest concentration among the three daqingye plants was found in P. tinctorium but with low levels of indirubin, and the concentration of indigo and indirubin was quite low in B. cusia. In summary, three different species commonly known as daqingye were accurately distinguished by morphological observation, internal leaf anatomy analysis, and chromatographic analysis

Comparative genomics reveals adaptive evolution of Asian tapeworm in switching to a new intermediate host

Taenia saginata, Taenia solium and Taenia asiatica (beef, pork and Asian tapeworms, respectively) are parasitic flatworms of major public health and food safety importance. Among them, T. asiatica is a newly recognized species that split from T. saginata via an intermediate host switch ∼1.14 Myr ago. Here we report the 169- and 168-Mb draft genomes of T. saginata and T. asiatica. Comparative analysis reveals that high rates of gene duplications and functional diversifications might have partially driven the divergence between T. asiatica and T. saginata. We observe accelerated evolutionary rates, adaptive evolutions in homeostasis regulation, tegument maintenance and lipid uptakes, and differential/specialized gene family expansions in T. asiatica that may favour its hepatotropism in the new intermediate host. We also identify potential targets for developing diagnostic or intervention tools against human tapeworms. These data provide new insights into the evolution of Taenia parasites, particularly the recent speciation of T. asiatica

An emerging recombinant human enterovirus 71 responsible for the 2008 outbreak of Hand Foot and Mouth Disease in Fuyang city of China

Hand, foot and mouth disease (HFMD), a common contagious disease that usually affects children, is normally mild but can have life-threatening manifestations. It can be caused by enteroviruses, particularly Coxsackieviruses and human enterovirus 71 (HEV71) with highly variable clinical manifestations. In the spring of 2008, a large, unprecedented HFMD outbreak in Fuyang city of Anhui province in the central part of southeastern China resulted in a high aggregation of fatal cases. In this study, epidemiologic and clinical investigations, laboratory testing, and genetic analyses were performed to identify the causal pathogen of the outbreak. Of the 6,049 cases reported between 1 March and 9 May of 2008, 3023 (50%) were hospitalized, 353 (5.8%) were severe and 22 (0.36%) were fatal. HEV71 was confirmed as the etiological pathogen of the outbreak. Phylogenetic analyses of entire VP1 capsid protein sequence of 45 Fuyang HEV71 isolates showed that they belong to C4a cluster of the C4 subgenotype. In addition, genetic recombinations were found in the 3D region (RNA-dependent RNA polymerase, a major component of the viral replication complex of the genome) between the Fuyang HEV71 strain and Coxsackievirus A16 (CV-A16), resulting in a recombination virus. In conclusion, an emerging recombinant HEV71 was responsible for the HFMD outbreak in Fuyang City of China, 2008

A novel HD-Zip I/C2H2-ZFP/WD-repeat complex regulates the size of spine base in cucumber

Fruit spine is an important trait in cucumber, affecting not only commercial quality, but also fruit smoothness, transportation and storage. Spine size is determined by a multi-cellular base. However, the molecular mechanism underlying the regulation of cucumber spine base remains largely unknown. Here, we report map-based cloning and characterization of a spine base size 1 (SBS1) gene, encoding a C2H2 zinc-finger transcription factor.Near-isogenic lines of cucumber were used to map, identify and quantify cucumber spine base size 1 (CsSBS1). Yeast-hybrid, bimolecular fluorescence complementation (BiFC), co-immunoprecipitation (Co-IP) and RNA-sequencing assays were used to explore the molecular mechanism of CsSBS1 in regulating spine base size development.CsSBS1 was specifically expressed in cucumber ovaries with particularly high expression in fruit spines. Overexpression of CsSBS1 resulted in large fruit spine base, while RNA-interference silencing of CsSBS1 inhibited the expansion of fruit spine base. Sequence analysis of natural cucumber accessions revealed that CsSBS1 was lost in small spine base accessions, resulting from a 4895 bp fragment deletion in CsSBS1 locus. CsSBS1 can form a trimeric complex with two positive regulators CsTTG1 and CsGL1 to regulate spine base development through ethylene signaling.A novel regulator network is proposed that the CsGL1/CsSBS1/CsTTG1 complex plays a significant role in regulating spine base formation and size, which offers a strategy for cucumber breeders to develop smooth fruit.This work was supported by the National Natural Science Foundation of China (31902020, 31972427), the Zhongyuan Youth Talent Program (ZYQR201912161), the Key Research Project of Henan institutions of higher learning (20A210015), the Program for Science & Technology Innovation Talents of Henan Province (21HASTIT038), and the Major Science and Technology Projects of Henan Province (201300111300).Peer reviewe