Marketing Budget Allocation with Offline Constrained Deep Reinforcement Learning

We study the budget allocation problem in online marketing campaigns that utilize previously collected offline data. We first discuss the long-term effect of optimizing marketing budget allocation decisions in the offline setting. To overcome the challenge, we propose a novel game-theoretic offline value-based reinforcement learning method using mixed policies. The proposed method reduces the need to store infinitely many policies in previous methods to only constantly many policies, which achieves nearly optimal policy efficiency, making it practical and favorable for industrial usage. We further show that this method is guaranteed to converge to the optimal policy, which cannot be achieved by previous value-based reinforcement learning methods for marketing budget allocation. Our experiments on a large-scale marketing campaign with tens-of-millions users and more than one billion budget verify the theoretical results and show that the proposed method outperforms various baseline methods. The proposed method has been successfully deployed to serve all the traffic of this marketing campaign.Comment: WSDM 23, Best Paper Candidat

Novel Yersinia enterocolitica Prophages and a Comparative Analysis of Genomic Diversity

Yersinia enterocolitica is a major agent of foodborne diseases worldwide. Prophage plays an important role in the genetic evolution of the bacterial genome. Little is known about the genetic information about prophages in the genome of Y. enterocolitica, and no pathogenic Y. enterocolitica prophages have been described. In this study, we induced and described the genomes of six prophages from pathogenic Y. enterocolitica for the first time. Phylogenetic analysis based on whole genome sequencing revealed that these novel Yersinia phages are genetically distinct from the previously reported phages, showing considerable genetic diversity. Interestingly, the prophages induced from O:3 and O:9 Y. enterocolitica showed different genomic sequences and morphology but highly conserved among the same serotype strains, which classified into two diverse clusters. The three long-tailed Myoviridae prophages induced from serotype O:3 Y. enterocolitica were highly conserved, shared ≥99.99% identity and forming genotypic cluster A; the three Podoviridae prophages induced from the serotype O:9 strains formed cluster B, also shared more than 99.90% identity with one another. Cluster A was most closely related to O:5 non-pathogenic Y. enterocolitica prophage PY54 (61.72% identity). The genetic polymorphism of these two kinds of prophages and highly conserved among the same serotype strains, suggested a possible shared evolutionary past for these phages: originated from distinct ancestors, and entered pathogenic Y. enterocolitica as extrachromosomal genetic components during evolution when facing selective pressure. These results are critically important for further understanding of phage roles in host physiology and the pathology of disease

Multiple-Locus Variable-Number Tandem-Repeat Analysis of Pathogenic Yersinia enterocolitica in China

The predominant bioserotypes of pathogenic Yersinia enterocolitica in China are 2/O: 9 and 3/O: 3; no pathogenic O: 8 strains have been found to date. Multiple-Locus Variable-Number Tandem-Repeat Analysis (MLVA) based on seven loci was able to distinguish 104 genotypes among 218 pathogenic Y. enterocolitica isolates in China and from abroad, showing a high resolution. The major pathogenic serogroups in China, O: 3 and O: 9, were divided into two clusters based on MLVA genotyping. The different distribution of Y. enterocolitica MLVA genotypes maybe due to the recent dissemination of specific clones of 2/O: 9 and 3/O: 3 strains in China. MLVA was a helpful tool for bacterial pathogen surveillance and investigation of pathogenic Y. enterocolitica outbreaks

Comparison and Evaluation of the Molecular Typing Methods for Toxigenic Vibrio cholerae in Southwest China

Vibrio cholerae O1 strains taken from the repository of Yunnan province, southwest China, were abundant and special. We selected 70 typical toxigenic V. cholerae (69 O1 and one O139 serogroup strains) isolated from Yunnan province, performed the pulsed field gel electrophoresis (PFGE), multilocus sequence typing (MLST), and MLST of virulence gene (V-MLST) methods, and evaluated the resolution abilities for typing methods. The ctxB subunit sequence analysis for all strains have shown that cholera between 1986 and 1995 was associated with mixed infections with El Tor and El Tor variants, while infections after 1996 were all caused by El Tor variant strains. Seventy V. cholerae obtained 50 PFGE patterns, with a high resolution. The strains could be divided into three groups with predominance of strains isolated during 1980s, 1990s, and 2000s, respectively, showing a good consistency with the epidemiological investigation. We also evaluated two MLST method for V. cholerae, one was used seven housekeeping genes (adk, gyrB, metE, pntA, mdh, purM, and pyrC), and all the isolates belonged to ST69; another was used nine housekeeping genes (cat, chi, dnaE, gyrB, lap, pgm, recA, rstA, and gmd). A total of seven sequence types (STs) were found by using this method for all the strains; among them, rstA gene had five alleles, recA and gmd have two alleles, and others had only one allele. The virulence gene sequence typing method (ctxAB, tcpA, and toxR) showed that 70 strains were divided into nine STs; among them, tcpA gene had six alleles, toxR had five alleles, while ctxAB was identical for all the strains. The latter two sequences based typing methods also had consistency with epidemiology of the strains. PFGE had a higher resolution ability compared with the sequence based typing method, and MLST used seven housekeeping genes showed the lower resolution power than nine housekeeping genes and virulence genes methods. These two sequence typing methods could distinguish some epidemiological special strains in local area

Comparative analysis of shotgun metagenomics and 16S rDNA sequencing of gut microbiota in migratory seagulls

Background Shotgun metagenomic and 16S rDNA sequencing are commonly used methods to identify the taxonomic composition of microbial communities. Previously, we analysed the gut microbiota and intestinal pathogenic bacteria configuration of migratory seagulls by using 16S rDNA sequencing and culture methods. Methods To continue in-depth research on the gut microbiome and reveal the applicability of the two methods, we compared the metagenome and 16S rDNA amplicon results to further demonstrate the features of this animal. Results The number of bacterial species detected by metagenomics gradually increased from the phylum to species level, consistent with 16S rDNA sequencing. Several taxa were commonly shared by both sequencing methods. However, Escherichia, Shigella, Erwinia, Klebsiella, Salmonella, Escherichia albertii, Shigella sonnei, Salmonella enterica, and Shigella flexneri were unique taxa for the metagenome compared with Escherichia-Shigella, Hafnia-Obesumbacterium, Catellicoccus marimammalium, Lactococcus garvieae, and Streptococcus gallolyticus for 16S rDNA sequencing. The largest differences in relative abundance between the two methods were identified at the species level, which identified many pathogenic bacteria to humans using metagenomic sequencing. Pearson correlation analysis indicated that the correlation coefficient for the two methods gradually decreased with the refinement of the taxonomic levels. The high consistency of the correlation coefficient was identified at the genus level for the beta diversity of the two methods. Conclusions In general, relatively consistent patterns and reliability could be identified by both sequencing methods, but the results varied following the refinement of taxonomic levels. Metagenomic sequencing was more suitable for the discovery and detection of pathogenic bacteria of gut microbiota in seagulls. Although there were large differences in the numbers and abundance of bacterial species of the two methods in terms of taxonomic levels, the patterns and reliability results of the samples were consistent

Effects of Shen-Fu Injection on the Expression of T-Cell-Specific Transcription Factors T-bet/Gata-3 in Porcine Postresuscitation Lung Injury

Shen-Fu injection (SFI) derived from the ancient traditional Chinese medicine. In this study, the effects of SFI on the expression of T-bet/GATA-3 and its potential mechanisms causing the shift of T cells from Th2 to Th1 on postresuscitation lung injury were examined in a porcine model of cardiac arrest. 30 pigs were randomly divided into SHAM () and three return of spontaneous circulation (ROSC) groups ( per group); 24 pigs were subjected to 8 min of electrically induced cardiac arrest and 2 min of basic life support, which received central venous injection of Shen-Fu (SFI), epinephrine (EP) or saline (SA). After successful ROSC, 18 surviving pigs were sacrificed at 24 h after ROSC ( per group). The levels of serum and lung tissue interleukin (IL)-4 and interferon (IFN)-γ were measured by ELISA, and the protein and mRNA levels of GATA-3 and T-bet in the lung tissue were determined by western blotting and quantitative real-time polymerase chain reaction, respectively. Compared with the EP and SA groups, SFI treatment reduced the levels of IL-4 (), increased levels of IFN-γ (), and induced T-bet mRNA upregulation and GATA-3 mRNA downregulation (). SFI attenuated lung injury and regulated lung immune disorders. Therefore, SFI could protect postresuscitation lung injury by modulating a Th1/Th2 imbalance

Unraveling ultrasonic assisted aqueous-phase one-step synthesis of porous PtPdCu nanodendrites for methanol oxidation with a CO-poisoning tolerance

The tailored design of tri-metallic Pt-based porous nanodendrites (PNDs) is crucial for green energy production technologies, ascribed to their fancy features, great surface areas, accessible active sites, and stability against aggregation. However, their aqueous-phase one-step synthesis at room temperature remains a daunting challenge. Herein, we present a facile, green, and template-free approach for the one-step synthesis of PtPdCu PNDs by ultrasonication of an aqueous solution of metal salts and Pluronic F127 at 25 ℃, based on natural isolation among nucleation and growth step driven by the disparate reduction kinetics of the metals and acoustic cavitation mechanism of ultrasonic waves. The resultant PtPdCu PNDs formed in a spatial nanodendritic shape with a dense array of branches, open corners, interconnected pores, high surface area (46.9 m2/g), and high Cu content (21 %). The methanol oxidation reaction (MOR) mass activity of PtPdCu PNDs (3.66 mA/µgPt) is 1.45, 2.73, and 2.83 times higher than those of PtPd PNDs, PtCu PNDs, and commercial Pt/C, respectively based on equivalent Pt mass, which is superior to previous PtPdCu catalysts reported elsewhere, besides a superior durability and CO-poisoning tolerance. This study may pave the way for the controlled fabrication of ternary Pt-based PNDs for various electrocatalytic applications

Robustness of Learning from Task Instructions

Traditional supervised learning mostly works on individual tasks and requires training on a large set of task-specific examples. This paradigm seriously hinders the development of task generalization since preparing a task-specific example set is costly. To build a system that can quickly and easily generalize to new tasks, task instructions have been adopted as an emerging trend of supervision recently. These instructions give the model the definition of the task and allow the model to output the appropriate answer based on the instructions and inputs. However, task instructions are often expressed in different forms, which can be interpreted from two threads: first, some instructions are short sentences and are pretrained language model (PLM) oriented, such as prompts, while other instructions are paragraphs and are human-oriented, such as those in Amazon MTurk; second, different end-users very likely explain the same task with instructions of different textual expressions. A robust system for task generalization should be able to handle any new tasks regardless of the variability of instructions. However, the system robustness in dealing with instruction-driven task generalization is still unexplored. This work investigates the system robustness when the instructions of new tasks are (i) manipulated, (ii) paraphrased, or (iii) from different levels of conciseness. To our knowledge, this is the first work that systematically studies how robust a PLM is when it is supervised by instructions with different factors of variability.Comment: ACL'23 Finding Accepte

Compost Addition Enhanced Hyphal Growth and Sporulation of Arbuscular Mycorrhizal Fungi without Affecting Their Community Composition in the Soil

Arbuscular mycorrhizal (AM) fungi form symbiotic associations with most crop plant species in agricultural ecosystems, and are conspicuously influenced by various agricultural practices. To understand the impact of compost addition on AM fungi, we examined effect of four compost rates (0, 11.25, 22.5, and 45 Mg/ha) on the abundance and community composition of AM fungi in seedling, flowering, and mature stage of soybean in a 1-year compost addition experiment system in Northeast China. Soybean [Glycine max (L.) Merrill] was used as test plant. Moderate (22.5 Mg/ha) and high (45 Mg/ha) levels of compost addition significantly increased AM root colonization and extraradical hyphal (ERH) density compared with control, whereas low (11.5 Mg/ha) level of compost addition did not cause significant increase in AM root colonization and ERH density. AM fungal spore density was significantly enhanced by all the compost rates compared with control. The temporal variations analysis revealed that, AM root colonization in seedling stage was significantly lower than in flowering and mature stage. Although AM fungal operational taxonomic unit richness and community composition was unaffected by compost addition, some abundant AM fungal species showed significantly different response to compost addition. In mature stage, Rhizophagus fasciculatum showed increasing trend along with compost addition gradient, whereas the opposite was observed with Paraglomus sp. In addition, AM fungal community composition exhibited significant temporal variation during growing season. Further analysis indicated that the temporal variation in AM fungal community only occurred in control treatment, but not in low, moderate, and high level of compost addition treatments. Our findings highlighted the significant effects of compost addition on AM growth and sporulation, and emphasized that growth stage is a stronger determinant than 1-year compost addition in shaping AM fungal community in black soil of Northeast China