Compositional Exemplars for In-context Learning

Large pretrained language models (LMs) have shown impressive In-Context Learning (ICL) ability, where the model learns to do an unseen task via a prompt consisting of input-output examples as the demonstration, without any parameter updates. The performance of ICL is highly dominated by the quality of the selected in-context examples. However, previous selection methods are mostly based on simple heuristics, leading to sub-optimal performance. In this work, we formulate in-context example selection as a subset selection problem. We propose CEIL (Compositional Exemplars for In-context Learning), which is instantiated by Determinantal Point Processes (DPPs) to model the interaction between the given input and in-context examples, and optimized through a carefully-designed contrastive learning objective to obtain preference from LMs. We validate CEIL on 12 classification and generation datasets from 7 distinct NLP tasks, including sentiment analysis, paraphrase detection, natural language inference, commonsense reasoning, open-domain question answering, code generation, and semantic parsing. Extensive experiments demonstrate not only the state-of-the-art performance but also the transferability and compositionality of CEIL, shedding new light on effective and efficient in-context learning. Our code is released at https://github.com/HKUNLP/icl-ceil.Comment: Accepted in ICML 202

A network SIS meta-population model with transportation flow

This paper considers a deterministic Susceptible-Infected-Susceptible (SIS) metapopulation model for the spread of a disease in a strongly connected network, where each node represents a large population. Individuals can travel between the nodes (populations). We derive a necessary and sufficient condition for the healthy equilibrium to be the unique equilibrium of the system, and then in fact it is asymptotically stable for all initial conditions (a sufficient condition for exponential stability is also given). If the condition is not satisfied, then there additionally exists a unique endemic equilibrium which is exponentially stable for all nonzero initial conditions. We then consider time-delay in the travel between nodes, and further investigate the role of the mobility rate that governs the flow of individuals between nodes in determining the convergence properties. We find that sometimes, increasing mobility helps the system converge to the healthy equilibrium.</p

AIGC Empowering Telecom Sector White Paper_chinese

In the global craze of GPT, people have deeply realized that AI, as a transformative technology and key force in economic and social development, will bring great leaps and breakthroughs to the global industry and profoundly influence the future world competition pattern. As the builder and operator of information and communication infrastructure, the telecom sector provides infrastructure support for the development of AI, and even takes the lead in the implementation of AI applications. How to enable the application of AIGC (GPT) and implement AIGC in the telecom sector are questions that telecom practitioners must ponder and answer. Through the study of GPT, a typical representative of AIGC, the authors have analyzed how GPT empowers the telecom sector in the form of scenarios, discussed the gap between the current GPT general model and telecom services, proposed for the first time a Telco Augmented Cognition capability system, provided answers to how to construct a telecom service GPT in the telecom sector, and carried out various practices. Our counterparts in the industry are expected to focus on collaborative innovation around telecom and AI, build an open and shared innovation ecosystem, promote the deep integration of AI and telecom sector, and accelerate the construction of next-generation information infrastructure, in an effort to facilitate the digital transformation of the economy and society

Spatial convergence characteristics of low carbon economy and economic growth quality: based on Guangdong urban data

As China's economy transitions from a stage of high-speed growth to a stage of high-quality development, the concept of low-carbon and green economic development has gained increasing popularity. Mastering the regional differences and changing patterns of low-carbon economy and economic growth quality is an important prerequisite for further promoting low-carbon economic development and improving the quality of economic growth. Taking the data of 21 prefecture-level cities in Guangdong Province from 2008 to 2019 as examples, we calculated the low-carbon economy and the quality index of economic growth, and analyzed the convergences between them through coefficient of variation analysis and a panel data convergence model with fixed effects. The results showed that: First, the convergence of low-carbon economy was better than the convergence of economic growth quality. Second, the low-carbon economy of Guangdong Province had σ convergence, and the imbalance between regions of low-carbon economy was alleviated, but the quality of economic growth of Guangdong Province did not have σ convergence. Third, there was absolute and conditional β convergence in the quality of low-carbon economy and economic growth in Guangdong Province. Fourth, the convergence rate of low-carbon economy in Guangdong Province showed "club difference"; the same was true of σ convergence, absolute β convergence, conditional β convergence, and dimensional convergence of economic growth quality in various regions of Guangdong Province. The exploration conducted in this article was conducive to better grasping the changing patterns of low-carbon economy and economic growth quality, enriching relevant research. The conclusions of this paper can provide decision-making basis for China to formulate urban and regional economic policies, achieve high-quality economic development, and "double carbon goal"

Polycyclopentene crystal-decorated carbon nanotubes by convenient large-scale in situ polymerization and their lotus leaf-like superhydrophobic films.

In situ Pd-catalyzed cyclopentene polymerization in the presence of multi-walled carbon nanotubes (MWCNTs) is demonstrated to effectively render, on a large scale, polycyclopentene-crystal-decorated MWCNTs. Controlling the catalyst loading and/or time in the polymerization offers a convenient tuning of the polymer content and the morphology of the decorated MWCNTs. Appealingly, films made of the decorated carbon nanotubes through simple vacuum filtration show the characteristic lotus-leaf-like superhydrophobicity with high water contact angle (>150°), low contact angle hysteresis (<10°), and low water adhesion, while being electrically conductive. This is the first demonstration of the direct fabrication of lotus-leaf-like superhydrophobic films with solution-grown polymer-crystal-decorated carbon nanotube

ATP6L promotes metastasis of colorectal cancer by inducing epithelial-mesenchymal transition

ATP6L, the C subunit of the V-ATPase V0 domain, is involved in regulating the acidic tumor micro-environment and may promote tumor progression. However, the expression and functional role of ATP6L in tumors have not yet been well explored. In this study, we found that ATP6L protein overexpression was related to colorectal cancer histological differentiation (P <0.001), presence of metastasis (P <0.001) and recurrence (P = 0.02). ATP6L expression in the liver metastatic foci was higher than in the primary foci (P = 0.04). ATP6L expression was notably concomitant with epithelial-mesenchymal transition (EMT) immunohistochemical features, such as reduced expression of the epithelial marker E-cadherin (P = 0.021) and increased expression of the mesenchymal marker vimentin (P = 0.004). Results of in vitro and in vivo experiments showed that ATP6L expression could alter cell morphology, regulate EMT-associated protein expression, and enhance migration and invasion. The effect of ATP6L on metastasis was further demonstrated in a tail vein injection mice model. In addition, the mouse xenograft model showed that ATP6L-overexpressing HCT116 cells grew into larger tumor masses, showed less necrosis and formed more micro-vessels than the control cells. Taken together, our results suggest that ATP6L promotes metastasis of colorectal cancer by inducing EMT and angiogenesis, and is a potential target for tumor therapy