Towards Codable Watermarking for Injecting Multi-bits Information to LLMs

As large language models (LLMs) generate texts with increasing fluency and realism, there is a growing need to identify the source of texts to prevent the abuse of LLMs. Text watermarking techniques have proven reliable in distinguishing whether a text is generated by LLMs by injecting hidden patterns. However, we argue that existing LLM watermarking methods are encoding-inefficient and cannot flexibly meet the diverse information encoding needs (such as encoding model version, generation time, user id, etc.). In this work, we conduct the first systematic study on the topic of Codable Text Watermarking for LLMs (CTWL) that allows text watermarks to carry multi-bit customizable information. First of all, we study the taxonomy of LLM watermarking technologies and give a mathematical formulation for CTWL. Additionally, we provide a comprehensive evaluation system for CTWL: (1) watermarking success rate, (2) robustness against various corruptions, (3) coding rate of payload information, (4) encoding and decoding efficiency, (5) impacts on the quality of the generated text. To meet the requirements of these non-Pareto-improving metrics, we follow the most prominent vocabulary partition-based watermarking direction, and devise an advanced CTWL method named Balance-Marking. The core idea of our method is to use a proxy language model to split the vocabulary into probability-balanced parts, thereby effectively maintaining the quality of the watermarked text. Our code is available at https://github.com/lancopku/codable-watermarking-for-llm.Comment: ICLR 2024 poste

Syntrophic Growth of Geobacter sulfurreducens Accelerates Anaerobic Denitrification

Nitrate is considered as a contamination since it’s over discharging to water incurs environmental problems. However, nitrate is an ideal electron sink for anaerobic pollutant degraders desiring electron acceptors due to the high redox potential. Unfortunately, not all degraders can directly reduce nitrate, and the anaerobic direct interspecies electron transfer (DIET) between degraders and denitrifiers has not been confirmed yet. Here we demonstrated that syntrophic growth of Geobacter sulfurreducens PCA with denitrifying microbial community at anaerobic condition eliminated the lag phase of 15 h and improved the denitrification rate by 13∼51% over a broad C/N ratio of 0.5 to 9. Quantitative PCR revealed that G. sulfurreducens selectively enhanced the expression of nirS coding for a cytochrome cd1-nitrite reductase, resulting in a fast and more complete denitrification. Geobacter also selectively enriched its potential denitrifying partners – Diaphorobacter, Delftia, and Shinella – to form spherical aggregates. More studies of the binary culture system need to be carried out to confirm the syntrophic mechanism of Geobacter and denitrifiers in the future. These findings extend our knowledge on understanding the anaerobic bacterial interspecies electron transfer in the denitrification process, which has broader implications in fast selection and stabilization of denitrifiers in wastewater treatment plant, and general understanding of ecology for nitrogen and metal cycling

How strong is the linkage between tourism and economic growth in Europe?

In this study, we examine the dynamic relationship between tourism growth and economic growth, using a newly introduced spillover index approach. Based on monthly data for 10 European countries over the period 1995{2012, our analysis reveals the following empirical regularities. First, the tourism-economic growth relationship is not stable over time in terms of both magnitude and direction, indicating that the tourism{led economic growth (TLEG) and the economic{driven tourism growth (EDTG) hypotheses are time{dependent. Second, the aforementioned relationship is also highly economic event{dependent, as it is influenced by the Great Recession of 2007 and the ongoing Eurozone debt crisis that began in 2010. Finally, the impact of these economic events is more pronounced in Cyprus,Greece, Portugal and Spain, which are the European countries that have witnessed the greatest economic downturn since 2009. Plausible explanations of these results are provided and policy implications are drawn

The role of the Sun in atmosphere-ocean coupling

Copyright © 2013 Royal Meteorological SocietyAn overview of the processes involved in determining the Sun's influence on climate is presented in the form of a flow chart. Evidence and hypotheses concerning the combined influences of the El Niño-Southern Oscillation, the Quasi-Biennial Oscillation and the Solar Cycle on the Hadley and Walker circulations are discussed in the context of atmosphere–ocean coupling, focussing on the Pacific region. It is shown that the Sun plays a crucial role in ocean–atmosphere coupling but that this coupling appears to be disturbed during the latter half of the 20th century, probably related to climate change. The identification of a solar influence can lead to improved skill in prediction so as to better inform communities to address/mitigate some of the crucial issues that are associated with climate change.Natural Environment Research Council (NERC

Solar wind-atmospheric electricity-cloud microphysics connections to weather and climate

We review recent research articles that present observations of the large-scale day-to-day dynamic tropospheric response to changes in the downward current density Jz of the global atmospheric electric circuit (GEC). The evidence for the global circuit downward current density, Jz, causing changes in atmospheric dynamics is now even stronger than as reviewed by Tinsley (Reports on Progress in Physics volume 71, 2008). We consider proposed mechanisms for these responses, and suggest future directions for research

The effects of explicit versus parameterized convection on the MJO in a large-domain high-resolution tropical case study. Part I: Characterization of large-scale organization and propagation

High-resolution simulations over a large tropical domain (∼20◦S–20◦N and 42◦E–180◦E) using both explicit and parameterized convection are analyzed and compared to observations during a 10-day case study of an active Madden-Julian Oscillation (MJO) event. The parameterized convection model simulations at both 40 km and 12 km grid spacing have a very weak MJO signal and little eastward propagation. A 4 km explicit convection simulation using Smagorinsky subgrid mixing in the vertical and horizontal dimensions exhibits the best MJO strength and propagation speed. 12 km explicit convection simulations also perform much better than the 12 km parameterized convection run, suggesting that the convection scheme, rather than horizontal resolution, is key for these MJO simulations. Interestingly, a 4 km explicit convection simulation using the conventional boundary layer scheme for vertical subgrid mixing (but still using Smagorinsky horizontal mixing) completely loses the large-scale MJO organization, showing that relatively high resolution with explicit convection does not guarantee a good MJO simulation. Models with a good MJO representation have a more realistic relationship between lower-free-tropospheric moisture and precipitation, supporting the idea that moisture-convection feedback is a key process for MJO propagation. There is also increased generation of available potential energy and conversion of that energy into kinetic energy in models with a more realistic MJO, which is related to larger zonal variance in convective heating and vertical velocity, larger zonal temperature variance around 200 hPa, and larger correlations between temperature and ascent (and between temperature and diabatic heating) between 500–400 hPa

Need for weight management in Switzerland: findings from National Blood Pressure Week 2009

<p>Abstract</p> <p>Background</p> <p>The Swiss Health Survey (SHS) provides the only source of data for monitoring overweight and obesity in the general population in Switzerland. However, this survey reports body mass index (BMI) based on self-reported height and weight, and is therefore subject to measurement errors. Moreover, it is not possible to differentiate between overall and abdominal overweight. In this study, we aimed to gain a better understanding of the need for weight management in the general population of Switzerland by exploring and comparing prevalence rates of BMI and waist circumference (WC) based on physical measurements by trained observers, based on data from the 2009 National Blood Pressure Week (NBPW).</p> <p>Methods</p> <p>Sample selection was based on a one-stage cluster design. A total of 385 pharmacies representing 3,600 subjects were randomly selected from pharmacies participating in NBPW. BMI measures based on physical weight and height (NBPW) were compared with self-reported BMI measures from the SHS. BMI and WC measurements from NBPW were then used to produce population estimates of overweight and obesity.</p> <p>Results</p> <p>BMI-based overall prevalence of overweight and obesity was 43.6%, which was 4.7% higher than the value based on the respective SHS data. Overweight and obesity were more common in men (54.3%) than in women (33.5%). However, the overall prevalence of increased WC in the general population was estimated to be 64.4%, with more women (68.4%) than men (60.1%) exhibiting a WC above the threshold. The prevalence of subjects requiring weight management in the Swiss population remained high, even after adjusting WC for false positive and negative cases.</p> <p>Conclusions</p> <p>Firstly, it may be more appropriate for health promotion programs to address the wider group identified by WC, which includes subjects who need to reduce their weight, or gain no further weight. Secondly, the gender differences are reversed depending on the use of WC or BMI to identify subjects suitable for health promotion programs; more women than men are identified by WC, and more men than women using BMI. These differences should be accounted for in gender-specific health promotion programs.</p

Experiment design of the International CLIVAR C20C+ Detection and Attribution project

There is a growing research interest in understanding extreme weather in the context of anthropogenic climate change, posing a requirement for new tailored climate data products. Here we introduce the Climate of the 20th Century Plus Detection and Attribution project (C20C + D&A), an international collaboration generating a product specifically intended for diagnosing causes of changes in extreme weather and for understanding uncertainties in that diagnosis. The project runs multiple dynamical models of the atmosphere-land system under observed historical conditions as well as under naturalised versions of those observed conditions, with the latter representing how the climate system might have evolved in the absence of anthropogenic interference. Each model generates large ensembles of simulations with different initial conditions for each historical scenario, providing a large sample size for understanding interannual variability, long-term trends, and the anthropogenic role in rare types of weather. This paper describes the C20C + D&A project design, implementation, strengths, and limitations, and also discusses various activities such as this special issue of Weather and Climate Extremes dedicated to “First results of the C20C + Detection and Attribution project”

Skeletal Adaptation to Intramedullary Pressure-Induced Interstitial Fluid Flow Is Enhanced in Mice Subjected to Targeted Osteocyte Ablation

Interstitial fluid flow (IFF) is a potent regulatory signal in bone. During mechanical loading, IFF is generated through two distinct mechanisms that result in spatially distinct flow profiles: poroelastic interactions within the lacunar-canalicular system, and intramedullary pressurization. While the former generates IFF primarily within the lacunar-canalicular network, the latter generates significant flow at the endosteal surface as well as within the tissue. This gives rise to the intriguing possibility that loading-induced IFF may differentially activate osteocytes or surface-residing cells depending on the generating mechanism, and that sensation of IFF generated via intramedullary pressurization may be mediated by a non-osteocytic bone cell population. To begin to explore this possibility, we used the Dmp1-HBEGF inducible osteocyte ablation mouse model and a microfluidic system for modulating intramedullary pressure (ImP) to assess whether structural adaptation to ImP-driven IFF is altered by partial osteocyte depletion. Canalicular convective velocities during pressurization were estimated through the use of fluorescence recovery after photobleaching and computational modeling. Following osteocyte ablation, transgenic mice exhibited severe losses in bone structure and altered responses to hindlimb suspension in a compartment-specific manner. In pressure-loaded limbs, transgenic mice displayed similar or significantly enhanced structural adaptation to Imp-driven IFF, particularly in the trabecular compartment, despite up to ∼50% of trabecular lacunae being uninhabited following ablation. Interestingly, regression analysis revealed relative gains in bone structure in pressure-loaded limbs were correlated with reductions in bone structure in unpressurized control limbs, suggesting that adaptation to ImP-driven IFF was potentiated by increases in osteoclastic activity and/or reductions in osteoblastic activity incurred independently of pressure loading. Collectively, these studies indicate that structural adaptation to ImP-driven IFF can proceed unimpeded following a significant depletion in osteocytes, consistent with the potential existence of a non-osteocytic bone cell population that senses ImP-driven IFF independently and potentially parallel to osteocytic sensation of poroelasticity-derived IFF