Electrotunable liquid sulfur microdroplets.

Manipulating liquids with tunable shape and optical functionalities in real time is important for electroactive flow devices and optoelectronic devices, but remains a great challenge. Here, we demonstrate electrotunable liquid sulfur microdroplets in an electrochemical cell. We observe electrowetting and merging of sulfur droplets under different potentiostatic conditions, and successfully control these processes via selective design of sulfiphilic/sulfiphobic substrates. Moreover, we employ the electrowetting phenomena to create a microlens based on the liquid sulfur microdroplets and tune its characteristics in real time through changing the shape of the liquid microdroplets in a fast, repeatable, and controlled manner. These studies demonstrate a powerful in situ optical battery platform for unraveling the complex reaction mechanism of sulfur chemistries and for exploring the rich material properties of the liquid sulfur, which shed light on the applications of liquid sulfur droplets in devices such as microlenses, and potentially other electrotunable and optoelectronic devices

Controlled drug delivery systems in eradicating bacterial biofilm-associated infections

Drug delivery systems (DDS) have extensively progressed over the past decades for eradicating the bacteria embedded in biofilms while minimizing the side effects of antimicrobials on the normal tissues. They possess potential in solving the challenges of intrinsic antimicrobial-resistance and poor penetration of antimicrobials into biofilms. However, the guidelines for developing a controlled DDS for combating bacterial biofilms are limited. In this review, classical mechanisms and mathematical models of DDS were summarized in order to lay the foundation of controlled DDS development. Strategies for building controlled DDS were proposed based on the process of biofilm formation, including surface coatings, fibers, nanoparticles as DDS to prevent biofilm formation and eradicate bacterial biofilm-associated infections. The challenges that still remain in DDS design were discussed and future directions were suggested. We hope this review could give a "road map" to inspire readers and boost the development of the new generation of controlled drug release system for antimicrobial applications

Killing Two Birds with One Stone: Quantization Achieves Privacy in Distributed Learning

Communication efficiency and privacy protection are two critical issues in distributed machine learning. Existing methods tackle these two issues separately and may have a high implementation complexity that constrains their application in a resource-limited environment. We propose a comprehensive quantization-based solution that could simultaneously achieve communication efficiency and privacy protection, providing new insights into the correlated nature of communication and privacy. Specifically, we demonstrate the effectiveness of our proposed solutions in the distributed stochastic gradient descent (SGD) framework by adding binomial noise to the uniformly quantized gradients to reach the desired differential privacy level but with a minor sacrifice in communication efficiency. We theoretically capture the new trade-offs between communication, privacy, and learning performance

The Tradeoff Between Privacy and Accuracy in Anomaly Detection Using Federated XGBoost

Privacy has raised considerable concerns recently, especially with the advent of information explosion and numerous data mining techniques to explore the information inside large volumes of data. In this context, a new distributed learning paradigm termed federated learning becomes prominent recently to tackle the privacy issues in distributed learning, where only learning models will be transmitted from the distributed nodes to servers without revealing users' own data and hence protecting the privacy of users. In this paper, we propose a horizontal federated XGBoost algorithm to solve the federated anomaly detection problem, where the anomaly detection aims to identify abnormalities from extremely unbalanced datasets and can be considered as a special classification problem. Our proposed federated XGBoost algorithm incorporates data aggregation and sparse federated update processes to balance the tradeoff between privacy and learning performance. In particular, we introduce the virtual data sample by aggregating a group of users' data together at a single distributed node. We compute parameters based on these virtual data samples in the local nodes and aggregate the learning model in the central server. In the learning model upgrading process, we focus more on the wrongly classified data before in the virtual sample and hence to generate sparse learning model parameters. By carefully controlling the size of these groups of samples, we can achieve a tradeoff between privacy and learning performance. Our experimental results show the effectiveness of our proposed scheme by comparing with existing state-of-the-arts

Layered Randomized Quantization for Communication-Efficient and Privacy-Preserving Distributed Learning

Next-generation wireless networks, such as edge intelligence and wireless distributed learning, face two critical challenges: communication efficiency and privacy protection. In this work, our focus is on addressing these issues in a distributed learning framework. We consider a new approach that simultaneously achieves communication efficiency and privacy protection by exploiting the privacy advantage offered by quantization. Specifically, we use a quantization scheme called \textbf{Gau}ssian \textbf{L}ayered \textbf{R}andomized \textbf{Q}uantization (Gau-LRQ) that compresses the raw model gradients using a layer multishift coupler. By adjusting the parameters of Gau-LRQ, we shape the quantization error to follow the expected Gaussian distribution, thus ensuring client-level differential privacy (CLDP). We demonstrate the effectiveness of our proposed Gau-LRQ in the distributed stochastic gradient descent (SGD) framework and theoretically quantify the trade-offs between communication, privacy, and convergence performance. We further improve the convergence performance by enabling dynamic private budget and quantization bit allocation. We achieve this by using an optimization formula that minimizes convergence error subject to the privacy budget constraint. We evaluate our approach on multiple datasets, including MNIST, CIFAR-10, and CIFAR-100, and show that our proposed method outperforms the baselines in terms of learning performance under various privacy constraints. Moreover, we observe that dynamic privacy allocation yields additional accuracy improvements for the models compared to the fixed scheme

Understanding and Patching Compositional Reasoning in LLMs

LLMs have marked a revolutonary shift, yet they falter when faced with compositional reasoning tasks. Our research embarks on a quest to uncover the root causes of compositional reasoning failures of LLMs, uncovering that most of them stem from the improperly generated or leveraged implicit reasoning results. Inspired by our empirical findings, we resort to Logit Lens and an intervention experiment to dissect the inner hidden states of LLMs. This deep dive reveals that implicit reasoning results indeed surface within middle layers and play a causative role in shaping the final explicit reasoning results. Our exploration further locates multi-head self-attention (MHSA) modules within these layers, which emerge as the linchpins in accurate generation and leveraing of implicit reasoning results. Grounded on the above findings, we develop CREME, a lightweight method to patch errors in compositional reasoning via editing the located MHSA modules. Our empirical evidence stands testament to CREME's effectiveness, paving the way for autonomously and continuously enhancing compositional reasoning capabilities in language models.Comment: Accepted by ACL'2024 Finding

From Knowing to Doing: Learning Diverse Motor Skills through Instruction Learning

Recent years have witnessed many successful trials in the robot learning field. For contact-rich robotic tasks, it is challenging to learn coordinated motor skills by reinforcement learning. Imitation learning solves this problem by using a mimic reward to encourage the robot to track a given reference trajectory. However, imitation learning is not so efficient and may constrain the learned motion. In this paper, we propose instruction learning, which is inspired by the human learning process and is highly efficient, flexible, and versatile for robot motion learning. Instead of using a reference signal in the reward, instruction learning applies a reference signal directly as a feedforward action, and it is combined with a feedback action learned by reinforcement learning to control the robot. Besides, we propose the action bounding technique and remove the mimic reward, which is shown to be crucial for efficient and flexible learning. We compare the performance of instruction learning with imitation learning, indicating that instruction learning can greatly speed up the training process and guarantee learning the desired motion correctly. The effectiveness of instruction learning is validated through a bunch of motion learning examples for a biped robot and a quadruped robot, where skills can be learned typically within several million steps. Besides, we also conduct sim-to-real transfer and online learning experiments on a real quadruped robot. Instruction learning has shown great merits and potential, making it a promising alternative for imitation learning

Status and Factors Associated with Healthcare Choices Among Older Adults and Children in an Urbanized County: A Cross-Sectional Study in Kunshan, China

As important unit for regional health planning, urbanized counties are facing challenges because of internal migrants and aging. This study took urbanized counties in China as cases and two key populations as objects to understand different populations’ intentions of choosing corresponding health service resources and to provide support for resource allocation. A cross-sectional study was conducted in Kunshan, a highly urbanized county in China, in 2016, among older adults aged 60 or over and children aged 0–6. Multinomial logistics models were used to identify the factors associated with healthcare choices. In this study, we found that income, distance of the tertiary provider, and migrant status were not associated with choices of tertiary healthcare outside county for children, while parents’ education level was. The responsiveness of the tertiary provider inside the county was lower than primary and secondary providers inside the county, while respondents were dissatisfied with the medical technology and medical facility for the tertiary inside the county compared to those of the tertiary provider outside the county. Significant differences existed in terms of the perception of different categories of institutions. To conclude, local governments should particularly seek to strengthen pediatric primary health services and improve the responsiveness of healthcare facilities to treat geriatric and pediatric diseases, which also bring significance to the developing countries in the process of urbanization