Training Large-Vocabulary Neural Language Models by Private Federated Learning for Resource-Constrained Devices

Federated Learning (FL) is a technique to train models using data distributed across devices. Differential Privacy (DP) provides a formal privacy guarantee for sensitive data. Our goal is to train a large neural network language model (NNLM) on compute-constrained devices while preserving privacy using FL and DP. However, the DP-noise introduced to the model increases as the model size grows, which often prevents convergence. We propose Partial Embedding Updates (PEU), a novel technique to decrease noise by decreasing payload size. Furthermore, we adopt Low Rank Adaptation (LoRA) and Noise Contrastive Estimation (NCE) to reduce the memory demands of large models on compute-constrained devices. This combination of techniques makes it possible to train large-vocabulary language models while preserving accuracy and privacy

A Deep Insight into Ferroptosis in Renal Disease: Facts and Perspectives

Background: Ferroptosis, a newly recognized form of programmed cell death, is distinguished by its reliance on reactive oxygen species and iron-mediated lipid peroxidation, setting it apart from established types like apoptosis, cell necrosis, and autophagy. Recent studies suggest its role in exacerbating or mitigating diseases by influencing metabolic and signaling pathways in conditions such as tumors and ischemic organ damage. Evidence also links ferroptosis to various kidney diseases, prompting a review of its research status and potential breakthroughs in understanding and treating these conditions. Summary: In acute kidney disease (AKI), ferroptosis has been confirmed in animal kidneys after being induced by various factors such as renal ischemia-reperfusion and cisplatin, and glutathione peroxidase 4 (GPX4) is linked with AKI. Ferroptosis is associated with renal fibrosis in chronic kidney disease (CKD), TGF-β1 being crucial in this regard. In diabetic nephropathy (DN), high SLC7A11 and low nuclear receptor coactivator 4 (NCOA4) expressions are linked to disease progression. For polycystic kidney disease (PKD), ferroptosis promotes the disease by regulating ferroptosis in kidney tissue. Renal cell carcinoma (RCC) and lupus nephritis (LN) also have links to ferroptosis, with mtDNA and iron accumulation causing RCC and oxidative stress causing LN. Key Messages: Ferroptosis is a newly identified form of programmed cell death that is associated with various diseases. It targets metabolic and signaling pathways and has been linked to kidney diseases such as AKI, CKD, PKD, DN, LN, and clear cell RCC. Understanding its role in these diseases could lead to breakthroughs in their pathogenesis, etiology, and treatment

Childhood Influenza Vaccination and Its Determinants during 2020-2021 Flu Seasons in China: A Cross-Sectional Survey.

Young children aged 6−59 months are recommended as one of the priority groups for seasonal influenza vaccination in China. This study assessed influenza vaccination coverage and the factors associated with vaccination uptake among children in three Chinese provinces. In September 2021, 2081 caregivers with children <5 years completed self-administered questionnaires as part of a cross-sectional survey. Logistic regression was used to assess determinants of childhood influenza vaccination. A total of 43.63% of respondents reported vaccinating their children against influenza during the 2020−2021 flu season. Caregivers who lived in Anhui province, had a bachelor degree or above, and an annual household income <20,000 RMB were more likely to vaccinate their children against influenza. Confidence in the importance (OR: 2.50; 95%CI: 1.77−3.54), safety (OR: 1.60; 95%CI: 1.29−1.99), and effectiveness (OR: 1.54; 95%CI: 1.23−1.93) of influenza vaccine was significantly associated with childhood vaccine acceptance. Respondents who saw that other caregivers were vaccinating their children had significantly higher odds of vaccinating their own children. Caregivers’ receiving positive influence from healthcare workers (OR: 1.33; 95%CI: 1.00−1.77), family members, or friends (OR: 1.30; 95%CI: 1.14−1.49) were also significantly associated with childhood influenza vaccination. Poor access, including conflicts between caregivers’ availability and vaccination service schedules and inconvenient transportation to the vaccination site were negatively associated with childhood flu vaccination. To promote childhood influenza vaccination, public health information campaigns need to target wealthier and less educated caregivers to enhance caregivers’ confidence in influenza vaccination. Targeted interventions are also needed to optimize access to vaccination services, including extending vaccination service hours and increasing the number of vaccination sites close to residential areas. Interventions are also needed to encourage primary care providers to play a greater role in promoting vaccination. Finally, the dissemination of related information and the public response need to be monitored for the timely understanding of public perceptions

The determinants of vaccine hesitancy in China: A cross-sectional study following the Changchun Changsheng vaccine incident.

INTRODUCTION: Vaccine hesitancy is cited as one of the top threats to global health. The Changchun Changsheng Biotechnology Company was found to have violated good manufacturing practices in July 2018, leading to widespread distribution of sub-potent vaccines in China. We estimated the prevalence and determinants of vaccine hesitancy following the Changchun Changsheng vaccine incident (CCVI). METHODS: We conducted a cross-sectional survey in China in January 2019, and 2,124 caregivers of children < 6 years old completed self-administered questionnaires. Multinomial logistic regression was used to assess the determinants of vaccine hesitancy; the potential determinants included demographics, socioeconomic status, vaccine confidence, and knowledge of the CCVI. Adjusted Odds Ratios (AORs) and 95% confidence intervals (CI) are reported. RESULTS: Around 89% of caregivers had heard of the CCVI. Although 83% and 88% of caregivers agreed that vaccines are safe and effective, respectively, 60% expressed some hesitancy about vaccination. Of those hesitant, 26% vaccinated their children at times with doubts, 31% delayed vaccination and 3% refused specific vaccines. Multinomial regression analysis showed that confidence in vaccine safety was associated with a reduced odds of doubts on vaccination (AOR = 0.64; 95%CI = 0.44-0.94), whereas caregivers who had heard of the CCVI had a significantly higher odds of doubts on vaccination (AOR = 1.61; 95%CI = 1.05-2.45). Confidence in the vaccine delivery system and government were associated with a lower odds of vaccine hesitancy. Caregivers with higher education and Buddhism or other religions were significantly more hesitant to vaccinate their children. CONCLUSION: Vaccine hesitancy was prevalent following the CCVI. Over half the caregivers either accepted childhood vaccination with doubts or delayed vaccines; only a small number were active refusers. Our findings highlight the importance of addressing vaccine hesitancy, especially following vaccine incidents. Tailored communications are needed to reduce vaccine hesitancy, especially among the highly educated and Buddhist caregivers

Access to Vaccination Information and Confidence/Hesitancy Towards Childhood Vaccination: A Cross-Sectional Survey in China.

Access to vaccination information could influence public attitudes towards vaccination. This study investigated the number and types of vaccination-related information sources, and estimated their associations with vaccine confidence and hesitancy in China. In January 2019, we conducted a cross-sectional survey in China, and 2122 caregivers with children <6 years completed self-administered questionnaires. Logistic regressions were used to assess associations between caregivers' primary information sources and vaccine confidence/hesitancy. A majority (72%) of caregivers had multiple sources of vaccination-related information. The proportions of caregivers reporting professional sources, media, and peers as primary information sources were 81%, 63%, and 26%. Internal migrants were less likely to get information from professional sources; more educated and wealthier caregivers reported more information sources and were more likely to get information from media and peers. Caregivers who reported professional information sources had significantly higher odds of being confident about the safety of vaccines and lower odds of being hesitant toward vaccination than those who did not. Caregivers who reported the media as a primary information source had significantly higher odds of being hesitant toward vaccination than those who did not. To address vaccine hesitancy, it is essential to promote universal access to professional vaccination-related information sources, and to use the media to disseminate evidence-based information and clarify misinformation. Health communication should target internal migrants, and more educated and wealthier caregivers

A meta-QTL analysis highlights genomic hotspots associated with phosphorus use efficiency in rice (Oryza sativa L.)

Phosphorus use efficiency (PUE) is a complex trait, governed by many minor quantitative trait loci (QTLs) with small effects. Advances in molecular marker technology have led to the identification of QTLs underlying PUE. However, their practical use in breeding programs remains challenging due to the unstable effects in different genetic backgrounds and environments, interaction with soil status, and linkage drag. Here, we compiled PUE QTL information from 16 independent studies. A total of 192 QTLs were subjected to meta-QTL (MQTL) analysis and were projected into a high-density SNP consensus map. A total of 60 MQTLs, with significantly reduced number of initial QTLs and confidence intervals (CI), were identified across the rice genome. Candidate gene (CG) mining was carried out for the 38 MQTLs supported by multiple QTLs from at least two independent studies. Genes related to amino and organic acid transport and auxin response were found to be abundant in the MQTLs linked to PUE. CGs were cross validated using a root transcriptome database (RiceXPro) and haplotype analysis. This led to the identification of the eight CGs (OsARF8, OsSPX-MFS3, OsRING141, OsMIOX, HsfC2b, OsFER2, OsWRKY64, and OsYUCCA11) modulating PUE. Potential donors for superior PUE CG haplotypes were identified through haplotype analysis. The distribution of superior haplotypes varied among subspecies being mostly found in indica but were largely scarce in japonica. Our study offers an insight on the complex genetic networks that modulate PUE in rice. The MQTLs, CGs, and superior CG haplotypes identified in our study are useful in the combination of beneficial alleles for PUE in rice

Tuning charge carrier transport and optical birefringence in liquid-crystalline thin films : a new design space for organic light-emitting diodes

B.L. acknowledges financial support from the Binational Science Foundation under grant No 2014396 and from the National Science Foundation under grant No 1639073. C.K. acknowledges funding from the Kent State University Internal Post-Doctoral Competition. M.C.K. acknowledges funding from the Belgian Agentschap voor innovatie door wetenschap en techniek under grant No IWT 131498.Liquid-crystalline organic semiconductors exhibit unique properties that make them highly interesting for organic optoelectronic applications. Their optical and electrical anisotropies and the possibility to control the alignment of the liquid-crystalline semiconductor allow not only to optimize charge carrier transport, but to tune the optical property of organic thin-film devices as well. In this study, the molecular orientation in a liquid-crystalline semiconductor film is tuned by a novel blading process as well as by different annealing protocols. The altered alignment is verified by cross-polarized optical microscopy and spectroscopic ellipsometry. It is shown that a change in alignment of the liquid-crystalline semiconductor improves charge transport in single charge carrier devices profoundly. Comparing the current-voltage characteristics of single charge carrier devices with simulations shows an excellent agreement and from this an in-depth understanding of single charge carrier transport in two-terminal devices is obtained. Finally, p-i-n type organic light-emitting diodes (OLEDs) compatible with vacuum processing techniques used in state-of-the-art OLEDs are demonstrated employing liquid-crystalline host matrix in the emission layer.Publisher PDFPeer reviewe