Knowledge Unlearning for LLMs: Tasks, Methods, and Challenges

In recent years, large language models (LLMs) have spurred a new research paradigm in natural language processing. Despite their excellent capability in knowledge-based question answering and reasoning, their potential to retain faulty or even harmful knowledge poses risks of malicious application. The challenge of mitigating this issue and transforming these models into purer assistants is crucial for their widespread applicability. Unfortunately, Retraining LLMs repeatedly to eliminate undesirable knowledge is impractical due to their immense parameters. Knowledge unlearning, derived from analogous studies on machine unlearning, presents a promising avenue to address this concern and is notably advantageous in the context of LLMs. It allows for the removal of harmful knowledge in an efficient manner, without affecting unrelated knowledge in the model. To this end, we provide a survey of knowledge unlearning in the era of LLMs. Firstly, we formally define the knowledge unlearning problem and distinguish it from related works. Subsequently, we categorize existing knowledge unlearning methods into three classes: those based on parameter optimization, parameter merging, and in-context learning, and introduce details of these unlearning methods. We further present evaluation datasets used in existing methods, and finally conclude this survey by presenting the ongoing challenges and future directions.Comment: Work in progres

NMI inhibits cancer stem cell traits by downregulating hTERT in breast cancer.

N-myc and STAT interactor (NMI) has been proved to bind to different transcription factors to regulate a variety of signaling mechanisms including DNA damage, cell cycle and epithelial-mesenchymal transition. However, the role of NMI in the regulation of cancer stem cells (CSCs) remains poorly understood. In this study, we investigated the regulation of NMI on CSCs traits in breast cancer and uncovered the underlying molecular mechanisms. We found that NMI was lowly expressed in breast cancer stem cells (BCSCs)-enriched populations. Knockdown of NMI promoted CSCs traits while its overexpression inhibited CSCs traits, including the expression of CSC-related markers, the number of CD44+CD24- cell populations and the ability of mammospheres formation. We also found that NMI-mediated regulation of BCSCs traits was at least partially realized through the modulation of hTERT signaling. NMI knockdown upregulated hTERT expression while its overexpression downregulated hTERT in breast cancer cells, and the changes in CSCs traits and cell invasion ability mediated by NMI were rescued by hTERT. The in vivo study also validated that NMI knockdown promoted breast cancer growth by upregulating hTERT signaling in a mouse model. Moreover, further analyses for the clinical samples demonstrated that NMI expression was negatively correlated with hTERT expression and the low NMI/high hTERT expression was associated with the worse status of clinical TNM stages in breast cancer patients. Furthermore, we demonstrated that the interaction of YY1 protein with NMI and its involvement in NMI-mediated transcriptional regulation of hTERT in breast cancer cells. Collectively, our results provide new insights into understanding the regulatory mechanism of CSCs and suggest that the NMI-YY1-hTERT signaling axis may be a potential therapeutic target for breast cancers

IKKbeta Deficiency in Myeloid Cells Ameliorates Alzheimer's Disease-Related Symptoms and Pathology

Alzheimer's disease (AD) is characterized by extracellular amyloid-beta (Abeta) deposits and microglia-dominated inflammatory activation. Innate immune signaling controls microglial inflammatory activities and Abeta clearance. However, studies examining innate immunity in Abeta pathology and neuronal degeneration have produced conflicting results. In this study, we investigated the pathogenic role of innate immunity in AD by ablating a key signaling molecule, IKKbeta, specifically in the myeloid cells of TgCRND8 APP-transgenic mice. Deficiency of IKKbeta in myeloid cells, especially microglia, simultaneously reduced inflammatory activation and Abeta load in the brain and these effects were associated with reduction of cognitive deficits and preservation of synaptic structure proteins. IKKbeta deficiency enhanced microglial recruitment to Abeta deposits and facilitated Abeta internalization, perhaps by inhibiting TGF-beta-SMAD2/3 signaling, but did not affect Abeta production and efflux. Therefore, inhibition of IKKbeta signaling in myeloid cells improves cognitive functions in AD mice by reducing inflammatory activation and enhancing Abeta clearance. These results contribute to a better understanding of AD pathogenesis and could offer a new therapeutic option for delaying AD progression

Deficiency of IKKβ in neurons ameliorates Alzheimer's disease pathology in APP- and tau-transgenic mice

In Alzheimer's disease (AD) brain, inflammatory activation regulates protein levels of amyloid-β-peptide (Aβ) and phosphorylated tau (p-tau), as well as neurodegeneration; however, the regulatory mechanisms remain unclear. We constructed APP- and tau-transgenic AD mice with deletion of IKKβ specifically in neurons, and observed that IKKβ deficiency reduced cerebral Aβ and p-tau, and modified inflammatory activation in both AD mice. However, neuronal deficiency of IKKβ decreased apoptosis and maintained synaptic proteins (e.g., PSD-95 and Munc18-1) in the brain and improved cognitive function only in APP-transgenic mice, but not in tau-transgenic mice. Additionally, IKKβ deficiency decreased BACE1 protein and activity in APP-transgenic mouse brain and cultured SH-SY5Y cells. IKKβ deficiency increased expression of PP2A catalytic subunit isoform A, an enzyme dephosphorylating cerebral p-tau, in the brain of tau-transgenic mice. Interestingly, deficiency of IKKβ in neurons enhanced autophagy as indicated by the increased ratio of LC3B-II/I in brains of both APP- and tau-transgenic mice. Thus, IKKβ deficiency in neurons ameliorates AD-associated pathology in APPand tau-transgenic mice, perhaps by decreasing Aβ production, increasing p-tau dephosphorylation, and promoting autophagy-mediated degradation of BACE1 and p-tau aggregates in the brain. However, IKKβ deficiency differently protects neurons in APP- and tau-transgenic mice. Further studies are needed, particularly in the context of interaction between Aβ and p-tau, before IKKβ/NF-κB can be targeted for AD therapies

Haploinsufficiency of microglial MyD88 ameliorates Alzheimer's pathology and vascular disorders in APP/PS1-transgenic mice

Growing evidence indicates that innate immune molecules regulate microglial activation in Alzheimer's disease (AD); however, their effects on amyloid pathology and neurodegeneration remain inconclusive. Here, we conditionally deleted one allele of myd88 gene specifically in microglia in APP/PS1-transgenic mice by 6 months and analyzed AD-associated pathologies by 9 months. We observed that heterozygous deletion of myd88 gene in microglia decreased cerebral amyloid β (Aβ) load and improved cognitive function of AD mice, which was correlated with reduced number of microglia in the brain and inhibited transcription of inflammatory genes, for example, tnf-α and il-1β, in both brain tissues and individual microglia. To investigate mechanisms underlying the pathological improvement, we observed that haploinsufficiency of MyD88 increased microglial recruitment toward Aβ deposits, which might facilitate Aβ clearance. Microglia with haploinsufficient expression of MyD88 also increased vasculature in the brain of APP/PS1-transgenic mice, which was associated with up-regulated transcription of osteopontin and insulin-like growth factor genes in microglia. Moreover, MyD88-haploinsufficient microglia elevated protein levels of LRP1 in cerebral capillaries of APP/PS1-transgenic mice. Cell culture experiments further showed that treatments with interleukin-1β decreased LRP1 expression in pericytes. In summary, haploinsufficiency of MyD88 in microglia at a late disease stage attenuates pro-inflammatory activation and amyloid pathology, prevents the impairment of microvasculature and perhaps also protects LRP1-mediated Aβ clearance in the brain of APP/PS1-transgenic mice, all of which improves neuronal function of AD mice

p38α-MAPK-deficient myeloid cells ameliorate symptoms and pathology of APP-transgenic Alzheimer's disease mice

Alzheimer's disease (AD), the most common cause of dementia in the elderly, is pathologically characterized by extracellular deposition of amyloid-β peptides (Aβ) and microglia-dominated inflammatory activation in the brain. p38α-MAPK is activated in both neurons and microglia. How p38α-MAPK in microglia contributes to AD pathogenesis remains unclear. In this study, we conditionally knocked out p38α-MAPK in all myeloid cells or specifically in microglia of APP-transgenic mice, and examined animals for AD-associated pathologies (i.e., cognitive deficits, Aβ pathology, and neuroinflammation) and individual microglia for their inflammatory activation and Aβ internalization at different disease stages (e.g., at 4 and 9 months of age). Our experiments showed that p38α-MAPK-deficient myeloid cells were more effective than p38α-MAPK-deficient microglia in reducing cerebral Aβ and neuronal impairment in APP-transgenic mice. Deficiency of p38α-MAPK in myeloid cells inhibited inflammatory activation of individual microglia at 4 months but enhanced it at 9 months. Inflammatory activation promoted microglial internalization of Aβ. Interestingly, p38α-MAPK-deficient myeloid cells reduced IL-17a-expressing CD4-positive lymphocytes in 9 but not 4-month-old APP-transgenic mice. By cross-breeding APP-transgenic mice with Il-17a-knockout mice, we observed that IL-17a deficiency potentially activated microglia and reduced Aβ deposition in the brain as shown in 9-month-old myeloid p38α-MAPK-deficient AD mice. Thus, p38α-MAPK deficiency in all myeloid cells, but not only in microglia, prevents AD progression. IL-17a-expressing lymphocytes may partially mediate the pathogenic role of p38α-MAPK in peripheral myeloid cells. Our study supports p38α-MAPK as a therapeutic target for AD patients

Triptolide modulates adriamycin sensitivity via regulating Mir-21 and Bcl-2 expression in K562/A02 cell line

Drug resistance is a major obstacle for successful treatment of leukemia. Increasing evidence suggests that microRNA-21 (miR-21) is over-expressed in K562/A02 cell line, promoting drug resistance. The aim of our present study is to investigate the reversal effects of triptolide on drug resistance in adriamycin-resistant cells. Cell viability was measured by MTT assays and adriamycin induced apoptosis was evaluated by flow cytometry. Levels of miR-21 quantified by real-time PCR. Bcl-2 protein level were measured by western blot. TPL enhanced sensitivity of K562/A02 cells to adriamycin and promoted adriamycin–induced apoptosis. Levels of miR-21 and Bcl-2 was significantly decreased after triptolide treatment. Transfection with anti-miR-21, a significant up-regulation of sensitivity to adriamycin and a significant down-regulation of Bcl-2 protein level was noted in K562/A02 cells. Our study suggests that triptolide significantly sensitizes K562/A02 cell to adriamycin by inducing apoptosis and these effects of triptolide may be due to its down-regulation of miR-21.Colegio de Farmacéuticos de la Provincia de Buenos Aire

From Molten Calcium Aluminates through Phase Transitions to Cement Phases

Crystalline calcium aluminates are a critical setting agent in cement. To date, few have explored the microscopic and dynamic mechanism of the transitions from molten aluminate liquids, through the supercooled state to glassy and crystalline phases, during cement clinker production. Herein, the first in situ measurements of viscosity and density are reported across all the principal molten phases, relevant to their eventual crystalline structures. Bulk atomistic computer simulations confirm that thermophysical properties scale with the evolution of network substructures interpenetrating melts on the nanoscale. It is demonstrated that the glass transition temperature (T-g) follows the eutectic profile of the liquidus temperature (T-m), coinciding with the melting zone in cement production. The viscosity has been uniquely charted over 14 decades for each calcium-aluminate phase, projecting and justifying the different temperature zones used in cement manufacture. The fragile-strong phase transitions are revealed across all supercooled phases coinciding with heterogeneous nucleation close to 1.2T(g), where sintering and quenching occur in industrial-scale cement processing