Gradient Surgery for One-shot Unlearning on Generative Model

Recent regulation on right-to-be-forgotten emerges tons of interest in unlearning pre-trained machine learning models. While approximating a straightforward yet expensive approach of retrain-from-scratch, recent machine unlearning methods unlearn a sample by updating weights to remove its influence on the weight parameters. In this paper, we introduce a simple yet effective approach to remove a data influence on the deep generative model. Inspired by works in multi-task learning, we propose to manipulate gradients to regularize the interplay of influence among samples by projecting gradients onto the normal plane of the gradients to be retained. Our work is agnostic to statistics of the removal samples, outperforming existing baselines while providing theoretical analysis for the first time in unlearning a generative model.Comment: ICML 2023 Workshop on Generative AI & La

Expression, Immobilization and Enzymatic Properties of Glutamate Decarboxylase Fused to a Cellulose-Binding Domain

Escherichia coli-derived glutamate decarboxylase (GAD), an enzyme that catalyzes the conversion of glutamic acid to gamma-aminobutyric acid (GABA), was fused to the cellulose-binding domain (CBD) and a linker of Trichoderma harzianum endoglucanase II. To prevent proteolysis of the fusion protein, the native linker was replaced with a S3N10 peptide known to be completely resistant to E. coli endopeptidase. The CBD-GAD expressed in E. coli was successfully immobilized on Avicel, a crystalline cellulose, with binding capacity of 33 ± 2 nmolCBD-GAD/gAvicel and the immobilized enzymes retained 60% of their initial activities after 10 uses. The results of this report provide a feasible alternative to produce GABA using immobilized GAD through fusion to CBD

Dual-Color-Emitting Carbon Nanodots for Multicolor Bioimaging and Optogenetic Control of Ion Channels

The development of intrinsically multicolor-emitting carbon nanodots (CNDs) has been one of the great challenges for their various fields of applications. Here, the controlled electronic structure engineering of CNDs is performed to emit two distinct colors via the facile surface modification with 4-octyloxyaniline. The so-called dual-color-emitting CNDs (DC-CNDs) can be stably encapsulated within poly(styrene-co-maleic anhydride) (PSMA). The prepared water-soluble DC-CNDs@PSMA can be successfully applied to in vitro and in vivo dual-color bioimaging and optogenetics. In vivo optical imaging can visualize the biodistribution of intravenously injected DC-CNDs@PSMA. In addition, the light-triggered activation of ion channel, channelrhodopsin-2, for optogenetic applications is demonstrated. As a new type of fluorophore, DC-CNDs offer a big insight into the design of charge-transfer complexes for various optical and biomedical applications.112Ysciescopu

Pilot KaVA monitoring on the M87 jet: confirming the inner jet structure and superluminal motions at sub-pc scales

We report the initial results of our high-cadence monitoring program on the radio jet in the active galaxy M87, obtained by the KVN and VERA Array (KaVA) at 22 GHz. This is a pilot study that preceded a larger KaVA-M87 monitoring program, which is currently ongoing. The pilot monitoring was mostly performed every two to three weeks from December 2013 to June 2014, at a recording rate of 1 Gbps, obtaining the data for a total of 10 epochs. We successfully obtained a sequence of good quality radio maps that revealed the rich structure of this jet from <~1 mas to 20 mas, corresponding to physical scales (projected) of ~0.1-2 pc (or ~140-2800 Schwarzschild radii). We detected superluminal motions at these scales, together with a trend of gradual acceleration. The first evidence for such fast motions and acceleration near the jet base were obtained from recent VLBA studies at 43 GHz, and the fact that very similar kinematics are seen at a different frequency and time with a different instrument suggests these properties are fundamental characteristics of this jet. This pilot program demonstrates that KaVA is a powerful VLBI array for studying the detailed structural evolution of the M87 jet and also other relativistic jets.Comment: 10 pages, 9 figures, accepted for publication in PAS

Virtual Reality-Based Psychotherapy in Social Anxiety Disorder: fMRI Study Using a Self-Referential Task

Background: Although it has been well demonstrated that the efficacy of virtual reality therapy for social anxiety disorder is comparable to that of traditional cognitive behavioral therapy, little is known about the effect of virtual reality on pathological self-referential processes in individuals with social anxiety disorder. Objective: We aimed to determine changes in self-referential processing and their neural mechanisms following virtual reality treatment. Methods: We recruited participants with and without a primary diagnosis of social anxiety disorder to undergo clinical assessments (Social Phobia Scale and Post-Event Rumination Scale) and functional magnetic resonance imaging (fMRI) scans. Participants with social anxiety disorder received virtual reality-based exposure treatment for 6 sessions starting immediately after baseline testing. After the sixth session, participants with social anxiety disorder completed follow-up scans during which they were asked to judge whether a series of words (positive, negative, neutral) was relevant to them. Results: Of 25 individuals with social anxiety disorder who participated in the study, 21 completed the sessions and follow-up; 22 control individuals also participated. There were no significant differences in age (P=.36), sex (P=.71), or handedness (P=.51) between the groups. Whole-brain analysis revealed that participants in the social anxiety disorder group had increased neural responses during positive self-referential processing in the medial temporal and frontal cortexes compared with those in the control group. Participants in the social anxiety disorder group also showed increased left insular activation and decreased right middle frontal gyms activation during negative self-referential processing. After undergoing virtual reality based therapy, overall symptoms of the participants with social anxiety disorder were reduced, and these participants exhibited greater activity in a brain regions responsible for self-referential and autobiographical memory processes while viewing positive words during postintervention fMRI scans. Interestingly, the greater the blood oxygen level dependent changes related to positive self-referential processing, the lower the tendency to ruminate on the negative events and the lower the social anxiety following the virtual reality session. Compared with that at baseline, higher activation was also found within broad somatosensory areas in individuals with social anxiety disorder during negative self-referential processing following virtual reality therapy. Conclusions: These fMRI findings might reflect the enhanced physiological and cognitive processing in individuals with social anxiety disorder in response to self-referential information. They also provide neural evidence of the effect of virtual reality exposure therapy on social anxiety and self-derogation

Intracerebroventricular injection of human umbilical cord blood mesenchymal stem cells in patients with Alzheimer’s disease dementia: a phase I clinical trial

Backgrounds: Alzheimer's disease is the most common cause of dementia, and currently, there is no disease-modifying treatment. Favorable functional outcomes and reduction of amyloid levels were observed following transplantation of mesenchymal stem cells (MSCs) in animal studies. Objectives: We conducted a phase I clinical trial in nine patients with mild-to-moderate Alzheimer's disease dementia to evaluate the safety and dose-limiting toxicity of three repeated intracerebroventricular injections of human umbilical cord blood-derived MSCs (hUCB-MSCs). Methods: We recruited nine mild-to-moderate Alzheimer's disease dementia patients from Samsung Medical Center, Seoul, Republic of Korea. Four weeks prior to MSC administration, the Ommaya reservoir was implanted into the right lateral ventricle of the patients. Three patients received a low dose (1.0 × 107 cells/2 mL), and six patients received a high dose (3.0 × 107 cells/2 mL) of hUCB-MSCs. Three repeated injections of MSCs were performed (4-week intervals) in all nine patients. These patients were followed up to 12 weeks after the first hUCB-MSC injection and an additional 36 months in the extended observation study. Results: After hUCB-MSC injection, the most common adverse event was fever (n = 9) followed by headache (n = 7), nausea (n = 5), and vomiting (n = 4), which all subsided within 36 h. There were three serious adverse events in two participants that were considered to have arisen from the investigational product. Fever in a low dose participant and nausea with vomiting in another low dose participant each required extended hospitalization by a day. There were no dose-limiting toxicities. Five participants completed the 36-month extended observation study, and no further serious adverse events were observed. Conclusions: Three repeated administrations of hUCB-MSCs into the lateral ventricle via an Ommaya reservoir were feasible, relatively and sufficiently safe, and well-tolerated. Currently, we are undergoing an extended follow-up study for those who participated in a phase IIa trial where upon completion, we hope to gain a deeper understanding of the clinical efficacy of MSC AD therapy

NGL-1/LRRC4C Deletion Moderately Suppresses Hippocampal Excitatory Synapse Development and Function in an Input-Independent Manner

Netrin-G ligand-1 (NGL-1), also known as LRRC4C, is a postsynaptic densities (PSDs)-95-interacting postsynaptic adhesion molecule that interacts trans-synaptically with presynaptic netrin-G1. NGL-1 and its family member protein NGL-2 are thought to promote excitatory synapse development through largely non-overlapping neuronal pathways. While NGL-2 is critical for excitatory synapse development in specific dendritic segments of neurons in an input-specific manner, whether NGL-1 has similar functions is unclear. Here, we show that Lrrc4c deletion in male mice moderately suppresses excitatory synapse development and function, but surprisingly, does so in an input-independent manner. While NGL-1 is mainly detected in the stratum lacunosum moleculare (SLM) layer of the hippocampus relative to the stratum radiatum (SR) layer, NGL-1 deletion leads to decreases in the number of PSDs in both SLM and SR layers in the ventral hippocampus. In addition, both SLM and SR excitatory synapses display suppressed short-term synaptic plasticity in the ventral hippocampus. These morphological and functional changes are either absent or modest in the dorsal hippocampus. The input-independent synaptic changes induced by Lrrc4c deletion involve abnormal translocation of NGL-2 from the SR to SLM layer. These results suggest that Lrrc4c deletion moderately suppresses hippocampal excitatory synapse development and function in an input-independent manner