CodeTF: One-stop Transformer Library for State-of-the-art Code LLM

Code intelligence plays a key role in transforming modern software engineering. Recently, deep learning-based models, especially Transformer-based large language models (LLMs), have demonstrated remarkable potential in tackling these tasks by leveraging massive open-source code data and programming language features. However, the development and deployment of such models often require expertise in both machine learning and software engineering, creating a barrier for the model adoption. In this paper, we present CodeTF, an open-source Transformer-based library for state-of-the-art Code LLMs and code intelligence. Following the principles of modular design and extensible framework, we design CodeTF with a unified interface to enable rapid access and development across different types of models, datasets and tasks. Our library supports a collection of pretrained Code LLM models and popular code benchmarks, including a standardized interface to train and serve code LLMs efficiently, and data features such as language-specific parsers and utility functions for extracting code attributes. In this paper, we describe the design principles, the architecture, key modules and components, and compare with other related library tools. Finally, we hope CodeTF is able to bridge the gap between machine learning/generative AI and software engineering, providing a comprehensive open-source solution for developers, researchers, and practitioners.Comment: Ongoing work - Draft Previe

Intrathecal enzyme replacement for Hurler syndrome: biomarker association with neurocognitive outcomes.

PurposeAbnormalities in cerebrospinal fluid (CSF) have been reported in Hurler syndrome, a fatal neurodegenerative lysosomal disorder. While no biomarker has predicted neurocognitive response to treatment, one of these abnormalities, glycosaminoglycan nonreducing ends (NREs), holds promise to monitor therapeutic efficacy. A trial of intrathecal enzyme replacement therapy (ERT) added to standard treatment enabled tracking of CSF abnormalities, including NREs. We evaluated safety, biomarker response, and neurocognitive correlates of change.MethodsIn addition to intravenous ERT and hematopoietic cell transplantation, patients (N = 24) received intrathecal ERT at four peritransplant time points; CSF was evaluated at each point. Neurocognitive functioning was quantified at baseline, 1 year, and 2 years posttransplant. Changes in CSF biomarkers and neurocognitive function were evaluated for an association.ResultsOver treatment, there were significant decreases in CSF opening pressure, biomarkers of disease activity, and markers of inflammation. Percent decrease in NRE from pretreatment to final intrathecal dose posttransplant was positively associated with percent change in neurocognitive score from pretreatment to 2 years posttransplant.ConclusionIntrathecal ERT was safe and, in combination with standard treatment, was associated with reductions in CSF abnormalities. Critically, we report evidence of a link between a biomarker treatment response and neurocognitive outcome in Hurler syndrome

Brain transplantation of genetically corrected Sanfilippo type B neural stem cells induces partial cross-correction of the disease

Sanfilippo syndrome type B (mucopolysaccharidosis type IIIB) is a recessive genetic disorder that severely affects the brain due to a deficiency in the enzyme α

Cross-species efficacy of enzyme replacement therapy for CLN1 disease in mice and sheep

CLN1 disease, also called infantile neuronal ceroid lipofuscinosis (NCL) or infantile Batten disease, is a fatal neurodegenerative lysosomal storage disorder resulting from mutations in the CLN1 gene encoding the soluble lysosomal enzyme palmitoyl-protein thioesterase 1 (PPT1). Therapies for CLN1 disease have proven challenging because of the aggressive disease course and the need to treat widespread areas of the brain and spinal cord. Indeed, gene therapy has proven less effective for CLN1 disease than for other similar lysosomal enzyme deficiencies. We therefore tested the efficacy of enzyme replacement therapy (ERT) by administering monthly infusions of recombinant human PPT1 (rhPPT1) to PPT1-deficient mice (Cln1-/-) and CLN1R151X sheep to assess how to potentially scale up for translation. In Cln1-/- mice, intracerebrovascular (i.c.v.) rhPPT1 delivery was the most effective route of administration, resulting in therapeutically relevant CNS levels of PPT1 activity. rhPPT1-treated mice had improved motor function, reduced disease-associated pathology, and diminished neuronal loss. In CLN1R151X sheep, i.c.v. infusions resulted in widespread rhPPT1 distribution and positive treatment effects measured by quantitative structural MRI and neuropathology. This study demonstrates the feasibility and therapeutic efficacy of i.c.v. rhPPT1 ERT. These findings represent a key step toward clinical testing of ERT in children with CLN1 disease and highlight the importance of a cross-species approach to developing a successful treatment strategy

Enzyme Replacement Therapy for Mucopolysaccharidosis IIID using Recombinant Human α-N-Acetylglucosamine-6-Sulfatase in Neonatal Mice

There is currently no cure or effective treatment available for mucopolysaccharidosis type IIID (MPS IIID, Sanfilippo syndrome type D), a lysosomal storage disorder (LSD) caused by the deficiency of α-N-acetylglucosamine-6-sulfatase (GNS). The clinical symptoms of MPS IIID, like other subtypes of Sanfilippo syndrome, are largely localized to the central nervous system (CNS), and any treatments aiming to ameliorate or reverse the catastrophic and fatal neurologic decline caused by this disease need to be delivered across the blood–brain barrier. Here, we report a proof-of-concept enzyme replacement therapy (ERT) for MPS IIID using recombinant human α-N-acetylglucosamine-6-sulfatase (rhGNS) via intracerebroventricular (ICV) delivery in a neonatal MPS IIID mouse model. We overexpressed and purified rhGNS from CHO cells with a specific activity of 3.9 × 10⁴ units/mg protein and a maximal enzymatic activity at lysosomal pH (pH 5.6), which was stable for over one month at 4 °C in artificial cerebrospinal fluid (CSF). We demonstrated that rhGNS was taken up by MPS IIID patient fibroblasts via the mannose 6-phosphate (M6P) receptor and reduced intracellular glycosaminoglycans to normal levels. The delivery of 5 μg of rhGNS into the lateral cerebral ventricle of neonatal MPS IIID mice resulted in normalization of the enzymatic activity in brain tissues; rhGNS was found to be enriched in lysosomes in MPS IIID-treated mice relative to the control. Furthermore, a single dose of rhGNS was able to reduce the accumulated heparan sulfate and β-hexosaminidase. Our results demonstrate that rhGNS delivered into CSF is a potential therapeutic option for MPS IIID that is worthy of further development

A Genetic Screen for Attenuated Growth Identifies Genes Crucial for Intraerythrocytic Development of Plasmodium falciparum

A majority of the Plasmodium falciparum genome codes for genes with unknown functions, which presents a major challenge to understanding the parasite's biology. Large-scale functional analysis of the parasite genome is essential to pave the way for novel therapeutic intervention strategies against the disease and yet difficulties in genetic manipulation of this deadly human malaria parasite have been a major hindrance for functional analysis of its genome. Here, we used a forward functional genomic approach to study P. falciparum and identify genes important for optimal parasite development in the disease-causing, intraerythrocytic stages. We analyzed 123 piggyBac insertion mutants of P. falciparum for proliferation efficiency in the intraerythrocytic stages, in vitro. Almost 50% of the analyzed mutants showed significant reduction in proliferation efficiency, with 20% displaying severe defects. Functional categorization of genes in the severely attenuated mutants revealed significant enrichment for RNA binding proteins, suggesting the significance of post-transcriptional gene regulation in parasite development and emphasizing its importance as an antimalarial target. This study demonstrates the feasibility of much needed forward genetics approaches for P. falciparum to better characterize its genome and accelerate drug and vaccine development

Cross-species efficacy of enzyme replacement therapy for CLN1 disease in mice and sheep

CLN1 disease, also called infantile neuronal ceroid lipofuscinosis (NCL) or infantile Batten disease, is a fatal neurodegenerative lysosomal storage disorder resulting from mutations in the CLN1 gene encoding the soluble lysosomal enzyme palmitoyl-protein thioesterase 1 (PPT1). Therapies for CLN1 disease have proven challenging because of the aggressive disease course and the need to treat widespread areas of the brain and spinal cord. Indeed, gene therapy has proven less effective for CLN1 disease than for other similar lysosomal enzyme deficiencies. We therefore tested the efficacy of enzyme replacement therapy (ERT) by administering monthly infusions of recombinant human PPT1 (rhPPT1) to PPT1-deficient mice (Cln1(–/–)) and CLN1(R151X) sheep to assess how to potentially scale up for translation. In Cln1(–/–) mice, intracerebrovascular (i.c.v.) rhPPT1 delivery was the most effective route of administration, resulting in therapeutically relevant CNS levels of PPT1 activity. rhPPT1-treated mice had improved motor function, reduced disease-associated pathology, and diminished neuronal loss. In CLN1(R151X) sheep, i.c.v. infusions resulted in widespread rhPPT1 distribution and positive treatment effects measured by quantitative structural MRI and neuropathology. This study demonstrates the feasibility and therapeutic efficacy of i.c.v. rhPPT1 ERT. These findings represent a key step toward clinical testing of ERT in children with CLN1 disease and highlight the importance of a cross-species approach to developing a successful treatment strategy

Effects of dissipation on quantum phase transitions

We discuss the effect of dissipation on quantum phase transitions. In particular we concentrate on the Superconductor to Insulator and Quantum-Hall to Insulator transitions. By invoking a phenomenological parameter $\alpha$ to describe the coupling of the system to a continuum of degrees of freedom representing the dissipative bath, we obtain new phase diagrams for the quantum Hall and superconductor-insulator problems. Our main result is that, in two-dimensions, the metallic phases observed in finite magnetic fields (possibly also strictly zero field) are adiabatically deformable from one to the other. This is plausible, as there is no broken symmetry which differentiates them.Comment: 13 pages, 4 figure