Developing Toward Generality: Combating Catastrophic Forgetting with Developmental Compression

General intelligence is the exhibition of intelligent behavior across multiple problems in a variety of settings, however intelligence is defined and measured. Endemic in approaches to realize such intelligence in machines is catastrophic forgetting, in which sequential learning corrupts knowledge obtained earlier in the sequence or in which tasks antagonistically compete for system resources. Methods for obviating catastrophic forgetting have either sought to identify and preserve features of the system necessary to solve one problem when learning to solve another, or enforce modularity such that minimally overlapping sub-functions contain task-specific knowledge. While successful in some domains, both approaches scale poorly because they require larger architectures as the number of training instances grows, causing different parts of the system to specialize for separate subsets of the data. Presented here is a method called developmental compression that addresses catastrophic forgetting in the neural networks of embodied agents. It exploits the mild impacts of developmental mutations to lessen adverse changes to previously evolved capabilities and `compresses\u27 specialized neural networks into a single generalized one. In the absence of domain knowledge, developmental compression produces systems that avoid overt specialization, alleviating the need to engineer a bespoke system for every task permutation, and does so in a way that suggests better scalability than existing approaches. This method is validated on a robot control problem and may be extended to other machine learning domains in the future

Cytotoxic T-Lymphocyte Responses During Acute Epstein-Barr Virus Infection

Epstein-Barr virus (EBV) is a ubiquitous human herpesvirus which causes acute infectious mononucleosis and is etiologically associated with malignant lymphoproliferative disorders including Burkitt\u27s lymphoma, nasopharyngeal carcinoma, B-cell lymphomas in immunocompromised hosts, Hodgkin\u27s disease, T cell lymphomas, and smooth muscle tumors in allograft recipients. The medical significance of EBV is underscored by its potent growth transforming effects on human B-lymphocytes in-vitro and the potentially oncogenic consequences of infection in-vivo. The majority of EBV-associated malignancies occur in the setting of chronic infection and strong virus-specific humoral immunity, suggesting that cellular immunity is primarily responsible for preventing the outgrowth of EBV-transformed B cells in-vivo. Similarly, primary EBV infection in adolescents and adults stimulates an intense cytotoxic-T-lymphocyte (CTL) response which coincides with a marked reduction in the number of infected B cells in the peripheral blood. Evidence of previous EBV infection can be confirmed by the presence of EBV-specific, HLA-restricted memory T cells in the peripheral blood which inhibit the outgrowth of newly EBV-transformed B cells and efficiently lyse established autologous B-lymphoblastoid cell lines. Worldwide, EBV is responsible for substantial morbidity, comparable to measles, mumps and hepatitis virus, for which vaccines exists. Accordingly, the potential public health impact of an EBV vaccine has reinforced our efforts to identify the immunodominant virus-encoded T-cell epitopes which stimulate naive CTL effectors during acute infection and maintain memory CTL surveillance during convalescence. The EBV-encoded antigens against which the memory CTL response is directed have been partially defined, and include most of the EBV latent proteins (EBNA-2, 3a, 3b, 3c, LP, and LMP-l, 2a, 2b) consistently expressed by in-vitro EBV-transformed B lymphocytes (type-III latency). Importantly, all EBV-associated malignancies express EBNA-1, and as yet no EBNA-1-specific memory CTL have been convincingly demonstrated. Additionally, many EBV-specific CTL lines and clones have been described which do not recognize any of the known latent proteins or other EBV protein antigens tested thus far. Thus while much is known about CTL-mediated immunity against EBV, our knowledge of EBV-derived CTL epitopes remains incomplete. In contrast to the EBV-specific memory CTL response, very little is known about the source of viral epitopes recognized during the primary CTL response to EBV. In this regard, acute infectious mononucleosis represents an ideal model system to study virus-specific, cell-mediated immunity. Acute IM is a self-limited illness characterized by the appearance of atypical lymphocytes (CD3+/CD8+/HLADR+), including both virus-specific and alloreactive CTL, which undoubtedly contribute to virus elimination and provide CTL precursors for life-long immunity to EBV. Like other herpesvirus, EBV can undergo either lytic or latent cycle replication. During primary EBV infection many lytic cycle genes are expressed which are likely responsible for stimulating the intense cellular immune response associated with acute infectious mononucleosis. During convalescence a minor population of circulating B cells remain latently infected, harbor multiple EBV episomes, and express only EBNA-1 and possibly LMP-2a (type-I latency). Thus, latency type-I infected B cells in-vivo express a much more restricted spectrum of latent proteins and are therefore not subject to elimination by the same virus-specific CTL as are type-III EBV latently infected cells. Accordingly, many mechanisms have been proposed to explain EBV persistence including; restricted expression of EBV latent genes, reduced levels of cellular adhesion molecules, downregulation of MHC class-I molecules, absence of EBNA-1 T-cell-epitopes, and most recently, EBNA-1-mediated inhibition of antigen processing. While these mechanisms may contribute to ineffective T cell surveillance against latency type-I EBV- infected cells, B cells expressing the full spectrum of latent proteins (type-III) also exist transiently in vivoand maintain detectable humoral and CTL responses to most latent proteins. Our first goal was to identify the virus-encoded immunodominant antigens recognized by in-vivoactivated MHC class-I restricted CTL isolated from college students experiencing primary EBV infection, manifested as acute IM. Following a prodromal period of several weeks, newly EBV infected patients present with signs and symptoms of acute IM, including elevated numbers of activated CD8+ T cells in their peripheral blood, many of which, like memory CTL, are EBV-specific and HLA-restricted. In order to address the issue of EBV persistence and the immune control of EBV-induced lymphoproliferation, we also studied the long-term EBV-specific memory CTL response in these same individuals. Blood from acute IM patients and healthy EBV seropositive donors served as a source of peripheral blood lymphocytes to generate bulk CTL cultures and autologous target cells. The infecting strain of EBV was determined for each patient by DNA-PCR amplification of virus from saliva. Lymphocytes were isolated from whole blood by Ficoll-Paque density centrifugation and T- and B-cell enriched populations were obtained by AET-sheep red cell rosette selection. Autologous B cell blasts served as a source of target cells and recombinant vaccinia virus constructs were used to introduce individual EBV latent genes into target cells. Expression of individual EBV genes in target cells was confirmed by both western blot and immunofluorescence. Primary CTL responses to EBV were evaluated in standard 5lCr release assays using freshly isolated, T-cell enriched PBL from acute IM patients as effector cells. EBV-specific memory CTL responses were evaluated with bulk CTL culture generated by in-vitro restimulation with autologous B-LCLs. FACS analyses were routinely performed on bulk cultures of effector CTL populations in order to more clearly characterize their phenotype. Lastly, monoclonal antibody blocking studies and cold target competition assays were performed in order to accurately identify the viral antigen and MHC components responsible for target cell recognition. Our results based upon evaluation of 35 acute IM patients and 32 convalescent patients demonstrate that the virus-specific primary CTL response is broadly directed against the full spectrum of latent proteins, including EBNA1 and the viral coat glycoprotein gp350, while the memoryCTL response, which essentially lacks EBNA1 reactivity, is directed primarily against the EBNA 3 family of proteins (3A, 3B, 3C). Importantly, the immunodominant response by both primary and memory CTL was directed against the EBNA3 proteins. CTL from 7 of the 35 acute IM patients evaluated recognized EBNA1 expressing targets, and in 4 of these 7 patients, EBNA1 was an immunodominant antigen. Similarly, CTL from 7 of 35 acute IM patients recognized gp350 transfected targets, while no gp350-specific memory CTL responses were observed. While the phenotype of in-vivo primed CTL effectors were CD8+/HLA-DR+/CD11b+, the major subpopulation of memory CTL were CD8+/HLA-DR+/CD11b-. The CD11b memory marker reached peaked levels on the first sample day for all patients and gradually declined to baseline levels over a period of several months. In contrast, the CD11b marker was quickly shed from in vitropropogated CTL, over a period of 5-10 days. Target cell lysis by in-vivoactivated CTL was almost completely blocked by antibody directed againt [against] class-I molecules (BBM.1), whereas the effect of blocking target cell lysis by anti-CD8 mAb varied between 40-75%. These findings are consistent with an absolute need for class-I restricted antigen presentation, and imply that CD8 was variably required, likely for the lower affinity TCR/ Ag combinations. Cell lysis mediated by in-vitro-restimulated memory CTL was also largely inhibited by anti-class-I mAb, while anti-CD8 mAb was only mild/moderately effective in blocking target cell lysis, in keeping with the concept that memory CTL bear higher avidity TCR which can recognize antigen independent of CD8. Our detection of only one EBNA1-specific memory CTL response among the 32 patients tested supports the theory that latently infected B cells in-vivo, expressing only EBNA1, escape CTL recogition and thus might serve as a reservoir for viral persistence and/or reactivation. The rare ability to detect an EBNA1-specific memory CTL responses remains a relatively unexplained phenomenon and may involve a number of tolerizing mechanisms including the induction of anergy by presentation of EBNA-1 in the absence of costimulation, clonal deletion of low affinity T cells, the absence of dominant T cell epitopes within EBNA1 or a result of the recently described inhibiting properties of EBNA-1 on antigen processing and presentation. Alternatively, the absence of detectable EBNA1-specific memory CTL may be the result of insufficient or inappropriate restimulation of memory CTL in vitro. We addressed this possibility by attempting to selectively restimulate and expand EBNA1-specific CTL from acute IM patients by using EBNA1 expressing B cells blasts as a stimulus. Effector cells generated in this manner killed target cells in an MHC class-I restricted manner but were specific for an unspecified vaccinia antigen. Interestingly, the phenotype of the effector cells was predominantly CD3+/CD4-/CD8-/γδ T cells. In summary, our findings suggest that a multitude of previously unrecognized, EBV-specific CTL are present in the peripheral blood during acute IM, and include EBNA-1-specific CTL. The importance of accurately defining the in-vivo immune response to EBV is underscored by the ever-growing list of EBV associated malignancies. In addition to providing insights into the oncogenesis and potential treatment of NPC, a newly described link between precursor lesions and EBV infection raises the possibility that heightened immunity to EBV or EBV-infected cells may prevent the development of NPC. An obvious expectation would include extension of such knowledge to other EBV associated malignancies such as B and T cell lymphomas, Hodgkin\u27s lymphomas, and smooth muscle tumors. First however, existing gaps in knowledge regarding the immune response to EBV and EBV-associated malignancies must be closed. Details about the viral gene products which are involved in stimulating a broadly protective, virus-specific immune response in a large number of individuals is fundamental to the design of an effective EBV vaccine. Since the presence of activated CD8+ T cells correlates with the rapid decline of EBV infected B cells in the peripheral blood, a concise description of the EBV-specific CTL response in the setting of acute infection will be necessary for the rational design of an effective acute IM vaccine. Increased understanding of viral escape mechanisms is also likely to contribute to therapeutic modalities to treat autoimmune disorders

Alien Registration- Beaulieu, Marie L. (Lewiston, Androscoggin County)

https://digitalmaine.com/alien_docs/30499/thumbnail.jp

High-contrast imaging at small separation: impact of the optical configuration of two deformable mirrors on dark holes

The direct detection and characterization of exoplanets will be a major scientific driver over the next decade, involving the development of very large telescopes and requires high-contrast imaging close to the optical axis. Some complex techniques have been developed to improve the performance at small separations (coronagraphy, wavefront shaping, etc). In this paper, we study some of the fundamental limitations of high contrast at the instrument design level, for cases that use a combination of a coronagraph and two deformable mirrors for wavefront shaping. In particular, we focus on small-separation point-source imaging (around 1 $\lambda$/D). First, we analytically or semi-analytically analysing the impact of several instrument design parameters: actuator number, deformable mirror locations and optic aberrations (level and frequency distribution). Second, we develop in-depth Monte Carlo simulation to compare the performance of dark hole correction using a generic test-bed model to test the Fresnel propagation of multiple randomly generated optics static phase errors. We demonstrate that imaging at small separations requires large setup and small dark hole size. The performance is sensitive to the optic aberration amount and spatial frequencies distribution but shows a weak dependence on actuator number or setup architecture when the dark hole is sufficiently small (from 1 to $\lesssim$ 5 $\lambda$/D).Comment: 13 pages, 18 figure

On the Fatigue Life of the Human Anterior Cruciate Ligament: Experimental Studies of the Effects of Limited Internal Femoral Rotation and Microscopic Entheseal Anatomy.

Anterior cruciate ligament (ACL) injuries pose significant health and financial burdens, such as the early development of knee osteoarthritis. It is imperative to better prevent these injuries, but several knowledge gaps exist, including: (1) why athletes with a restricted range of hip internal rotation are more prone to ACL injuries; (2) whether this restriction can increase the ACL’s susceptibility to a fatigue failure; and (3) why the ACL ruptures more frequently near its femoral enthesis, especially the posterolateral fibers during pivot landings. This dissertation addresses these gaps. I hypothesized that limiting range of internal femoral rotation would increase peak ACL strain and risk of ACL fatigue failure during in vitro single-leg pivot landings. A custom-built testing apparatus applied an impulsive load, which induced knee compression, flexion moment, and internal tibial torque to human male and female knee specimens. A novel femoral rotation device controlled internal femoral rotation. As the range of internal femoral rotation was decreased, peak ACL strain increased 1.3% per 10° decrease and ACL fatigue failure risk increased 17-fold, when accounting for sex of specimen donor. These results suggest that screening for a limited range of hip internal rotation should become a component of ACL injury prevention programs and evaluation protocols for those with ACL injuries and/or reconstructions. I also hypothesized that micro-anatomical differences would exist between ACL entheses, as well as regionally within the femoral enthesis. The microscopic appearance of the ACL entheses was quantified in unembalmed human knee specimens using standard histological methods. The femoral enthesis had more fibrocartilage and a more acute ligament entheseal attachment angle than the tibial enthesis. The profiles of the femoral entheseal tidemarks varied within an enthesis and between donors, with six profiles predominating, but bilateral similarities existed. Within the femoral enthesis, there was more fibrocartilage in the inferior region of the origin of the anteromedial fibers. These fibers originated from the femur at a more acute angle than the posterolateral fibers. Perhaps these differences can induce a strain concentration at the inferior margin of the posterolateral fibers femoral enthesis, thus making this region susceptible to damage accumulation, during pivot landings.PhDKinesiologyUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/111583/1/mbeaulie_1.pd

Directed transport in a classical lattice with a high-frequency driving

We analyze the dynamics of a classical particle in a spatially periodic potential under the influence of a periodic in time uniform force. It was shown in [S.Flach, O.Yevtushenko, Y. Zolotaryuk, Phys. Rev. Lett. 84, 2358 (2000)] that despite zero average force, directed transport is possible in the system. Asymptotic description of this phenomenon for the case of slow driving was developed in [X. Leoncini, A. Neishtadt, A. Vasiliev, Phys. Rev. E 79, 026213 (2009)]. Here we consider the case of fast driving using canonical perturbation theory. An asymptotic formula is derived for the average drift velocity as a function of the system parameters and the driving law. We show that directed transport arises in an effective Hamiltonian that does not possess chaotic dynamics, thereby clarifying the relation between chaos and transport in the system. Sufficient conditions for transport are derived.Comment: 5 page