6,287 research outputs found

    Modular lifelong machine learning

    Get PDF
    Deep learning has drastically improved the state-of-the-art in many important fields, including computer vision and natural language processing (LeCun et al., 2015). However, it is expensive to train a deep neural network on a machine learning problem. The overall training cost further increases when one wants to solve additional problems. Lifelong machine learning (LML) develops algorithms that aim to efficiently learn to solve a sequence of problems, which become available one at a time. New problems are solved with less resources by transferring previously learned knowledge. At the same time, an LML algorithm needs to retain good performance on all encountered problems, thus avoiding catastrophic forgetting. Current approaches do not possess all the desired properties of an LML algorithm. First, they primarily focus on preventing catastrophic forgetting (Diaz-Rodriguez et al., 2018; Delange et al., 2021). As a result, they neglect some knowledge transfer properties. Furthermore, they assume that all problems in a sequence share the same input space. Finally, scaling these methods to a large sequence of problems remains a challenge. Modular approaches to deep learning decompose a deep neural network into sub-networks, referred to as modules. Each module can then be trained to perform an atomic transformation, specialised in processing a distinct subset of inputs. This modular approach to storing knowledge makes it easy to only reuse the subset of modules which are useful for the task at hand. This thesis introduces a line of research which demonstrates the merits of a modular approach to lifelong machine learning, and its ability to address the aforementioned shortcomings of other methods. Compared to previous work, we show that a modular approach can be used to achieve more LML properties than previously demonstrated. Furthermore, we develop tools which allow modular LML algorithms to scale in order to retain said properties on longer sequences of problems. First, we introduce HOUDINI, a neurosymbolic framework for modular LML. HOUDINI represents modular deep neural networks as functional programs and accumulates a library of pre-trained modules over a sequence of problems. Given a new problem, we use program synthesis to select a suitable neural architecture, as well as a high-performing combination of pre-trained and new modules. We show that our approach has most of the properties desired from an LML algorithm. Notably, it can perform forward transfer, avoid negative transfer and prevent catastrophic forgetting, even across problems with disparate input domains and problems which require different neural architectures. Second, we produce a modular LML algorithm which retains the properties of HOUDINI but can also scale to longer sequences of problems. To this end, we fix the choice of a neural architecture and introduce a probabilistic search framework, PICLE, for searching through different module combinations. To apply PICLE, we introduce two probabilistic models over neural modules which allows us to efficiently identify promising module combinations. Third, we phrase the search over module combinations in modular LML as black-box optimisation, which allows one to make use of methods from the setting of hyperparameter optimisation (HPO). We then develop a new HPO method which marries a multi-fidelity approach with model-based optimisation. We demonstrate that this leads to improvement in anytime performance in the HPO setting and discuss how this can in turn be used to augment modular LML methods. Overall, this thesis identifies a number of important LML properties, which have not all been attained in past methods, and presents an LML algorithm which can achieve all of them, apart from backward transfer

    Towards A Practical High-Assurance Systems Programming Language

    Full text link
    Writing correct and performant low-level systems code is a notoriously demanding job, even for experienced developers. To make the matter worse, formally reasoning about their correctness properties introduces yet another level of complexity to the task. It requires considerable expertise in both systems programming and formal verification. The development can be extremely costly due to the sheer complexity of the systems and the nuances in them, if not assisted with appropriate tools that provide abstraction and automation. Cogent is designed to alleviate the burden on developers when writing and verifying systems code. It is a high-level functional language with a certifying compiler, which automatically proves the correctness of the compiled code and also provides a purely functional abstraction of the low-level program to the developer. Equational reasoning techniques can then be used to prove functional correctness properties of the program on top of this abstract semantics, which is notably less laborious than directly verifying the C code. To make Cogent a more approachable and effective tool for developing real-world systems, we further strengthen the framework by extending the core language and its ecosystem. Specifically, we enrich the language to allow users to control the memory representation of algebraic data types, while retaining the automatic proof with a data layout refinement calculus. We repurpose existing tools in a novel way and develop an intuitive foreign function interface, which provides users a seamless experience when using Cogent in conjunction with native C. We augment the Cogent ecosystem with a property-based testing framework, which helps developers better understand the impact formal verification has on their programs and enables a progressive approach to producing high-assurance systems. Finally we explore refinement type systems, which we plan to incorporate into Cogent for more expressiveness and better integration of systems programmers with the verification process

    Fairness Testing: A Comprehensive Survey and Analysis of Trends

    Full text link
    Unfair behaviors of Machine Learning (ML) software have garnered increasing attention and concern among software engineers. To tackle this issue, extensive research has been dedicated to conducting fairness testing of ML software, and this paper offers a comprehensive survey of existing studies in this field. We collect 100 papers and organize them based on the testing workflow (i.e., how to test) and testing components (i.e., what to test). Furthermore, we analyze the research focus, trends, and promising directions in the realm of fairness testing. We also identify widely-adopted datasets and open-source tools for fairness testing

    Art and Creativity for HIV/AIDS Awareness, Prevention, and Empowerment of Young People in Uganda

    Get PDF
    Art, youth engagement and informality in the context of HIV prevention have been generally ignored by most researchers and stakeholders within the HIV programming and policy arenas, thus silencing the plight of urban youth infected with and affected by HIV/AIDS. In response, this thesis draws on the case of peri-urban settings of Kampala, Uganda to bring geographies of applied sculpture, HIV/AIDS prevention, and youth empowerment into dialogue, informed by the notions of art having the capacity to move beyond the spaces of galleries into an expanded field, and thus, beyond the visual and into the social spheres. In liaison with local NGOs (The Uganda AIDS Support Organisation - TASO, National Guidance and Empowerment Network for People Living with HIV/AIDS - NGEN+ and Lungujja Community based Health care Organisation – LUCOHECO, it adopts a mixed methodological approach, including applied art and participatory techniques - observation, video, storytelling, and interviews, to understand the lived experiences of young people (15-24 years) in marginalized spaces in Kampala. The thesis first examines the general context of using ethnography and applied social sculpture to explore every day experiences by facilitating the engagement of young people in open communication about the epidemic. This is intended to enable them to act in confronting stigma, taboos, and their precarious existence, while raising their awareness about HIV/AIDS. The thesis then explores the everyday precarious existence of young people in informal settings in Kampala. It proceeds to examine how workshops with these young people allowed collective engagement which, in turn, influenced the creation of artworks envisioned to act as communication tools for raising awareness of HIV/AIDS with the potential for livelihood benefits. Finally, the thesis examines young people’s active involvement in participatory workshops for HIV/AIDS prevention, providing ethnographic evidence regarding the artmaking process, the conversations that ensued as they worked, and the creation of applied objects/forms that enabled them to build their confidence to freely express about the precarities affecting their lives, countering taboos, and encouraging them to change their behaviours and practices while potentially acting as change agents in their own communities. It highlights the significance of stimulating open conversations about HIV/AIDS - as a starting point towards confronting stigma and other aspects of precarity, while advocating for the incorporation of the approach into practice by public health experts, policymakers, and development practitioners. The thesis shows the strengths of applied sculpture as an approach that has potential for making sense of ordinary everyday experiences, finding meaning and crafting clarity of young people’s lived experiences in the context of HIV/AIDS. It concludes that applied sculpture is potentially an important tool in tackling HIV/AIDS and its attendant problems by engendering and facilitating open conversations and social economic development through an engagement with the voices and agency of young people in Uganda and beyond

    Anime Studies: media-specific approaches to neon genesis evangelion

    Get PDF
    Anime Studies: Media-Specific Approaches to Neon Genesis Evangelion aims at advancing the study of anime, understood as largely TV-based genre fiction rendered in cel, or cel-look, animation with a strong affinity to participatory cultures and media convergence. Making Neon Genesis Evangelion (Shin Seiki Evangerion, 1995-96) its central case and nodal point, this volumen forground anime as a media with clearly recognizable aesthetic properties, (sub)cultural affordances and situated discourses

    John\u27s Canonical Portrait of Christ: A Biblical-Theological Approach to the Depiction of the Glorified Christ in Revelation 1

    Get PDF
    Throughout the history of evangelical scholarship, a significant lacuna has formed in Apocalyptic studies. Many theologians have expressed fear or uncertainty concerning the text of Revelation as numerous ambiguous aspects exist within the Apocalypse. A proposed path forward into the gap in scholarship is to return the focus to the intent of the author of Revelation, John the apostle, and examine the definitive truths of the text. John’s priority is revealed in the initial chapter as he depicts the subject of his Apocalypse, Jesus Christ. This intent is revealed in John’s use of allusions, metaphors, and other rhetorical devices through which John draws upon the other books of the Christian canon. This dissertation focuses on analyzing John’s description of Christ in the initial chapter of the Apocalypse. As John depicts Christ, the protagonist of Revelation, he describes Him through titles, descriptions, and attributes that appear elsewhere in Scripture. This study examines the appearance of these canonical similarities concerning their place in the biblical text. The analysis dedicates a chapter to exegeting the OT and NT resemblances, respectively, before moving to the use of the terminology within Revelation itself. John’s writing style in the Apocalypse makes this endeavor unique from such studies elsewhere in Scripture. While Revelation is saturated with allusions to other parts of the canon, John does not use formal citations in the Apocalypse that scholars of other parts of the NT may be accustomed to. Thorough exegesis reveals that the task is a worthwhile endeavor, as Christological truths are revealed through John’s use of the canon. John’s high Christology is evident throughout this study through his compositional method in the Apocalypse. This dissertation aims to highlight this Christology and demonstrate its purposeful inclusion in Revelation’s initial chapter

    2023-2024 Boise State University Undergraduate Catalog

    Get PDF
    This catalog is primarily for and directed at students. However, it serves many audiences, such as high school counselors, academic advisors, and the public. In this catalog you will find an overview of Boise State University and information on admission, registration, grades, tuition and fees, financial aid, housing, student services, and other important policies and procedures. However, most of this catalog is devoted to describing the various programs and courses offered at Boise State

    Urban Space, Genre and Subjectivity in African and Latin American Cinema

    Full text link
    This project studies twelve African and Latin American films from a range of eras and countries, with an emphasis on their treatment of urban space, their manipulation of genre elements, and their approaches to character subjectivity. The analysis draws on major works of urban theory by Henri Lefebvre, Manuel Castells, David Harvey, Jane Jacobs, and others in order to investigate the relationship between cinema and the urban experience. As the films in the study are mostly set in cities that are not discussed by the theorists, the analysis entails testing their theories against the realities of these other settings, as depicted in the films. Furthermore, as these films depict places and people not usually featured in commercial cinema, this project will emphasize ways in which the films challenge dominant patterns of cinematic representation with regard to African and Latin American people, places and culture. Finally, this project will analyze important structural and stylistic nuances of each film in order to contribute to existing discussions of African and Latin American film and global film in general

    John Singer Sargent in Spain: Eluding the Stereotype

    Full text link
    The aim of this thesis is to present John Singer Sargent\u27s unique vision of Spain as well as to analyze this part of his work through the use of methodologies such as Orientalism and Spanish cultural studies, an approach that has not been undertaken to date. The thesis intends to demonstrate that Sargent\u27s early paintings -along with those of his American counterparts who traveled to Paris- were strongly motivated by the prevailing cultural orientalism of the moment in France, one of those extensions being the so called españolismo that exacerbated the most stereotyped dimensions of Spanish history and culture. Undoubtedly, the artist\u27s most iconic work related to Spain is El Jaleo, which could be considered the pinnacle of the portrayal of Spain in the Western imaginary at the end of the XIX century. However, despite the great success obtained by this canvas, the artist rarely portrayed images with this subject matter again. On the contrary, he refrained from depicting images as highly topic-oriented as this one, being aware that by doing so he was perpetuating a stereotyped image of Spain. This idea is at the core of our thesis, which will try to demonstrate Sargent deliberately rejected this colonial vision of Spain and focused on realistic and aestheticized representations of the country

    Worshipping at the Shrine of Wagner: Fandom, Media and Richard Wagner

    Get PDF
    Nineteenth-century opera composer Richard Wagner has long inspired passionate responses, with contemporary commentators often noting the cult-like reverence with which lovers approached his operas. In the years since, however, interest in Wagner’s art has not disappeared. In this dissertation, I explore the contours of modern Wagnerism using as my primary case study the Toronto Wagner Society, asking how members incorporate opera into their lives and what Wagner means to them. To do this, I employ a multimethodology of ethnography, an examination of Wagner’s art and rhetoric, and a consideration of the materiality of opera. These findings are analyzed through a dual lens of fan studies and cultural techniques, with which this dissertation makes two principal moves: first, to highlight how fandom of high culture is different in nature, not in kind to fandom of popular culture; second, to propose a networked model of fandom, one which conceptualizes fandom as a dynamic assemblage of audience, media and text. Chapter 1 opens by asking what is a fan, which I resolve through the introduction of cultural techniques, and subsequently, my networked model of fandom. I also consider how cultural techniques research might expand to include ethnography. Chapter 2 lays out the main findings of my interview. Particularly, I examine how aging intersects with reception, how fans re-enact the distinction between German and Italian opera, and the joy of opera as an explicitly performance art. Chapter 3 tackles the dual description of Wagner as both “work” and “overwhelming.” By taking seriously Theodor Adorno’s criticism, I illustrate how his music and rhetoric exert their agency onto fans. The final chapter studies the materiality of reception. Employing the metaphor of Michel Serres’ parasite, I analyze how the media which host opera shape reception through an examination of the role of the theatre, and by tracking mentions of Wagner in Toronto’s Globe newspaper in the years 1875–1876
    • 

    corecore