6,354 research outputs found

    Modular lifelong machine learning

    Get PDF
    Deep learning has drastically improved the state-of-the-art in many important fields, including computer vision and natural language processing (LeCun et al., 2015). However, it is expensive to train a deep neural network on a machine learning problem. The overall training cost further increases when one wants to solve additional problems. Lifelong machine learning (LML) develops algorithms that aim to efficiently learn to solve a sequence of problems, which become available one at a time. New problems are solved with less resources by transferring previously learned knowledge. At the same time, an LML algorithm needs to retain good performance on all encountered problems, thus avoiding catastrophic forgetting. Current approaches do not possess all the desired properties of an LML algorithm. First, they primarily focus on preventing catastrophic forgetting (Diaz-Rodriguez et al., 2018; Delange et al., 2021). As a result, they neglect some knowledge transfer properties. Furthermore, they assume that all problems in a sequence share the same input space. Finally, scaling these methods to a large sequence of problems remains a challenge. Modular approaches to deep learning decompose a deep neural network into sub-networks, referred to as modules. Each module can then be trained to perform an atomic transformation, specialised in processing a distinct subset of inputs. This modular approach to storing knowledge makes it easy to only reuse the subset of modules which are useful for the task at hand. This thesis introduces a line of research which demonstrates the merits of a modular approach to lifelong machine learning, and its ability to address the aforementioned shortcomings of other methods. Compared to previous work, we show that a modular approach can be used to achieve more LML properties than previously demonstrated. Furthermore, we develop tools which allow modular LML algorithms to scale in order to retain said properties on longer sequences of problems. First, we introduce HOUDINI, a neurosymbolic framework for modular LML. HOUDINI represents modular deep neural networks as functional programs and accumulates a library of pre-trained modules over a sequence of problems. Given a new problem, we use program synthesis to select a suitable neural architecture, as well as a high-performing combination of pre-trained and new modules. We show that our approach has most of the properties desired from an LML algorithm. Notably, it can perform forward transfer, avoid negative transfer and prevent catastrophic forgetting, even across problems with disparate input domains and problems which require different neural architectures. Second, we produce a modular LML algorithm which retains the properties of HOUDINI but can also scale to longer sequences of problems. To this end, we fix the choice of a neural architecture and introduce a probabilistic search framework, PICLE, for searching through different module combinations. To apply PICLE, we introduce two probabilistic models over neural modules which allows us to efficiently identify promising module combinations. Third, we phrase the search over module combinations in modular LML as black-box optimisation, which allows one to make use of methods from the setting of hyperparameter optimisation (HPO). We then develop a new HPO method which marries a multi-fidelity approach with model-based optimisation. We demonstrate that this leads to improvement in anytime performance in the HPO setting and discuss how this can in turn be used to augment modular LML methods. Overall, this thesis identifies a number of important LML properties, which have not all been attained in past methods, and presents an LML algorithm which can achieve all of them, apart from backward transfer

    An Exploration of the Suitability of Pharmacy Education in Saudi Arabia to Prepare Graduates to Meet Healthcare Needs: a Mixed-Methods Study

    Get PDF
    The key role of pharmacists within the health system, particularly in optimising safe, responsible and effective use of medicines, underpins the demand for a highly skilled and competent workforce. Therefore, developing the capacity of pharmacists to attain and maintain essential competencies relevant to the population’s health needs is required to ensure a high standard of patient care, thereby helping to improve patient and population health. In Saudi Arabia, little evidence exists regarding the assessment of national educational programmes’ structure and outcomes. Moreover, no national competency framework exists for pharmacists in any sector or stage of practice. In the absence of such core quality elements to inform pharmacy education assessment and development, the extent to which pharmacy schools in Saudi Arabia prepare competent pharmacists to address societal needs from pharmacy services is unclear. Therefore, this study aimed to explore the extent to which pharmacy education can prepare competent pharmacists to address the healthcare needs for pharmacy practice in Saudi Arabia. An exploratory sequential mixed methods research design was used to address the aim of this study in three phases: individual interviews and focus groups were employed with a purposively selected sample of pharmacy policy makers, pharmacists and the public to explore societal healthcare needs and the roles required of pharmacists to meet those needs; a national online survey of pharmacists and an online nominal group consensus method of pharmacy experts were used to identify competencies considered essential to develop a profession-wide national foundation level competency framework; and a case study in which curriculum mapping of two purposively selected Doctor of Pharmacy (PharmD) curricula was used to assess the extent to which the current pharmacy programme in Saudi Arabia meets the identified competencies of the developed national competency framework. Based on qualitative and quantitative analyses of societal healthcare needs, pharmacists’ roles, core competencies and curricular contents within the local context of Saudi Arabia, findings showed that there is a mismatch between initial education and real practice needs and expectations. While the country’s current needs from pharmacists are to optimise health system capacity and increase access to primary care services and medicines expertise in community pharmacies, the study indicated local education is product-oriented with a focus of curricular content and experiential training opportunities in most schools on preparing future pharmacists for hospital pharmacy practice. The study also identified several gaps between current initial education programmes and the competencies required to practise the expected roles, suggesting that current initial education might not prepare the students sufficiently to provide the full range of quality pharmaceutical services as per the country’s pharmacy practice needs. The study provided a new understanding of graduates’ readiness to practise as per the country’s pharmacy practice needs, the quality of educational programmes and pharmacists' professional development opportunities in Saudi Arabia. Findings maybe used to inform the development of competency-based education and maximise graduates’ capacity to deliver and develop pharmaceutical services effectively to best meet societal healthcare needs in Saudi Arabia

    Exploring the Training Factors that Influence the Role of Teaching Assistants to Teach to Students With SEND in a Mainstream Classroom in England

    Get PDF
    With the implementation of inclusive education having become increasingly valued over the years, the training of Teaching Assistants (TAs) is now more important than ever, given that they work alongside pupils with special educational needs and disabilities (hereinafter SEND) in mainstream education classrooms. The current study explored the training factors that influence the role of TAs when it comes to teaching SEND students in mainstream classrooms in England during their one-year training period. This work aimed to increase understanding of how the training of TAs is seen to influence the development of their personal knowledge and professional skills. The study has significance for our comprehension of the connection between the TAs’ training and the quality of education in the classroom. In addition, this work investigated whether there existed a correlation between the teaching experience of TAs and their background information, such as their gender, age, grade level taught, years of teaching experience, and qualification level. A critical realist theoretical approach was adopted for this two-phased study, which involved the mixing of adaptive and grounded theories respectively. The multi-method project featured 13 case studies, each of which involved a trainee TA, his/her college tutor, and the classroom teacher who was supervising the trainee TA. The analysis was based on using semi-structured interviews, various questionnaires, and non-participant observation methods for each of these case studies during the TA’s one-year training period. The primary analysis of the research was completed by comparing the various kinds of data collected from the participants in the first and second data collection stages of each case. Further analysis involved cross-case analysis using a grounded theory approach, which made it possible to draw conclusions and put forth several core propositions. Compared with previous research, the findings of the current study reveal many implications for the training and deployment conditions of TAs, while they also challenge the prevailing approaches in many aspects, in addition to offering more diversified, enriched, and comprehensive explanations of the critical pedagogical issues

    A Decision Support System for Economic Viability and Environmental Impact Assessment of Vertical Farms

    Get PDF
    Vertical farming (VF) is the practice of growing crops or animals using the vertical dimension via multi-tier racks or vertically inclined surfaces. In this thesis, I focus on the emerging industry of plant-specific VF. Vertical plant farming (VPF) is a promising and relatively novel practice that can be conducted in buildings with environmental control and artificial lighting. However, the nascent sector has experienced challenges in economic viability, standardisation, and environmental sustainability. Practitioners and academics call for a comprehensive financial analysis of VPF, but efforts are stifled by a lack of valid and available data. A review of economic estimation and horticultural software identifies a need for a decision support system (DSS) that facilitates risk-empowered business planning for vertical farmers. This thesis proposes an open-source DSS framework to evaluate business sustainability through financial risk and environmental impact assessments. Data from the literature, alongside lessons learned from industry practitioners, would be centralised in the proposed DSS using imprecise data techniques. These techniques have been applied in engineering but are seldom used in financial forecasting. This could benefit complex sectors which only have scarce data to predict business viability. To begin the execution of the DSS framework, VPF practitioners were interviewed using a mixed-methods approach. Learnings from over 19 shuttered and operational VPF projects provide insights into the barriers inhibiting scalability and identifying risks to form a risk taxonomy. Labour was the most commonly reported top challenge. Therefore, research was conducted to explore lean principles to improve productivity. A probabilistic model representing a spectrum of variables and their associated uncertainty was built according to the DSS framework to evaluate the financial risk for VF projects. This enabled flexible computation without precise production or financial data to improve economic estimation accuracy. The model assessed two VPF cases (one in the UK and another in Japan), demonstrating the first risk and uncertainty quantification of VPF business models in the literature. The results highlighted measures to improve economic viability and the viability of the UK and Japan case. The environmental impact assessment model was developed, allowing VPF operators to evaluate their carbon footprint compared to traditional agriculture using life-cycle assessment. I explore strategies for net-zero carbon production through sensitivity analysis. Renewable energies, especially solar, geothermal, and tidal power, show promise for reducing the carbon emissions of indoor VPF. Results show that renewably-powered VPF can reduce carbon emissions compared to field-based agriculture when considering the land-use change. The drivers for DSS adoption have been researched, showing a pathway of compliance and design thinking to overcome the ‘problem of implementation’ and enable commercialisation. Further work is suggested to standardise VF equipment, collect benchmarking data, and characterise risks. This work will reduce risk and uncertainty and accelerate the sector’s emergence

    OLIG2 neural progenitor cell development and fate in Down syndrome

    Full text link
    Down syndrome (DS) is caused by triplication of human chromosome 21 (HSA21) and is the most common genetic form of intellectual disability. It is unknown precisely how triplication of HSA21 results in the intellectual disability, but it is thought that the global transcriptional dysregulation caused by trisomy 21 perturbs multiple aspects of neurodevelopment that cumulatively contribute to its etiology. While the characteristics associated with DS can arise from any of the genes triplicated on HSA21, in this work we focus on oligodendrocyte transcription factor 2 (OLIG2). The progeny of neural progenitor cells (NPCs) expressing OLIG2 are likely to be involved in many of the cellular changes underlying the intellectual disability in DS. To explore the fate of OLIG2+ neural progenitors, we took advantage of two distinct models of DS, the Ts65Dn mouse model and induced pluripotent stem cells (iPSCs) derived from individuals with DS. Our results from these two systems identified multiple perturbations in development in the cellular progeny of OLIG2+ NPCs. In Ts65Dn, we identified alterations in neurons and glia derived from the OLIG2 expressing progenitor domain in the ventral spinal cord. There were significant differences in the number of motor neurons and interneurons present in the trisomic lumbar spinal cord depending on age of the animal pointing both to a neurodevelopment and a neurodegeneration phenotype in the Ts65Dn mice. Of particular note, we identified changes in oligodendrocyte (OL) maturation in the trisomic mice that are dependent on spatial location and developmental origin. In the dorsal corticospinal tract, there were significantly fewer mature OLs in the trisomic mice, and in the lateral funiculus we observed the opposite phenotype with more mature OLs being present in the trisomic animals. We then transitioned our studies into iPSCs where we were able to pattern OLIG2+ NPCs to either a spinal cord-like or a brain-like identity and study the OL lineage that differentiated from each progenitor pool. Similar to the region-specific dysregulation found in the Ts65Dn spinal cord, we identified perturbations in trisomic OLs that were dependent on whether the NPCs had been patterned to a brain-like or spinal cord-like fate. In the spinal cord-like NPCs, there was no difference in the proportion of cells expressing either OLIG2 or NKX2.2, the two transcription factors whose co-expression is essential for OL differentiation. Conversely, in the brain-like NPCs, there was a significant increase in OLIG2+ cells in the trisomic culture and a decrease in NKX2.2 mRNA expression. We identified a sonic hedgehog (SHH) signaling based mechanism underlying these changes in OLIG2 and NKX2.2 expression in the brain-like NPCs and normalized the proportion of trisomic cells expressing the transcription factors to euploid levels by modulating the activity of the SHH pathway. Finally, we continued the differentiation of the brain-like and spinal cord-like NPCs to committed OL precursor cells (OPCs) and allowed them to mature. We identified an increase in OPC production in the spinal cord-like trisomic culture which was not present in the brain-like OPCs. Conversely, we identified a maturation deficit in the brain-like trisomic OLs that was not present in the spinal cord-like OPCs. These results underscore the importance of regional patterning in characterizing changes in cell differentiation and fate in DS. Together, the findings presented in this work contribute to the understanding of the cellular and molecular etiology of the intellectual disability in DS and in particular the contribution of cells differentiated from OLIG2+ progenitors

    Strategies for Early Learners

    Get PDF
    Welcome to learning about how to effectively plan curriculum for young children. This textbook will address: • Developing curriculum through the planning cycle • Theories that inform what we know about how children learn and the best ways for teachers to support learning • The three components of developmentally appropriate practice • Importance and value of play and intentional teaching • Different models of curriculum • Process of lesson planning (documenting planned experiences for children) • Physical, temporal, and social environments that set the stage for children’s learning • Appropriate guidance techniques to support children’s behaviors as the self-regulation abilities mature. • Planning for preschool-aged children in specific domains including o Physical development o Language and literacy o Math o Science o Creative (the visual and performing arts) o Diversity (social science and history) o Health and safety • Making children’s learning visible through documentation and assessmenthttps://scholar.utc.edu/open-textbooks/1001/thumbnail.jp

    Efficient instance and hypothesis space revision in Meta-Interpretive Learning

    Get PDF
    Inductive Logic Programming (ILP) is a form of Machine Learning. The goal of ILP is to induce hypotheses, as logic programs, that generalise training examples. ILP is characterised by a high expressivity, generalisation ability and interpretability. Meta-Interpretive Learning (MIL) is a state-of-the-art sub-field of ILP. However, current MIL approaches have limited efficiency: the sample and learning complexity respectively are polynomial and exponential in the number of clauses. My thesis is that improvements over the sample and learning complexity can be achieved in MIL through instance and hypothesis space revision. Specifically, we investigate 1) methods that revise the instance space, 2) methods that revise the hypothesis space and 3) methods that revise both the instance and the hypothesis spaces for achieving more efficient MIL. First, we introduce a method for building training sets with active learning in Bayesian MIL. Instances are selected maximising the entropy. We demonstrate this method can reduce the sample complexity and supports efficient learning of agent strategies. Second, we introduce a new method for revising the MIL hypothesis space with predicate invention. Our method generates predicates bottom-up from the background knowledge related to the training examples. We demonstrate this method is complete and can reduce the learning and sample complexity. Finally, we introduce a new MIL system called MIGO for learning optimal two-player game strategies. MIGO learns from playing: its training sets are built from the sequence of actions it chooses. Moreover, MIGO revises its hypothesis space with Dependent Learning: it first solves simpler tasks and can reuse any learned solution for solving more complex tasks. We demonstrate MIGO significantly outperforms both classical and deep reinforcement learning. The methods presented in this thesis open exciting perspectives for efficiently learning theories with MIL in a wide range of applications including robotics, modelling of agent strategies and game playing.Open Acces

    In Defence of Social Justice:A Qualitative Study on an Intergroup Dialogue Programme in American Higher Education

    Get PDF
    The continuous struggle for equity in American culture and the recent racial tensions on university campuses across the United States prompt further exploration into innovative initiatives that maximise the educational benefits of diversity in higher education. Intergroup dialogue (IGD) has gained recognition as a transformative social justice education practice that focuses on issues of diversity and inequality while employing critical, democratic pedagogies. This qualitative study examines the extent dialogue across identity differences can be used in higher education to motivate awareness about and actions in defence of social justice. Freire’s (1970, 1974) critical pedagogy framework is combined with Pettigrew’s (1998) intergroup contact theory to provide theoretical context for examining the complex learning experiences and outcomes of intergroup dialogue. This theoretical framework positions the examination of intergroup dialogue as a social justice praxis versus intergroup dialogue as an individual intervention with intergroup harmony as its objective. The study uses qualitative data from focus groups with voluntary participants from a convenience sample of students who enrolled in an intergroup dialogue class at a US-based university (anonymised as USU in this thesis) in the autumn semester 2017. The study found that IGD shows promising results on the individual level, facilitating deeper awareness and understanding of social injustice, but does not seem to have an influence on supporting social justice at the institutional and systemic levels
    • …
    corecore