4,417 research outputs found
Meta-learning algorithms and applications
Meta-learning in the broader context concerns how an agent learns about their own learning, allowing them to improve their learning process. Learning how to learn is not only beneficial for humans, but it has also shown vast benefits for improving how machines learn. In the context of machine learning, meta-learning enables models to improve their learning process by selecting suitable meta-parameters that influence the learning. For deep learning specifically, the meta-parameters typically describe details of the training of the model but can also include description of the model itself - the architecture. Meta-learning is usually done with specific goals in mind, for example trying to improve ability to generalize or learn new concepts from only a few examples.
Meta-learning can be powerful, but it comes with a key downside: it is often computationally costly. If the costs would be alleviated, meta-learning could be more accessible to developers of new artificial intelligence models, allowing them to achieve greater goals or save resources. As a result, one key focus of our research is on significantly improving the efficiency of meta-learning. We develop two approaches: EvoGrad and PASHA, both of which significantly improve meta-learning efficiency in two common scenarios. EvoGrad allows us to efficiently optimize the value of a large number of differentiable meta-parameters, while PASHA enables us to efficiently optimize any type of meta-parameters but fewer in number.
Meta-learning is a tool that can be applied to solve various problems. Most commonly it is applied for learning new concepts from only a small number of examples (few-shot learning), but other applications exist too. To showcase the practical impact that meta-learning can make in the context of neural networks, we use meta-learning as a novel solution for two selected problems: more accurate uncertainty quantification (calibration) and general-purpose few-shot learning. Both are practically important problems and using meta-learning approaches we can obtain better solutions than the ones obtained using existing approaches. Calibration is important for safety-critical applications of neural networks, while general-purpose few-shot learning tests model's ability to generalize few-shot learning abilities across diverse tasks such as recognition, segmentation and keypoint estimation.
More efficient algorithms as well as novel applications enable the field of meta-learning to make more significant impact on the broader area of deep learning and potentially solve problems that were too challenging before. Ultimately both of them allow us to better utilize the opportunities that artificial intelligence presents
Self-supervised learning for transferable representations
Machine learning has undeniably achieved remarkable advances thanks to large labelled datasets and supervised learning. However, this progress is constrained by the labour-intensive annotation process. It is not feasible to generate extensive labelled datasets for every problem we aim to address. Consequently, there has been a notable shift in recent times toward approaches that solely leverage raw data. Among these, self-supervised learning has emerged as a particularly powerful approach, offering scalability to massive datasets and showcasing considerable potential for effective knowledge transfer. This thesis investigates self-supervised representation learning with a strong focus on computer vision applications. We provide a comprehensive survey of self-supervised methods across various modalities, introducing a taxonomy that categorises them into four distinct families while also highlighting practical considerations for real-world implementation. Our focus thenceforth is on the computer vision modality, where we perform a comprehensive benchmark evaluation of state-of-the-art self supervised models against many diverse downstream transfer tasks. Our findings reveal that self-supervised models often outperform supervised learning across a spectrum of tasks, albeit with correlations weakening as tasks transition beyond classification, particularly for datasets with distribution shifts. Digging deeper, we investigate the influence of data augmentation on the transferability of contrastive learners, uncovering a trade-off between spatial and appearance-based invariances that generalise to real-world transformations. This begins to explain the differing empirical performances achieved by self-supervised learners on different downstream tasks, and it showcases the advantages of specialised representations produced with tailored augmentation. Finally, we introduce a novel self-supervised pre-training algorithm for object detection, aligning pre-training with downstream architecture and objectives, leading to reduced localisation errors and improved label efficiency. In conclusion, this thesis contributes a comprehensive understanding of self-supervised representation learning and its role in enabling effective transfer across computer vision tasks
Multidisciplinary perspectives on Artificial Intelligence and the law
This open access book presents an interdisciplinary, multi-authored, edited collection of chapters on Artificial Intelligence (‘AI’) and the Law. AI technology has come to play a central role in the modern data economy. Through a combination of increased computing power, the growing availability of data and the advancement of algorithms, AI has now become an umbrella term for some of the most transformational technological breakthroughs of this age. The importance of AI stems from both the opportunities that it offers and the challenges that it entails. While AI applications hold the promise of economic growth and efficiency gains, they also create significant risks and uncertainty. The potential and perils of AI have thus come to dominate modern discussions of technology and ethics – and although AI was initially allowed to largely develop without guidelines or rules, few would deny that the law is set to play a fundamental role in shaping the future of AI. As the debate over AI is far from over, the need for rigorous analysis has never been greater. This book thus brings together contributors from different fields and backgrounds to explore how the law might provide answers to some of the most pressing questions raised by AI. An outcome of the Católica Research Centre for the Future of Law and its interdisciplinary working group on Law and Artificial Intelligence, it includes contributions by leading scholars in the fields of technology, ethics and the law.info:eu-repo/semantics/publishedVersio
Advances and Challenges of Multi-task Learning Method in Recommender System: A Survey
Multi-task learning has been widely applied in computational vision, natural
language processing and other fields, which has achieved well performance. In
recent years, a lot of work about multi-task learning recommender system has
been yielded, but there is no previous literature to summarize these works. To
bridge this gap, we provide a systematic literature survey about multi-task
recommender systems, aiming to help researchers and practitioners quickly
understand the current progress in this direction. In this survey, we first
introduce the background and the motivation of the multi-task learning-based
recommender systems. Then we provide a taxonomy of multi-task learning-based
recommendation methods according to the different stages of multi-task learning
techniques, which including task relationship discovery, model architecture and
optimization strategy. Finally, we raise discussions on the application and
promising future directions in this area
2023-2024 Catalog
The 2023-2024 Governors State University Undergraduate and Graduate Catalog is a comprehensive listing of current information regarding:Degree RequirementsCourse OfferingsUndergraduate and Graduate Rules and Regulation
Archaeological palaeoenvironmental archives: challenges and potential
This Arts and Humanities Research Council (AHRC) sponsored collaborative doctoral project represents one of
the most significant efforts to collate quantitative and qualitative data that can elucidate practices related to
archaeological palaeoenvironmental archiving in England. The research has revealed that archived
palaeoenvironmental remains are valuable resources for archaeological research and can clarify subjects that
include the adoption and importation of exotic species, plant and insect invasion, human health and diet, and
plant and animal husbandry practices. In addition to scientific research, archived palaeoenvironmental remains
can provide evidence-based narratives of human resilience and climate change and offer evidence of the
scientific process, making them ideal resources for public science engagement. These areas of potential have
been realised at an imperative time; given that waterlogged palaeoenvironmental remains at significant sites
such as Star Carr, Must Farm, and Flag Fen, archaeological deposits in towns and cities are at risk of decay due
to climate change-related factors, and unsustainable agricultural practices. Innovative approaches to collecting
and archiving palaeoenvironmental remains and maintaining existing archives will permit the creation of an
accessible and thorough national resource that can service archaeologists and researchers in the related fields
of biology and natural history. Furthermore, a concerted effort to recognise absences in archaeological
archives, matched by an effort to supply these deficiencies, can produce a resource that can contribute to an
enduring geographical and temporal record of England's biodiversity, which can be used in perpetuity in the
face of diminishing archaeological and contemporary natural resources.
To realise these opportunities, particular challenges must be overcome. The most prominent of these include
inconsistent collection policies resulting from pressures associated with shortages in storage capacity and
declining specialist knowledge in museums and repositories combined with variable curation practices. Many of
these challenges can be resolved by developing a dedicated storage facility that can focus on the ongoing
conservation and curation of palaeoenvironmental remains. Combined with an OASIS + module designed to
handle and disseminate data pertaining to palaeoenvironmental archives, remains would be findable,
accessible, and interoperable with biological archives and collections worldwide. Providing a national centre for
curating palaeoenvironmental remains and a dedicated digital repository will require significant funding.
Funding sources could be identified through collaboration with other disciplines. If sufficient funding cannot be
identified, options that would require less financial investment, such as high-level archive audits and the
production of guidance documents, will be able to assist all stakeholders with the improved curation,
management, and promotion of the archived resource
Proceedings of SIRM 2023 - The 15th European Conference on Rotordynamics
It was our great honor and pleasure to host the SIRM Conference after 2003 and 2011 for the third time in Darmstadt. Rotordynamics covers a huge variety of different applications and challenges which are all in the scope of this conference. The conference was opened with a keynote lecture given by Rainer Nordmann, one of the three founders of SIRM “Schwingungen in rotierenden Maschinen”. In total 53 papers passed our strict review process and were presented. This impressively shows that rotordynamics is relevant as ever. These contributions cover a very wide spectrum of session topics: fluid bearings and seals; air foil bearings; magnetic bearings; rotor blade interaction; rotor fluid interactions; unbalance and balancing; vibrations in turbomachines; vibration control; instability; electrical machines; monitoring, identification and diagnosis; advanced numerical tools and nonlinearities as well as general rotordynamics. The international character of the conference has been significantly enhanced by the Scientific Board since the 14th SIRM resulting on one hand in an expanded Scientific Committee which meanwhile consists of 31 members from 13 different European countries and on the other hand in the new name “European Conference on Rotordynamics”. This new international profile has also been
emphasized by participants of the 15th SIRM coming from 17 different countries out of three continents. We experienced a vital discussion and dialogue between industry and academia at the conference where roughly one third of the papers were presented by industry and two thirds by academia being an excellent basis to follow a bidirectional transfer what we call xchange at Technical University of Darmstadt. At this point we also want to give our special thanks to the eleven industry sponsors for their great support of the conference. On behalf of the Darmstadt Local Committee I welcome you to read the papers of the 15th SIRM giving you further insight into the topics and presentations
- …