6,803 research outputs found

    Is attention all you need in medical image analysis? A review

    Full text link
    Medical imaging is a key component in clinical diagnosis, treatment planning and clinical trial design, accounting for almost 90% of all healthcare data. CNNs achieved performance gains in medical image analysis (MIA) over the last years. CNNs can efficiently model local pixel interactions and be trained on small-scale MI data. The main disadvantage of typical CNN models is that they ignore global pixel relationships within images, which limits their generalisation ability to understand out-of-distribution data with different 'global' information. The recent progress of Artificial Intelligence gave rise to Transformers, which can learn global relationships from data. However, full Transformer models need to be trained on large-scale data and involve tremendous computational complexity. Attention and Transformer compartments (Transf/Attention) which can well maintain properties for modelling global relationships, have been proposed as lighter alternatives of full Transformers. Recently, there is an increasing trend to co-pollinate complementary local-global properties from CNN and Transf/Attention architectures, which led to a new era of hybrid models. The past years have witnessed substantial growth in hybrid CNN-Transf/Attention models across diverse MIA problems. In this systematic review, we survey existing hybrid CNN-Transf/Attention models, review and unravel key architectural designs, analyse breakthroughs, and evaluate current and future opportunities as well as challenges. We also introduced a comprehensive analysis framework on generalisation opportunities of scientific and clinical impact, based on which new data-driven domain generalisation and adaptation methods can be stimulated

    Reinforcement learning in large state action spaces

    Get PDF
    Reinforcement learning (RL) is a promising framework for training intelligent agents which learn to optimize long term utility by directly interacting with the environment. Creating RL methods which scale to large state-action spaces is a critical problem towards ensuring real world deployment of RL systems. However, several challenges limit the applicability of RL to large scale settings. These include difficulties with exploration, low sample efficiency, computational intractability, task constraints like decentralization and lack of guarantees about important properties like performance, generalization and robustness in potentially unseen scenarios. This thesis is motivated towards bridging the aforementioned gap. We propose several principled algorithms and frameworks for studying and addressing the above challenges RL. The proposed methods cover a wide range of RL settings (single and multi-agent systems (MAS) with all the variations in the latter, prediction and control, model-based and model-free methods, value-based and policy-based methods). In this work we propose the first results on several different problems: e.g. tensorization of the Bellman equation which allows exponential sample efficiency gains (Chapter 4), provable suboptimality arising from structural constraints in MAS(Chapter 3), combinatorial generalization results in cooperative MAS(Chapter 5), generalization results on observation shifts(Chapter 7), learning deterministic policies in a probabilistic RL framework(Chapter 6). Our algorithms exhibit provably enhanced performance and sample efficiency along with better scalability. Additionally, we also shed light on generalization aspects of the agents under different frameworks. These properties have been been driven by the use of several advanced tools (e.g. statistical machine learning, state abstraction, variational inference, tensor theory). In summary, the contributions in this thesis significantly advance progress towards making RL agents ready for large scale, real world applications

    Machine learning and mixed reality for smart aviation: applications and challenges

    Get PDF
    The aviation industry is a dynamic and ever-evolving sector. As technology advances and becomes more sophisticated, the aviation industry must keep up with the changing trends. While some airlines have made investments in machine learning and mixed reality technologies, the vast majority of regional airlines continue to rely on inefficient strategies and lack digital applications. This paper investigates the state-of-the-art applications that integrate machine learning and mixed reality into the aviation industry. Smart aerospace engineering design, manufacturing, testing, and services are being explored to increase operator productivity. Autonomous systems, self-service systems, and data visualization systems are being researched to enhance passenger experience. This paper investigate safety, environmental, technological, cost, security, capacity, and regulatory challenges of smart aviation, as well as potential solutions to ensure future quality, reliability, and efficiency

    Facilitating prosociality through technology: Design to promote digital volunteerism

    Get PDF
    Volunteerism covers many activities involving no financial rewards for volunteers but which contribute to the common good. There is existing work in designing technology for volunteerism in HumanComputer Interaction (HCI) and related disciplines that focuses on motivation to improve performance, but it does not account for volunteer wellbeing. Here, I investigate digital volunteerism in three case studies with a focus on volunteer motivation, engagement, and wellbeing. My research involved volunteers and others in the volunteering context to generate recommendations for a volunteer-centric design for digital volunteerism. The thesis has three aims: 1. To investigate motivational aspects critical for enhancing digital volunteers’ experiences 2. To identify digital platform attributes linked to volunteer wellbeing 3. To create guidelines for effectively supporting volunteer engagement in digital volunteering platforms In the first case study I investigate the design of a chat widget for volunteers working in an organisation with a view to develop a design that improves their workflow and wellbeing. The second case study investigates the needs, motivations, and wellbeing of volunteers who help medical students improve their medical communication skills. An initial mixed-methods study was followed by an experiment comparing two design strategies to improve volunteer relatedness; an important indicator of wellbeing. The third case study looks into volunteer needs, experiences, motivations, and wellbeing with a focus on volunteer identity and meaning-making on a science-based research platform. I then analyse my findings from these case studies using the lens of care ethics to derive critical insights for design. The key contributions of this thesis are design strategies and critical insights, and a volunteer-centric design framework to enhance the motivation, wellbeing and engagement of digital volunteers

    The correlation between values-based leadership and economic success: An empirical evaluation within selected German cooperative banks and related policy implications

    Get PDF
    We are living in a society which is characterised by a permanent developing knowledge culture. The emergence of this megatrend among others, in combination with the financial crisis started in 2007 is the basis of the discussion about values and their impact on economic success. This study explores the links between values, which promote leadership, especially cooperative values, and economic success. The thesis is based on an online survey with all cooperative banks in Germany with an individual balance sheet totals over 1500 million Euro. These banks represent the greatest cooperative banks in Germany and their employees were invited to answer a questionnaire in order to analyse if cooperative values are part of everyday leadership and are perceived accordingly. The examined values were fairness, confidence, certainty, competence, reliability, individuality, common ground, respect, partnership, responsibility and solidarity. These values were set in correlation to financial figures: capital adequacy, asset quality, management efficiency, earnings quality and liquidity management. In addition to that the questionnaire of the online survey contained questions about performance appraisal systems including feedback systems for executives. The concept of values-based leadership and economic success measured in Key Performance Indicators formed the conceptual framework as presented in the literature review. Beyond that, this research follows the fundamental philosophy ‘critical theory’, because critical theory as a social theory is oriented toward critiquing society as a whole or like in this research project a part of our society. The study shows first small indications about the relationships between cooperative management values and business key figures. Correlation analysis was one of the main statistical analysis method of the study, because it measures the relationship between two items. In this case values and financial figures. In addition, various regression analyses were carried out. The aim of regression analysis is to determine the relationships between a dependent variable (financial figures) on the one hand and several explanatory variables (cooperative values) on the other. The elaborations in this study indicate that values-based leadership might have a positive influence on economic success. Organisations could be able to improve their results if they follow the concept of values-based leadership or even the cooperative values management style. The findings of this study might have important implications for those training, coaching or selecting executives, those intending to take a leadership position or who already are leaders, the organisations within values-based leadership is put into focus and for other researchers who want to build on the results. Thus, this study contributes to both practice and knowledge

    The Metaverse: Survey, Trends, Novel Pipeline Ecosystem & Future Directions

    Full text link
    The Metaverse offers a second world beyond reality, where boundaries are non-existent, and possibilities are endless through engagement and immersive experiences using the virtual reality (VR) technology. Many disciplines can benefit from the advancement of the Metaverse when accurately developed, including the fields of technology, gaming, education, art, and culture. Nevertheless, developing the Metaverse environment to its full potential is an ambiguous task that needs proper guidance and directions. Existing surveys on the Metaverse focus only on a specific aspect and discipline of the Metaverse and lack a holistic view of the entire process. To this end, a more holistic, multi-disciplinary, in-depth, and academic and industry-oriented review is required to provide a thorough study of the Metaverse development pipeline. To address these issues, we present in this survey a novel multi-layered pipeline ecosystem composed of (1) the Metaverse computing, networking, communications and hardware infrastructure, (2) environment digitization, and (3) user interactions. For every layer, we discuss the components that detail the steps of its development. Also, for each of these components, we examine the impact of a set of enabling technologies and empowering domains (e.g., Artificial Intelligence, Security & Privacy, Blockchain, Business, Ethics, and Social) on its advancement. In addition, we explain the importance of these technologies to support decentralization, interoperability, user experiences, interactions, and monetization. Our presented study highlights the existing challenges for each component, followed by research directions and potential solutions. To the best of our knowledge, this survey is the most comprehensive and allows users, scholars, and entrepreneurs to get an in-depth understanding of the Metaverse ecosystem to find their opportunities and potentials for contribution

    Corporate Social Responsibility: the institutionalization of ESG

    Get PDF
    Understanding the impact of Corporate Social Responsibility (CSR) on firm performance as it relates to industries reliant on technological innovation is a complex and perpetually evolving challenge. To thoroughly investigate this topic, this dissertation will adopt an economics-based structure to address three primary hypotheses. This structure allows for each hypothesis to essentially be a standalone empirical paper, unified by an overall analysis of the nature of impact that ESG has on firm performance. The first hypothesis explores the evolution of CSR to the modern quantified iteration of ESG has led to the institutionalization and standardization of the CSR concept. The second hypothesis fills gaps in existing literature testing the relationship between firm performance and ESG by finding that the relationship is significantly positive in long-term, strategic metrics (ROA and ROIC) and that there is no correlation in short-term metrics (ROE and ROS). Finally, the third hypothesis states that if a firm has a long-term strategic ESG plan, as proxied by the publication of CSR reports, then it is more resilience to damage from controversies. This is supported by the finding that pro-ESG firms consistently fared better than their counterparts in both financial and ESG performance, even in the event of a controversy. However, firms with consistent reporting are also held to a higher standard than their nonreporting peers, suggesting a higher risk and higher reward dynamic. These findings support the theory of good management, in that long-term strategic planning is both immediately economically beneficial and serves as a means of risk management and social impact mitigation. Overall, this contributes to the literature by fillings gaps in the nature of impact that ESG has on firm performance, particularly from a management perspective

    Neural Architecture Search: Insights from 1000 Papers

    Full text link
    In the past decade, advances in deep learning have resulted in breakthroughs in a variety of areas, including computer vision, natural language understanding, speech recognition, and reinforcement learning. Specialized, high-performing neural architectures are crucial to the success of deep learning in these areas. Neural architecture search (NAS), the process of automating the design of neural architectures for a given task, is an inevitable next step in automating machine learning and has already outpaced the best human-designed architectures on many tasks. In the past few years, research in NAS has been progressing rapidly, with over 1000 papers released since 2020 (Deng and Lindauer, 2021). In this survey, we provide an organized and comprehensive guide to neural architecture search. We give a taxonomy of search spaces, algorithms, and speedup techniques, and we discuss resources such as benchmarks, best practices, other surveys, and open-source libraries
    • …
    corecore