2,959 research outputs found

    The metric tide: report of the independent review of the role of metrics in research assessment and management

    Get PDF
    This report presents the findings and recommendations of the Independent Review of the Role of Metrics in Research Assessment and Management. The review was chaired by Professor James Wilsdon, supported by an independent and multidisciplinary group of experts in scientometrics, research funding, research policy, publishing, university management and administration. This review has gone beyond earlier studies to take a deeper look at potential uses and limitations of research metrics and indicators. It has explored the use of metrics across different disciplines, and assessed their potential contribution to the development of research excellence and impact. It has analysed their role in processes of research assessment, including the next cycle of the Research Excellence Framework (REF). It has considered the changing ways in which universities are using quantitative indicators in their management systems, and the growing power of league tables and rankings. And it has considered the negative or unintended effects of metrics on various aspects of research culture. The report starts by tracing the history of metrics in research management and assessment, in the UK and internationally. It looks at the applicability of metrics within different research cultures, compares the peer review system with metric-based alternatives, and considers what balance might be struck between the two. It charts the development of research management systems within institutions, and examines the effects of the growing use of quantitative indicators on different aspects of research culture, including performance management, equality, diversity, interdisciplinarity, and the ‘gaming’ of assessment systems. The review looks at how different funders are using quantitative indicators, and considers their potential role in research and innovation policy. Finally, it examines the role that metrics played in REF2014, and outlines scenarios for their contribution to future exercises

    Machine learning in safety critical industry domains

    Get PDF

    Intent-based zero-touch service chaining layer for software-defined edge cloud networks

    Get PDF
    Edge Computing, along with Software Defined Networking and Network Function Virtualization, are causing network infrastructures to become as distributed clouds extended to the edge with services provided as dynamically established sequences of virtualized functions (i.e., dynamic service chains) thereby elastically addressing different processing requirements of application data flows. However, service operators and application developers are not inclined to deal with descriptive configuration directives to establish and operate services, especially in case of service chains. Intent-based Networking is emerging as a novel approach that simplifies network management and automates the implementation of network operations required by applications. This paper presents an intent-based zero-touch service chaining layer that provides the programmable provision of service chain paths in edge cloud networks. In addition to the dynamic and elastic deployment of data delivery services, the intent-based layer offers an automated adaptation of the service chains paths according to the application's goals expressed in the intent to recover from sudden congestion events in the SDN network. Experiments have been carried out in an emulated network environment to show the feasibility of the approach and to evaluate the performance of the intent layer in terms of network resource usage and adaptation overhead

    Uncertainty propagation and sensitivity analysis techniques in building performance simulation to support conceptual building and system design

    Get PDF
    Due to advances in computing and modeling, the Architecture Engineering and Construction (AEC)industry has arrived at an era of digital empiricism. Computational simulation tools are widely used across many engineering disciplines for design, evaluation and analysis. Experts in the field agree that design decisions taken during the early design stages have a significant impact on the real performance of the building. Nevertheless, building performance simulation is still hardly used during conceptual design. The European Commission has targeted a 20% reduction of CO2 emissions, a 20% increase of energy efficiency and a 20% increase in the use of renewable energy by 2020. These ambitious aims have resulted in the recasting of the Energy for Buildings Directive, demanding nearly-zero-net energy-buildings for new buildings and major refurbishments by 2020. The formulated aim requires for the first time an integrated design of the building’s demand and supply systems. The current research was triggered by the above observation. It uses semi-structured interviews and critical reviews of literature and software to establish the reasons that prevent Heating, Ventilation and Air Conditioning (HVAC) consultants from adopting Building Performance Simulation (BPS) tools and to identify the needs of practitioners during the conceptual design stage. In response to the identified needs, a rapid iterative development process is deployed to produce a prototypical software tool. Finally, the tool is heuristically tested on expert users to evaluate its capability to support the conceptual design process. The results obtained from interviews and reviews highlight that HVAC consultants work with an increasing number of design alternatives to prevent dysfunctional buildings. The complexity of design problems is increasing on the one hand due to the need for an early integration of engineering discipline’s and on the other hand due to the challenges in meeting the even more stringent requirements of new buildings. Furthermore, design teams run the risk of only identifying suboptimal solutions for the design problem when they limit themselves too early to a small number of design alternatives. The use of simulation tools helps facilitate a quick turnaround of performance evaluations for a great number of design alternatives early in the design process. By doing so, performance simulation tools have the potential to supplement design experience and support decision making. However, simulation tools are perceived by many as too detailed to be readily used for conceptual design support. Research findings suggest that tools for the early design stages are required to enable parametric studies and to provide facilities to explore the relationships between potential design decisions and performance aspects. Tools need to be able to dynamically scale the resolution of their interfaces to fit the different levels of information density characteristic of the different design stages. In addition, they need to be flexible enough to facilitate expansion of the system representations with innovative design concepts as the design progresses. Due to the need for parametric studies and the exploration of the relationships between potential design decision and performance aspects, this research explores the extension and application of BPS tools with techniques for uncertainty propagation and sensitivity analysis for conceptual design support. This endeavor requires (1) the evaluation and selection of an extension strategy, (2) the determination of the format and availability of input to techniques for uncertainty propagation and sensitivity analysis, as well as (3) developing knowledge regarding the extent and content of the design option space. To avoid the need to modify the source code of BPS tools, an external strategy is applied that embeds an existing simulation engine into a shell with extra features for statistical pre and post-processing by Latin Hypercube sampling and regression based sensitivity analysis. With regards to the model resolution, results suggest that it is more beneficial to use detailed models with adaptive interfaces rather than simpler tools. The advantages are twofold. Firstly, the BPS tool can use an existing validated simulation model - rather than a specifically developed abstract model with limited applicability. Secondly, the model is able to provide consistent feedback throughout the lifetime of the building. Within the iterative process, the conceptual design stage has some distinctive tasks, such as to explore the option space and to generate and evaluate design concepts. The option space is multidimensional, due to its multi-disciplinary set-up and wide-ranging interests of the participating practitioners. An empirical study as part of the research demonstrates the presence of at least two attributes, four subsystem categories and four relationships. Depending on the experience of the practicing designer, components, attributes and relationships are used to a very different extent. While experienced HVAC consultants seem to work mainly with relationships when compiling a design concept, novice designers prefer to work with components. The sampling based analysis strategy requires knowledge about the uncertainty of the parametric model input in the form of probability distribution functions. On the basis of a survey on internal gains for offices, this thesis concludes that current design guidelines provide useful data in a suitable format. Measurements conducted in an office building in Amsterdam confirm the trend towards decreasing equipment gains and the proportional increase of lighting gains. However, in the absence of data to derive a probability density function, this research suggests the definition of "explanatory" scenarios. It is common practice to use "normative" scenarios as input in building performance studies aiming to prove compliance with building regulations. The use of "exploratory" scenarios is less common. Scenario based load profiles have to meet three characteristics. They have to be: (1) locally representative; (2) up-to date and (3) need to match workplace culture. As part of this thesis explanatory data sets were developed representing climate change scenarios for The Netherlands. The exploratory scenarios facilitate the robustness assessment of the future performance of design alternatives. Tests with the Dutch data sets confirm that neither the current reference data nor the projected reference data provide valid results to predict uncertainty ranges for the peak cooling load as a potential robustness indicator. A simulation based comparative robustness assessment of three HVAC concepts over 15 and 30 years is reported. The results indicate a robust future performance for the floor-cooling based design alternative with respect to thermal comfort and cooling energy demand. The software prototype shows that detailed simulation tools with features for uncertainty propagation and sensitivity analysis provide the facilities to explore consequences of potential design decisions on performance aspects. In addition, they enable parametric studies and create the possibility to quantify parameter interactions and their collective impact on the performance aspect. Heuristic usability evaluation of the software prototype confirms the value to design practice. 85% of approached HVAC consultants state that the uncertainty of performance aspects is an important parameter to support conceptual design. More importantly, 80% of the practitioners consider the prototype to have great potential to reduce the number of necessary design iterations. This thesis concludes that simulation tools that quantitatively address uncertainties and sensitivities related to conceptual building design generate value by (1) providing an indication of the accuracy of the performance predictions; (2) allowing the identification of parameters and systems to which performance metrics react sensitively and in-sensitively, respectively; and (3) enabling a robustness assessment of design alternatives
    • …
    corecore