An Overview of Classifier Fusion Methods

A number of classifier fusion methods have been recently developed opening an alternative approach leading to a potential improvement in the classification performance. As there is little theory of information fusion itself, currently we are faced with different methods designed for different problems and producing different results. This paper gives an overview of classifier fusion methods and attempts to identify new trends that may dominate this area of research in future. A taxonomy of fusion methods trying to bring some order into the existing “pudding of diversities” is also provided

An Overview of Classifier Fusion Methods

A number of classifier fusion methods have been recently developed opening an alternative approach leading to a potential improvement in the classification performance. As there is little theory of information fusion itself, currently we are faced with different methods designed for different problems and producing different results. This paper gives an overview of classifier fusion methods and attempts to identify new trends that may dominate this area of research in future. A taxonomy of fusion methods trying to bring some order into the existing “pudding of diversities” is also provided

Expert Elicitation for Reliable System Design

This paper reviews the role of expert judgement to support reliability assessments within the systems engineering design process. Generic design processes are described to give the context and a discussion is given about the nature of the reliability assessments required in the different systems engineering phases. It is argued that, as far as meeting reliability requirements is concerned, the whole design process is more akin to a statistical control process than to a straightforward statistical problem of assessing an unknown distribution. This leads to features of the expert judgement problem in the design context which are substantially different from those seen, for example, in risk assessment. In particular, the role of experts in problem structuring and in developing failure mitigation options is much more prominent, and there is a need to take into account the reliability potential for future mitigation measures downstream in the system life cycle. An overview is given of the stakeholders typically involved in large scale systems engineering design projects, and this is used to argue the need for methods that expose potential judgemental biases in order to generate analyses that can be said to provide rational consensus about uncertainties. Finally, a number of key points are developed with the aim of moving toward a framework that provides a holistic method for tracking reliability assessment through the design process.Comment: This paper commented in: [arXiv:0708.0285], [arXiv:0708.0287], [arXiv:0708.0288]. Rejoinder in [arXiv:0708.0293]. Published at http://dx.doi.org/10.1214/088342306000000510 in the Statistical Science (http://www.imstat.org/sts/) by the Institute of Mathematical Statistics (http://www.imstat.org

Potentials and Limits of Bayesian Networks to Deal with Uncertainty in the Assessment of Climate Change Adaptation Policies

Bayesian networks (BNs) have been increasingly applied to support management and decision-making processes under conditions of environmental variability and uncertainty, providing logical and holistic reasoning in complex systems since they succinctly and effectively translate causal assertions between variables into patterns of probabilistic dependence. Through a theoretical assessment of the features and the statistical rationale of BNs, and a review of specific applications to ecological modelling, natural resource management, and climate change policy issues, the present paper analyses the effectiveness of the BN model as a synthesis framework, which would allow the user to manage the uncertainty characterising the definition and implementation of climate change adaptation policies. The review will let emerge the potentials of the model to characterise, incorporate and communicate the uncertainty, with the aim to provide an efficient support to an informed and transparent decision making process. The possible drawbacks arising from the implementation of BNs are also analysed, providing potential solutions to overcome them.Adaptation to Climate Change, Bayesian Network, Uncertainty

Continuous Improvement Through Knowledge-Guided Analysis in Experience Feedback

Continuous improvement in industrial processes is increasingly a key element of competitiveness for industrial systems. The management of experience feedback in this framework is designed to build, analyze and facilitate the knowledge sharing among problem solving practitioners of an organization in order to improve processes and products achievement. During Problem Solving Processes, the intellectual investment of experts is often considerable and the opportunities for expert knowledge exploitation are numerous: decision making, problem solving under uncertainty, and expert configuration. In this paper, our contribution relates to the structuring of a cognitive experience feedback framework, which allows a flexible exploitation of expert knowledge during Problem Solving Processes and a reuse such collected experience. To that purpose, the proposed approach uses the general principles of root cause analysis for identifying the root causes of problems or events, the conceptual graphs formalism for the semantic conceptualization of the domain vocabulary and the Transferable Belief Model for the fusion of information from different sources. The underlying formal reasoning mechanisms (logic-based semantics) in conceptual graphs enable intelligent information retrieval for the effective exploitation of lessons learned from past projects. An example will illustrate the application of the proposed approach of experience feedback processes formalization in the transport industry sector

Best practices for the provision of prior information for Bayesian stock assessment

This manual represents a review of the potential sources and methods to be applied when providing prior information to Bayesian stock assessments and marine risk analysis. The manual is compiled as a product of the EC Framework 7 ECOKNOWS project (www.ecoknows.eu). The manual begins by introducing the basic concepts of Bayesian inference and the role of prior information in the inference. Bayesian analysis is a mathematical formalization of a sequential learning process in a probabilistic rationale. Prior information (also called ”prior knowledge”, ”prior belief”, or simply a ”prior”) refers to any existing relevant knowledge available before the analysis of the newest observations (data) and the information included in them. Prior information is input to a Bayesian statistical analysis in the form of a probability distribution (a prior distribution) that summarizes beliefs about the parameter concerned in terms of relative support for different values. Apart from specifying probable parameter values, prior information also defines how the data are related to the phenomenon being studied, i.e. the model structure. Prior information should reflect the different degrees of knowledge about different parameters and the interrelationships among them. Different sources of prior information are described as well as the particularities important for their successful utilization. The sources of prior information are classified into four main categories: (i) primary data, (ii) literature, (iii) online databases, and (iv) experts. This categorization is somewhat synthetic, but is useful for structuring the process of deriving a prior and for acknowledging different aspects of it. A hierarchy is proposed in which sources of prior information are ranked according to their proximity to the primary observations, so that use of raw data is preferred where possible. This hierarchy is reflected in the types of methods that might be suitable – for example, hierarchical analysis and meta-analysis approaches are powerful, but typically require larger numbers of observations than other methods. In establishing an informative prior distribution for a variable or parameter from ancillary raw data, several steps should be followed. These include the choice of the frequency distribution of observations which also determines the shape of prior distribution, the choice of the way in which a dataset is used to construct a prior, and the consideration related to whether one or several datasets are used. Explicitly modelling correlations between parameters in a hierarchical model can allow more effective use of the available information or more knowledge with the same data. Checking the literature is advised as the next approach. Stock assessment would gain much from the inclusion of prior information derived from the literature and from literature compilers such as FishBase (www.fishbase.org), especially in data-limited situations. The reader is guided through the process of obtaining priors for length–weight, growth, and mortality parameters from FishBase. Expert opinion lends itself to data-limited situations and can be used even in cases where observations are not available. Several expert elicitation tools are introduced for guiding experts through the process of expressing their beliefs and for extracting numerical priors about variables of interest, such as stock–recruitment dynamics, natural mortality, maturation, and the selectivity of fishing gears. Elicitation of parameter values is not the only task where experts play an important role; they also can describe the process to be modelled as a whole. Information sources and methods are not mutually exclusive, so some combination may be used in deriving a prior distribution. Whichever source(s) and method(s) are chosen, it is important to remember that the same data should not be used twice. If the 2 | ICES Cooperative Research Report No. 328 plan is to use the data in the analysis for which the prior distribution is needed, then the same data cannot be used in formulating the prior. The techniques studied and proposed in this manual can be further elaborated and fine-tuned. New developments in technology can potentially be explored to find novel ways of forming prior distributions from different sources of information. Future research efforts should also be targeted at the philosophy and practices of model building based on existing prior information. Stock assessments that explicitly account for model uncertainty are still rare, and improving the methodology in this direction is an important avenue for future research. More research is also needed to make Bayesian analysis of non-parametric models more accessible in practice. Since Bayesian stock assessment models (like all other assessment models) are made from existing knowledge held by human beings, prior distributions for parameters and model structures may play a key role in the processes of collectively building and reviewing those models with stakeholders. Research on the theory and practice of these processes will be needed in the future