Rank aggregation methods dealing with incomplete information applied to smart cities

City-rankings have become a central instrument for assessing the attractiveness of urban regions over the last years. Demographic, environmental, economic, political and socio-cultural factors are forcing the urban world to design and implement Smart Cities. A set of multidimensional components underlies the fuzzy smart city concept. As a result cities are evaluated and ranked with regard to different characteristics, and smart city measures are achieved through chosen indicators. Therefore, the problem of combining multiple rankings to form an aggregate ranking, which compares city performance, is recognized as a useful tool in this context. Moreover, a usual situation is when incomplete information arises and only partial rankings may be supplied. This paper addresses the general problem of rank aggregation dealing with incomplete information based on rank aggregation methods and multicriteria decision making theory. It consists on constructing a consensus ranking from partial rankings of a set of objects provided according different criteria. Our techniques rely on outranking matrices as a way of collecting relevance information from input data, theory of fuzzy preference relations and the PageRank algorithm

Finding Academic Experts on a MultiSensor Approach using Shannon's Entropy

Expert finding is an information retrieval task concerned with the search for the most knowledgeable people, in some topic, with basis on documents describing peoples activities. The task involves taking a user query as input and returning a list of people sorted by their level of expertise regarding the user query. This paper introduces a novel approach for combining multiple estimators of expertise based on a multisensor data fusion framework together with the Dempster-Shafer theory of evidence and Shannon's entropy. More specifically, we defined three sensors which detect heterogeneous information derived from the textual contents, from the graph structure of the citation patterns for the community of experts, and from profile information about the academic experts. Given the evidences collected, each sensor may define different candidates as experts and consequently do not agree in a final ranking decision. To deal with these conflicts, we applied the Dempster-Shafer theory of evidence combined with Shannon's Entropy formula to fuse this information and come up with a more accurate and reliable final ranking list. Experiments made over two datasets of academic publications from the Computer Science domain attest for the adequacy of the proposed approach over the traditional state of the art approaches. We also made experiments against representative supervised state of the art algorithms. Results revealed that the proposed method achieved a similar performance when compared to these supervised techniques, confirming the capabilities of the proposed framework

Intelligent component selection

Component-based software engineering (CBSE) provides solutions to the development of complex and evolving systems. As these systems are created and maintained, the task of selecting components is repeated. The context-driven component evaluation (CdCE) project is developing strategies and techniques for automating a repeatable process for assessing software components. This paper describes our work using artificial intelligence (AI) techniques to classify components based on an ideal component specification. Using AI we are able to represent dependencies between attributes, overcoming some of the limitations of existing aggregation-based approaches to component selection

Preference Learning

This report documents the program and the outcomes of Dagstuhl Seminar 14101 “Preference Learning”. Preferences have recently received considerable attention in disciplines such as machine learning, knowledge discovery, information retrieval, statistics, social choice theory, multiple criteria decision making, decision under risk and uncertainty, operations research, and others. The motivation for this seminar was to showcase recent progress in these different areas with the goal of working towards a common basis of understanding, which should help to facilitate future synergies

iAggregator: Multidimensional Relevance Aggregation Based on a Fuzzy Operator

International audienceRecently, an increasing number of information retrieval studies have triggered a resurgence of interest in redefining the algorithmic estimation of relevance, which implies a shift from topical to multidimensional relevance assessment. A key underlying aspect that emerged when addressing this concept is the aggregation of the relevance assessments related to each of the considered dimensions. The most commonly adopted forms of aggregation are based on classical weighted means and linear combination schemes to address this issue. Although some initiatives were recently proposed, none was concerned with considering the inherent dependencies and interactions existing among the relevance criteria, as is the case in many real-life applications. In this article, we present a new fuzzy-based operator, called iAggregator, for multidimensional relevance aggregation. Its main originality, beyond its ability to model interactions between different relevance criteria, lies in its generalization of many classical aggregation functions. To validate our proposal, we apply our operator within a tweet search task. Experiments using a standard benchmark, namely, Text REtrieval Conference Microblog,1 emphasize the relevance of our contribution when compared with traditional aggregation schemes. In addition, it outperforms state-of-the-art aggregation operators such as the Scoring and the And prioritized operators as well as some representative learning-to-rank algorithms

Enhancing the ELECTRE decision support method with semantic data

Prendre una decisió quan les opcions es defineixen mitjançant un conjunt divers de criteris no és fàcil. Aqueta tesi es centra en ampliar la metodologia ELECTRE, que és el mètode del tipus "outranking" més utilitzat. En aquesta tesi ens centrem en problemes de decisió que involucren informació no numèrica, tal com els criteris semàntics multivaluats, que poden prendre com a valors els conceptes d'una ontologia de domini determinada. Primer proposo una nova manera de manipular els criteris semàntics per evitar l'agregació de les puntuacions numèriques abans del procediment de classificació. Aquest mètode, anomenat ELECTRE-SEM, segueix els mateixos principis que el clàssic ELECTRE però, en aquest cas, els índexs de concordança i discordança es defineixen en termes de la comparació per parelles de les puntuacions que indiquen l'interès de l'usuari sobre diferents conceptes de l'ontologia. En segon lloc, proposo crear un perfil d'usuari semàntic mitjançant el emmagatzemant de puntuacions de preferències a l'ontologia. Es vincula una puntuació d'interès numèrica als conceptes més específics, això permet distingir millor les preferències de l'usuari, i també s'incorpora un procediment d'agregació per inferir les preferències de l'usuari considerant les relacions taxonòmiques entre conceptes. La metodologia proposada s'ha aplicat en dos casos d’estudi: l'avaluació de plantes de generació d'energia i la recomanació d'activitats turístiques a Tarragona.Tomar una decisión cuando las opciones se definen sobre un conjunto diverso de criterios no es fácil. Esta tesis se centra en ampliar la metodología ELECTRE, que es el método del tipo "outranking" más utilizado. En esta tesis nos centramos en problemas de decisión que involucren información no numérica, tal como los criterios semánticos multi-valuados, que pueden tomar como valores los conceptos de una ontología de dominio determinada. Primero propongo una nueva forma de manejar los criterios semánticos para evitar la agregación de puntuaciones numéricas antes del procedimiento de clasificación. Este método, llamado ELECTRE-SEM, sigue los mismos principios que el clásico ELECTRE, pero en este caso los índices de concordancia y discordancia se definen en términos de la comparación por pares de unas puntuaciones que indican el interés del usuario sobre distintos conceptos de la ontología. En segundo lugar, propongo crear un perfil de usuario semántico mediante el almacenamiento de puntuaciones de preferencias en la ontología. Se asocian puntuaciones numéricas a los conceptos más específicos, lo cual permite distinguir mejor las preferencias del usuario, y se incorpora un proceso de agregación para inferir las preferencias del usuario mediante las relaciones taxonómicas entre conceptos. La metodología propuesta ha sido aplicada en dos casos de estudio: la evaluación de las plantas de generación de energía y la recomendación de actividades turísticas en Tarragona.Reach a decision when options are defined on a set of diverse criteria is not easy. This thesis is focused on improving the methodology ELECTRE, which is the most used outranking-based method. In this dissertation, we focus on decision problems involving non-numerical information, such as multi-valued semantic criteria, which may take as values the concepts of a given domain ontology. First, I propose a new way of handling semantic criteria to avoid the aggregation of the numerical scores before the ranking procedure. This method, called ELECTRE-SEM, follows the same principles than the classic ELECTRE but in this case the concordance and discordance indices are defined in terms of the pairwise comparison of the interest scores. Second, I also propose to create a semantic user profile by storing preference scores into the ontology. The numerical interest score attached to the most specific concepts permits to distinguish better the preferences of the user, improving the quality of the decision by the incorporation of an aggregation methodology to infer the user's preferences by considering taxonomic relations between concepts. The proposed methodology has been applied in two case studies: the assessment of power generation plants and the recommendation of touristic activities in Tarragona

Multi-Criteria Decision Making in software development:a systematic literature review

Abstract. Multiple Criteria Decision Making is a formal approach to assist decision makers to select the best solutions among multiple alternatives by assessing criteria which are relatively precise but generally conflicting. The utilization of MCDM are quite popular and common in software development process. In this study, a systematic literature review which includes creating review protocol, selecting primary study, making classification schema, extracting data and other relevant steps was conducted. The objective of this study are making a summary about the state-of-the-art of MCDM in software development process and identifying the MCDM methods and MCDM problems in software development by systematically structuring and analyzing the literature on those issues. A total of 56 primary studies were identified after the review, and 33 types of MCDM methods were extracted from those primary studies. Among them, AHP was defined as the most frequent used MCDM methods in software development process by ranking the number of primary studies which applied it in their studies, and Pareto optimization was ranked in the second place. Meanwhile, 33 types of software development problems were identified. Components selection, design concepts selection and performance evaluation became the three most frequent occurred problems which need to be resolved by MCDM methods. Most of those MCDM problems were found in software design phase. There were many limitations to affect the quality of this study; however, the strictly-followed procedures of SLR and mass data from thousands of literature can still ensure the validity of this study, and this study is also able to provide the references when decision makers want to select the appropriate technique to cope with the MCDM problems