Quantifying Aspect Bias in Ordinal Ratings using a Bayesian Approach

User opinions expressed in the form of ratings can influence an individual's view of an item. However, the true quality of an item is often obfuscated by user biases, and it is not obvious from the observed ratings the importance different users place on different aspects of an item. We propose a probabilistic modeling of the observed aspect ratings to infer (i) each user's aspect bias and (ii) latent intrinsic quality of an item. We model multi-aspect ratings as ordered discrete data and encode the dependency between different aspects by using a latent Gaussian structure. We handle the Gaussian-Categorical non-conjugacy using a stick-breaking formulation coupled with P\'{o}lya-Gamma auxiliary variable augmentation for a simple, fully Bayesian inference. On two real world datasets, we demonstrate the predictive ability of our model and its effectiveness in learning explainable user biases to provide insights towards a more reliable product quality estimation.Comment: Accepted for publication in IJCAI 201

Content, granularity, and type 2 sensitivity of subjective measures of visual consciousness

According to several major theories in the field of consciousness research, the valid assessment of conscious awareness requires subjective measures, i.e. participants’ reports about their conscious experience. However, there is a considerable amount of uncertainty in the field if and how scientifically valuable data can be obtained from subjective measures. The present work empirically examines how subjective measures of conscious awareness need to be designed and applied to provide maximally useful data for empirical studies of visual consciousness. Specifically, it is investigated what contents subjective measures should require participants to report, at which granularity subjective measures ought to be recorded, and what statistical procedures should be used to quantify the relation between subjective measures and discrimination task performance. Concerning content, subjective measures that referred to the accuracy of a preceding discrimination response and subjective measures referring to participants’ visual experience of the task-relevant stimulus feature were compared during a series of visual psychophysical experiments. Subjective measures about the accuracy of the responses were associated with more liberal psychophysical thresholds: At lower stimulus quality, participants reported that they feel confident that their discrimination response was correct without reporting a visual experience of the stimulus feature. Only at greater stimulus quality, they reported that they had a visual experience of the stimulus feature in addition to being confident. Moreover, subjective measures about confidence in discrimination responses predicted task accuracy more efficiently than measures about visual experience. Finally, subjective measures of experience and task accuracy as content were compared while event-related potentials (ERP) were recorded. The earliest electrophysiological correlates of subjective measures where predictive of the fact if participants reported that they selected the response to the discrimination task based on knowledge instead of guessing, but were not yet predictive whether participants reported a clear experience over and above making the task response based on knowledge. The strongest ERP correlate of visual experience occurred a short period in time before participants responded to the discrimination task. As a consequence, it is argued that conceptual considerations are required which conscious contents are relevant for a specific research question, and subjective measures should be about the relevant contents accordingly. Concerning the granularity of subjective measures, a continuous scale and a scale with four discrete labelled categories were compared as subjective measure of conscious experience of motion. The subjective measures contained more information when participants used the continuous scale instead of the discrete scales. The greater amount of information provided by continuous scales rendered subjective measures more predictive of task accuracy and enhanced internal consistency. Regarding the statistical procedure to quantify the relation between subjective measures and task performance, it was found that logistic regression is a suboptimal method because the relationship between subjective measures and the transformed accuracy was frequently not linear. In contrast, meta-da, a measure of the relationship between subjective reports and task accuracy derived from signal detection theory (SDT), provided the most consistent results across all studies. Overall, it is concluded that subjective measures are suited to provide highly useful data to address non-trivial research questions for the scientific study of consciousness: As prerequisite, the content of a subjective measures should be tailored to the current research question. In addition, the problem of a lacking objective standard can be addressed by using the relation between subjective measures and task performance as a reference frame

Good research practices

In this dissertation, entitled “Good Research Practices”, I examine research practices and reform ideas aiming to combat the crisis of confidence in psychology (Pashler & Wagenmakers, 2012). I do so through theoretical contributions and empirical work, propose practical guidelines for researchers, and demonstrate how principles of good research can be conveyed to students. The research methods and statistical practices I present facilitate the adherence to the following three principles: (1) respect the empirical cycle; (2) acknowledge uncertainty; and (3) enrich statistical models with theoretical knowledge

Patient ratings in exercise therapy for the management of tendinopathy: a systematic review with meta-analysis.

The objective of this study was to synthesise exercise therapy intervention data investigating patient rating outcomes for the management of tendinopathy. A systematic review and meta-analysis of randomised controlled trials investigating exercise therapy interventions and reporting patient rating outcomes were undertaken. Eligible settings were considered to be any setting in any country listed as very high on the human development index. Eligible participants were considered to be people with a diagnosis of any tendinopathy of any severity or duration. Exercise therapy for the management of tendinopathy was considered for inclusion based on alignment with five different therapy classes: 1) resistance; 2) plyometric; 3) vibration; 4) flexibility; and 5) movement pattern retraining modalities. The main outcomes sought were those that measured patient rating of condition, including patient satisfaction and Global Rating of Change (GROC). From a total of 124 exercise therapy studies, 34 (Achilles: 41%; rotator cuff: 32%; patellar: 15%; elbow: 9%; and gluteal: 3%) provided sufficient information to be meta-analysed. The data were obtained across 48 treatment arms and 1246 participants. The pooled estimate for proportion of satisfaction was 0.63 [95% CrI: 0.53 to 0.73], and the pooled estimate for percentage of maximum GROC was 53 [95% CrI: 38 to 69%]. The proportion of patients reporting positive satisfaction and perception of change increased with longer follow-up periods from treatment onset. Patient satisfaction and GROC appear similar and are ranked moderately high demonstrating that patients generally perceive exercise therapies positively. Further research including greater consistency in measurement tools is required to explore and where possible, identify patient- and exercise-related moderating factors that can be used to improve person-centred care

Statistical Inferences for Polarity Identification in Natural Language

Information forms the basis for all human behavior, including the ubiquitous decision-making that people constantly perform in their every day lives. It is thus the mission of researchers to understand how humans process information to reach decisions. In order to facilitate this task, this work proposes a novel method of studying the reception of granular expressions in natural language. The approach utilizes LASSO regularization as a statistical tool to extract decisive words from textual content and draw statistical inferences based on the correspondence between the occurrences of words and an exogenous response variable. Accordingly, the method immediately suggests significant implications for social sciences and Information Systems research: everyone can now identify text segments and word choices that are statistically relevant to authors or readers and, based on this knowledge, test hypotheses from behavioral research. We demonstrate the contribution of our method by examining how authors communicate subjective information through narrative materials. This allows us to answer the question of which words to choose when communicating negative information. On the other hand, we show that investors trade not only upon facts in financial disclosures but are distracted by filler words and non-informative language. Practitioners - for example those in the fields of investor communications or marketing - can exploit our insights to enhance their writings based on the true perception of word choice

A Bayesian nonparametric approach to dynamic item-response modeling: An application to the GUSTO cohort study

Statistical analysis of questionnaire data is often performed employing techniques from item-response theory. In this framework, it is possible to differentiate respondent profiles and characterize the questions (items) included in the questionnaire via interpretable parameters. These models are often crosssectional and aim at evaluating the performance of the respondents. The motivating application of this work is the analysis of psychometric questionnaires taken by a group of mothers at different time points and by their children at one later time point. The data are available through the GUSTO cohort study. To this end, we propose a Bayesian semiparametric model and extend the current literature by: (i) introducing temporal dependence among questionnaires taken at different time points; (ii) jointly modeling the responses to questionnaires taken from different, but related, groups of subjects (in our case mothers and children), introducing a further dependency structure and therefore sharing of information; (iii) allowing clustering of subjects based on their latent response profile. The proposed model is able to identify three main groups of mother/child pairs characterized by their response profiles. Furthermore, we report an interesting maternal reporting bias effect strongly affecting the clustering structure of the mother/child dyads

Responding to the Eurozone Crisis - Applying the Shadow Rating Approach to Determine Economic Capital for Sovereign Exposures

The recent European sovereign-debt crisis has made it clear that exposures towards sovereigns contain credit risk. However, according to the Basel framework's standardized approach banks are not required to hold any regulatory capital for highly rated sovereigns. In response, this thesis develops a shadow rating approach model for sovereign probability of default estimation, subsequently determining economic capital for sovereign exposures within a foundation internal ratings-based framework. Furthermore, the empirical Bayes estimator is utilized for low-default portfolio probability of default calibration. The model is tested on ve homogeneous sub-segments in addition to the entire dataset at hand. Empirical ndings suggest that the full dataset performs adequately overall. Nonetheless, model performance is superior for accurately constructed sub-segments. In addition, economic, monetary and political indicators as well as banking sector health are found to best replicate S&P's sovereign long-term issuer credit ratings

Statistical methods in Kansei engineering studies

Aquesta tesi doctoral tracta sobre Enginyeria Kansei (EK), una tècnica per traslladar emocions transmeses per productes en paràmetres tècnics, i sobre mètodes estadístics que poden beneficiar la disciplina. El propòsit bàsic de l'EK és descobrir de quina manera algunes propietats d'un producte transmeten certes emocions als seus usuaris. És un mètode quantitatiu, i les dades es recullen típicament fent servir qüestionaris. S'extreuen conclusions en analitzar les dades recollides, normalment usant algun tipus d'anàlisi de regressió. L'EK es pot situar en l'àrea de recerca del disseny emocional. La tesi comença justificant la importància del disseny emocional. Com que el rang de tècniques usades sota el nom d'EK és extens i no massa clar, la tesi proposa una definició d'EK que serveix per delimitar el seu abast. A continuació, es suggereix un model per desenvolupar estudis d'EK. El model inclou el desenvolupament de l'espai semàntic – el rang d'emocions que el producte pot transmetre – i l'espai de propietats – les variables tècniques que es poden modificar en la fase de disseny. Després de la recollida de dades, l'etapa de síntesi enllaça ambdós espais (descobreix com diferents propietats del producte transmeten certes emocions). Cada pas del model s'explica detalladament usant un estudi d'EK realitzat per aquesta tesi: l'experiment dels sucs de fruites. El model inicial es va millorant progressivament durant la tesi i les dades de l'experiment es van reanalitzant usant noves propostes.Moltes inquietuds pràctiques apareixen quan s'estudia el model per a estudis d'EK esmentat anteriorment (entre d'altres, quants participants són necessaris i com es desenvolupa la sessió de recollida de dades). S'ha realitzat una extensa revisió bibliogràfica amb l'objectiu de respondre aquestes i altres preguntes. Es descriuen també les aplicacions d'EK més habituals, juntament amb comentaris sobre idees particularment interessants de diferents articles. La revisió bibliogràfica serveix també per llistar quines són les eines més comunament utilitzades en la fase de síntesi.La part central de la tesi se centra precisament en les eines per a la fase de síntesi. Eines estadístiques com la teoria de quantificació tipus I o la regressió logística ordinal s'estudien amb detall, i es proposen diverses millores. En particular, es proposa una nova forma gràfica de representar els resultats d'una regressió logística ordinal. S'introdueix una tècnica d'aprenentatge automàtic, els conjunts difusos (rough sets), i s'inclou una discussió sobre la seva idoneïtat per a estudis d'EK. S'usen conjunts de dades simulades per avaluar el comportament de les eines estadístiques suggerides, la qual cosa dóna peu a proposar algunes recomanacions.Independentment de les eines d'anàlisi utilitzades en la fase de síntesi, les conclusions seran probablement errònies quan la matriu del disseny no és adequada. Es proposa un mètode per avaluar la idoneïtat de matrius de disseny basat en l'ús de dos nous indicadors: un índex d'ortogonalitat i un índex de confusió. S'estudia l'habitualment oblidat rol de les interaccions en els estudis d'EK i es proposa un mètode per incloure una interacció, juntament amb una forma gràfica de representar-la. Finalment, l'última part de la tesi es dedica a l'escassament tractat tema de la variabilitat en els estudis d'EK. Es proposen un mètode (basat en l'anàlisi clúster) per segmentar els participants segons les seves respostes emocionals i una forma d'ordenar els participants segons la seva coherència en valorar els productes (usant un coeficient de correlació intraclasse). Com que molts usuaris d'EK no són especialistes en la interpretació de sortides numèriques, s'inclouen representacions visuals per a aquests dos nous mètodes que faciliten el processament de les conclusions.Esta tesis doctoral trata sobre Ingeniería Kansei (IK), una técnica para trasladar emociones transmitidas por productos en parámetros técnicos, y sobre métodos estadísticos que pueden beneficiar la disciplina. El propósito básico de la IK es descubrir de qué manera algunas propiedades de un producto transmiten ciertas emociones a sus usuarios. Es un método cuantitativo, y los datos se recogen típicamente usando cuestionarios. Se extraen conclusiones al analizar los datos recogidos, normalmente usando algún tipo de análisis de regresión.La IK se puede situar en el área de investigación del diseño emocional. La tesis empieza justificando la importancia del diseño emocional. Como que el rango de técnicas usadas bajo el nombre de IK es extenso y no demasiado claro, la tesis propone una definición de IK que sirve para delimitar su alcance. A continuación, se sugiere un modelo para desarrollar estudios de IK. El modelo incluye el desarrollo del espacio semántico – el rango de emociones que el producto puede transmitir – y el espacio de propiedades – las variables técnicas que se pueden modificar en la fase de diseño. Después de la recogida de datos, la etapa de síntesis enlaza ambos espacios (descubre cómo distintas propiedades del producto transmiten ciertas emociones). Cada paso del modelo se explica detalladamente usando un estudio de IK realizado para esta tesis: el experimento de los zumos de frutas. El modelo inicial se va mejorando progresivamente durante la tesis y los datos del experimento se reanalizan usando nuevas propuestas. Muchas inquietudes prácticas aparecen cuando se estudia el modelo para estudios de IK mencionado anteriormente (entre otras, cuántos participantes son necesarios y cómo se desarrolla la sesión de recogida de datos). Se ha realizado una extensa revisión bibliográfica con el objetivo de responder éstas y otras preguntas. Se describen también las aplicaciones de IK más habituales, junto con comentarios sobre ideas particularmente interesantes de distintos artículos. La revisión bibliográfica sirve también para listar cuáles son las herramientas más comúnmente utilizadas en la fase de síntesis. La parte central de la tesis se centra precisamente en las herramientas para la fase de síntesis. Herramientas estadísticas como la teoría de cuantificación tipo I o la regresión logística ordinal se estudian con detalle, y se proponen varias mejoras. En particular, se propone una nueva forma gráfica de representar los resultados de una regresión logística ordinal. Se introduce una técnica de aprendizaje automático, los conjuntos difusos (rough sets), y se incluye una discusión sobre su idoneidad para estudios de IK. Se usan conjuntos de datos simulados para evaluar el comportamiento de las herramientas estadísticas sugeridas, lo que da pie a proponer algunas recomendaciones. Independientemente de las herramientas de análisis utilizadas en la fase de síntesis, las conclusiones serán probablemente erróneas cuando la matriz del diseño no es adecuada. Se propone un método para evaluar la idoneidad de matrices de diseño basado en el uso de dos nuevos indicadores: un índice de ortogonalidad y un índice de confusión. Se estudia el habitualmente olvidado rol de las interacciones en los estudios de IK y se propone un método para incluir una interacción, juntamente con una forma gráfica de representarla. Finalmente, la última parte de la tesis se dedica al escasamente tratado tema de la variabilidad en los estudios de IK. Se proponen un método (basado en el análisis clúster) para segmentar los participantes según sus respuestas emocionales y una forma de ordenar los participantes según su coherencia al valorar los productos (usando un coeficiente de correlación intraclase). Puesto que muchos usuarios de IK no son especialistas en la interpretación de salidas numéricas, se incluyen representaciones visuales para estos dos nuevos métodos que facilitan el procesamiento de las conclusiones.This PhD thesis deals with Kansei Engineering (KE), a technique for translating emotions elicited by products into technical parameters, and statistical methods that can benefit the discipline. The basic purpose of KE is discovering in which way some properties of a product convey certain emotions in its users. It is a quantitative method, and data are typically collected using questionnaires. Conclusions are reached when analyzing the collected data, normally using some kind of regression analysis. Kansei Engineering can be placed under the more general area of research of emotional design. The thesis starts justifying the importance of emotional design. As the range of techniques used under the name of Kansei Engineering is rather vast and not very clear, the thesis develops a detailed definition of KE that serves the purpose of delimiting its scope. A model for conducting KE studies is then suggested. The model includes spanning the semantic space – the whole range of emotions the product can elicit – and the space of properties – the technical variables that can be modified in the design phase. After the data collection, the synthesis phase links both spaces; that is, discovers how several properties of the product elicit certain emotions. Each step of the model is explained in detail using a KE study specially performed for this thesis: the fruit juice experiment. The initial model is progressively improved during the thesis and data from the experiment are reanalyzed using the new proposals. Many practical concerns arise when looking at the above mentioned model for KE studies (among many others, how many participants are used and how the data collection session is conducted). An extensive literature review is done with the aim of answering these and other questions. The most common applications of KE are also depicted, together with comments on particular interesting ideas from several papers. The literature review also serves to list which are the most common tools used in the synthesis phase. The central part of the thesis focuses precisely in tools for the synthesis phase. Statistical tools such as quantification theory type I and ordinal logistic regression are studied in detail, and several improvements are suggested. In particular, a new graphical way to represent results from an ordinal logistic regression is proposed. An automatic learning technique, rough sets, is introduced and a discussion is included on its adequacy for KE studies. Several sets of simulated data are used to assess the behavior of the suggested statistical techniques, leading to some useful recommendations. No matter the analysis tools used in the synthesis phase, conclusions are likely to be flawed when the design matrix is not appropriate. A method to evaluate the suitability of design matrices used in KE studies is proposed, based on the use of two new indicators: an orthogonality index and a confusion index. The commonly forgotten role of interactions in KE studies is studied and a method to include an interaction in KE studies is suggested, together with a way to represent it graphically. Finally, the untreated topic of variability in KE studies is tackled in the last part of the thesis. A method (based in cluster analysis) for finding segments among subjects according to their emotional responses and a way to rank subjects based on their coherence when rating products (using an intraclass correlation coefficient) are proposed. As many users of Kansei Engineering are not specialists in the interpretation of the numerical output from statistical techniques, visual representations for these two new proposals are included to aid understanding