Limitations of Majority Agreement in Crowdsourced Image Interpretation

Crowdsourcing can efficiently complete tasks that are difficult to automate, but the quality of crowdsourced data is tricky to evaluate. Algorithms to grade volunteer work often assume that all tasks are similarly difficult, an assumption that is frequently false. We use a cropland identification game with over 2,600 participants and 165,000 unique tasks to investigate how best to evaluate the difficulty of crowdsourced tasks and to what extent this is possible based on volunteer responses alone. Inter-volunteer agreement exceeded 90% for about 80% of the images and was negatively correlated with volunteer-expressed uncertainty about image classification. A total of 343 relatively difficult images were independently classified as cropland, non-cropland or impossible by two experts. The experts disagreed weakly (one said impossible while the other rated as cropland or non-cropland) on 27% of the images, but disagreed strongly (cropland vs. non-cropland) on only 7%. Inter-volunteer disagreement increased significantly with inter-expert disagreement. While volunteers agreed with expert classifications for most images, over 20% would have been mis-categorized if only the volunteers’ majority vote was used. We end with a series of recommendations for managing the challenges posed by heterogeneous tasks in crowdsourcing campaigns

Nobody cares if you liked Star Wars: KNN graph construction on the cheap

International audienceK-Nearest-Neighbors (KNN) graphs play a key role in a large range of applications. A KNN graph typically connects entities characterized by a set of features so that each entity becomes linked to its k most similar counterparts according to some similarity function. As datasets grow, KNN graphs are unfortunately becoming increasingly costly to construct, and the general approach, which consists in reducing the number of comparisons between entities, seems to have reached its full potential. In this paper we propose to overcome this limit with a simple yet powerful strategy that samples the set of features of each entity and only keeps the least popular features. We show that this strategy outperforms other more straightforward policies on a range of four representative datasets: for instance, keeping the 25 least popular items reduces computational time by up to 63%, while producing a KNN graph close to the ideal one

The ESR1 (6q25) locus is associated with calcaneal ultrasound parameters and radial volumetric bone mineral density in European men

<p><b>Purpose:</b> Genome-wide association studies (GWAS) have identified 6q25, which incorporates the oestrogen receptor alpha gene (ESR1), as a quantitative trait locus for areal bone mineral density (BMD(a)) of the hip and lumbar spine. The aim of this study was to determine the influence of this locus on other bone health outcomes; calcaneal ultrasound (QUS) parameters, radial peripheral quantitative computed tomography (pQCT) parameters and markers of bone turnover in a population sample of European men.</p> <p><b>Methods:</b> Eight single nucleotide polymorphisms (SNP) in the 6q25 locus were genotyped in men aged 40-79 years from 7 European countries, participating in the European Male Ageing Study (EMAS). The associations between SNPs and measured bone parameters were tested under an additive genetic model adjusting for centre using linear regression.</p> <p><b>Results:</b> 2468 men, mean (SD) aged 59.9 (11.1) years had QUS measurements performed and bone turnover marker levels measured. A subset of 628 men had DXA and pQCT measurements. Multiple independent SNPs showed significant associations with BMD using all three measurement techniques. Most notably, rs1999805 was associated with a 0.10 SD (95%CI 0.05, 0.16; p = 0.0001) lower estimated BMD at the calcaneus, a 0.14 SD (95%CI 0.05, 0.24; p = 0.004) lower total hip BMD(a), a 0.12 SD (95%CI 0.02, 0.23; p = 0.026) lower lumbar spine BMD(a) and a 0.18 SD (95%CI 0.06, 0.29; p = 0.003) lower trabecular BMD at the distal radius for each copy of the minor allele. There was no association with serum levels of bone turnover markers and a single SNP which was associated with cortical density was also associated with cortical BMC and thickness.</p> <p><b>Conclusions:</b> Our data replicate previous associations found between SNPs in the 6q25 locus and BMD(a) at the hip and extend these data to include associations with calcaneal ultrasound parameters and radial volumetric BMD.</p&gt

ARPES: A probe of electronic correlations

Angle-resolved photoemission spectroscopy (ARPES) is one of the most direct methods of studying the electronic structure of solids. By measuring the kinetic energy and angular distribution of the electrons photoemitted from a sample illuminated with sufficiently high-energy radiation, one can gain information on both the energy and momentum of the electrons propagating inside a material. This is of vital importance in elucidating the connection between electronic, magnetic, and chemical structure of solids, in particular for those complex systems which cannot be appropriately described within the independent-particle picture. Among the various classes of complex systems, of great interest are the transition metal oxides, which have been at the center stage in condensed matter physics for the last four decades. Following a general introduction to the topic, we will lay the theoretical basis needed to understand the pivotal role of ARPES in the study of such systems. After a brief overview on the state-of-the-art capabilities of the technique, we will review some of the most interesting and relevant case studies of the novel physics revealed by ARPES in 3d-, 4d- and 5d-based oxides.Comment: Chapter to appear in "Strongly Correlated Systems: Experimental Techniques", edited by A. Avella and F. Mancini, Springer Series in Solid-State Sciences (2013). A high-resolution version can be found at: http://www.phas.ubc.ca/~quantmat/ARPES/PUBLICATIONS/Reviews/ARPES_Springer.pdf. arXiv admin note: text overlap with arXiv:cond-mat/0307085, arXiv:cond-mat/020850

An efficient RANSAC hypothesis evaluation using sufficient statistics for RGB-D pose estimation

Achieving autonomous flight in GPS-denied environments begins with pose estimation in three-dimensional space, and this is much more challenging in an MAV in a swarm robotic system due to limited computational resources. In vision-based pose estimation, outlier detection is the most time-consuming step. This usually involves a RANSAC procedure using the reprojection-error method for hypothesis evaluation. Realignment-based hypothesis evaluation method is observed to be more accurate, but the considerably slower speed makes it unsuitable for robots with limited resources. We use sufficient statistics of least-squares minimisation to speed up this process. The additive nature of these sufficient statistics makes it possible to compute pose estimates in each evaluation by reusing previously computed statistics. Thus estimates need not be calculated from scratch each time. The proposed method is tested on standard RANSAC, Preemptive RANSAC and R-RANSAC using benchmark datasets. The results show that the use of sufficient statistics speeds up the outlier detection process with realignment hypothesis evaluation for all RANSAC variants, achieving an execution speed of up to 6.72 times

Role of seminal plasma in the anti-HIV-1 activity of candidate microbicides

BACKGROUND: Evaluation of microbicides for prevention of HIV-1 infection in macaque models for vaginal infection has indicated that the concentrations of active compounds needed for protection by far exceed levels sufficient for complete inhibition of infection in vitro. These experiments were done in the absence of seminal plasma (SP), a vehicle for sexual transmission of the virus. To gain insight into the possible effect of SP on the performance of selected microbicides, their anti-HIV-1 activity in the presence, and absence of SP, was determined. METHODS: The inhibitory activity of compounds against the X4 virus, HIV-1 IIIB, and the R5 virus, HIV-1 BaL was determined using TZM-bl indicator cells and quantitated by measuring β-galactosidase induced by infection. The virucidal properties of cellulose acetate 1,2-benzene-dicarboxylate (CAP), the only microbicide provided in water insoluble, micronized form, in the presence of SP was measured. RESULTS: The HIV-1 inhibitory activity of the polymeric microbicides, poly(naphthalene sulfonate), cellulose sulfate, carrageenan, CAP (in soluble form) and polystyrene sulfonate, respectively, was considerably (range ≈ 4 to ≈ 73-fold) diminished in the presence of SP (33.3%). Formulations of micronized CAP, providing an acidic buffering system even in the presence of an SP volume excess, effectively inactivated HIV-1 infectivity. CONCLUSION: The data presented here suggest that the in vivo efficacy of polymeric microbicides, acting as HIV-1 entry inhibitors, might become at least partly compromised by the inevitable presence of SP. These possible disadvantages could be overcome by combining the respective polymers with acidic pH buffering systems (built-in for formulations of micronized CAP) or with other anti-HIV-1 compounds, the activity of which is not affected by SP, e.g. reverse transcriptase and zinc finger inhibitors

Estimation of trabecular bone parameters in children from multisequence MRI using texture-based regression

PURPOSE: This paper presents a statistical approach for the prediction of trabecular bone parameters from low-resolution multisequence magnetic resonance imaging (MRI) in children, thus addressing the limitations of high-resolution modalities such as HR-pQCT, including the significant exposure of young patients to radiation and the limited applicability of such modalities to peripheral bones in vivo. METHODS: A statistical predictive model is constructed from a database of MRI and HR-pQCT datasets, to relate the low-resolution MRI appearance in the cancellous bone to the trabecular parameters extracted from the high-resolution images. The description of the MRI appearance is achieved between subjects by using a collection of feature descriptors, which describe the texture properties inside the cancellous bone, and which are invariant to the geometry and size of the trabecular areas. The predictive model is built by fitting to the training data a nonlinear partial least square regression between the input MRI features and the output trabecular parameters. RESULTS: Detailed validation based on a sample of 96 datasets shows correlations >0.7 between the trabecular parameters predicted from low-resolution multisequence MRI based on the proposed statistical model and the values extracted from high-resolution HRp-QCT. CONCLUSIONS: The obtained results indicate the promise of the proposed predictive technique for the estimation of trabecular parameters in children from multisequence MRI, thus reducing the need for high-resolution radiation-based scans for a fragile population that is under development and growth

Calculability as politics in the construction of markets: the case of socially responsible investment in France

This paper examines some of the processes by which power constitutes calculability and, in so doing, shapes the construction of markets. We combine insights from performativity studies about calculability with Lukes’ ‘radical view of power’ to investigate how multiple facets of power are mobilized to influence the creation and activities of calculative agencies in the process of market construction. An in-depth longitudinal study of the French socially responsible investment market shows how organizations acting as calculative agencies become sites of power through calculability. We identify how power is exercised over, through and against these calculative agencies by a variety of actors in order to build their position in the socially responsible investment market. Our results complement the broader question of the ‘government of economic life’ by showing how micro-level power games interact with the macro-politics of market building through calculative agencies. In so doing, our paper sheds light on neglected aspects of the changing geopolitics of calculative power in market construction and suggests approaching ‘calculability as politics’ when studying the construction of markets

Composition of the pericellular matrix modulates the deformation behaviour of chondrocytes in articular cartilage under static loading

The aim was to assess the role of the composition changes in the pericellular matrix (PCM) for the chondrocyte deformation. For that, a three-dimensional finite element model with depth-dependent collagen density, fluid fraction, fixed charge density and collagen architecture, including parallel planes representing the split-lines, was created to model the extracellular matrix (ECM). The PCM was constructed similarly as the ECM, but the collagen fibrils were oriented parallel to the chondrocyte surfaces. The chondrocytes were modelled as poroelastic with swelling properties. Deformation behaviour of the cells was studied under 15% static compression. Due to the depth-dependent structure and composition of cartilage, axial cell strains were highly depth-dependent. An increase in the collagen content and fluid fraction in the PCMs increased the lateral cell strains, while an increase in the fixed charge density induced an inverse behaviour. Axial cell strains were only slightly affected by the changes in PCM composition. We conclude that the PCM composition plays a significant role in the deformation behaviour of chondrocytes, possibly modulating cartilage development, adaptation and degeneration. The development of cartilage repair materials could benefit from this information

Decline in Health-Related Quality of Life reported by more than half of those waiting for joint replacement surgery: a prospective cohort study

<p>Abstract</p> <p>Background</p> <p>In many healthcare systems, people with severe joint disease wait months to years for joint replacement surgery. There are little empirical data on the health consequences of this delay and it is unclear whether people with substantial morbidity at entry to the waiting list continue to deteriorate further while awaiting surgery. This study investigated changes in Health-Related Quality of Life (HRQoL), health status and psychological distress among people waiting for total hip (THR) and knee replacement (TKR) surgery at a major metropolitan Australian public hospital.</p> <p>Methods</p> <p>134 patients completed questionnaires including the Assessment of Quality of Life (AQoL) instrument, Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) and Kessler Psychological Distress Scale after entering an orthopaedic waiting list (baseline) and before surgery (preadmission). To quantify potential decline in wellbeing, we calculated the proportion of people experiencing clinically important deterioration using published guidelines and compared HRQoL and psychological distress outcomes with population norms.</p> <p>Results</p> <p>Most participants (69%) waited ≥6 months for surgery (median 286 days, IQR 169-375 days). Despite poor physical and psychological wellbeing at baseline, there was an overall deterioration in HRQoL during the waiting period (mean AQoL change -0.04, 95%CI -0.08 to -0.01), with 53% of participants experiencing decline in HRQoL (≥0.04 AQoL units). HRQoL prior to surgery remained substantially lower than Australian population norms (mean sample AQoL 0.37, 95%CI 0.33 to 0.42 vs mean population AQoL 0.83, 95%CI 0.82 to 0.84). Twenty-five per cent of participants showed decline in health status (≥9.6 WOMAC units) over the waiting period and prevalence of high psychological distress remained high at preadmission (RR 3.5, 95%CI 2.8 to 4.5). Most participants considered their pain (84%), fatigue (76%), quality of life (73%) and confidence in managing their health (55%) had worsened while waiting for surgery.</p> <p>Conclusions</p> <p>Despite substantial initial morbidity, over half of the participants awaiting joint replacement experienced deterioration in HRQoL during the waiting period. These data provide much-needed evidence to guide health professionals and policymakers in the design of care pathways and resource allocation for people who require joint replacement surgery.</p