Improving information retrieval through correspondence analysis instead of latent semantic analysis

Both latent semantic analysis (LSA) and correspondence analysis (CA) are dimensionality reduction techniques that use singular value decomposition (SVD) for information retrieval. Theoretically, the results of LSA display both the association between documents and terms, and marginal effects; in comparison, CA only focuses on the associations between documents and terms. Marginal effects are usually not relevant for information retrieval, and therefore, from a theoretical perspective CA is more suitable for information retrieval. In this paper, we empirically compare LSA and CA. The elements of the raw document-term matrix are weighted, and the weighting exponent of singular values is adjusted to improve the performance of LSA. We explore whether these two weightings also improve the performance of CA. In addition, we compare the optimal singular value weighting exponents for LSA and CA to identify what the initial dimensions in LSA correspond to. The results for four empirical datasets show that CA always performs better than LSA. Weighting the elements of the raw data matrix can improve CA; however, it is data dependent and the improvement is small. Adjusting the singular value weighting exponent usually improves the performance of CA; however, the extent of the improved performance depends on the dataset and number of dimensions. In general, CA needs a larger singular value weighting exponent than LSA to obtain the optimal performance. This indicates that CA emphasizes initial dimensions more than LSA, and thus, margins play an important role in the initial dimensions in LSA

Detection of the tulip breaking virus (TBV) in tulips using optical sensors

The tulip breaking virus (TBV) causes severe economic losses for countries that export tulips such as the Netherlands. Infected plants have to be removed from the field as soon as possible. There is an urgent need for a rapid and objective method of screening. In this study, four proximal optical sensing techniques for the detection of TBV in tulip plants were evaluated and compared with a visual assessment by crop experts as well as with an ELISA (enzyme immunoassay) analysis of the same plants. The optical sensor techniques used were an RGB color camera, a spectrophotometer measuring from 350 to 2500 nm, a spectral imaging camera covering a spectral range from 400 to 900 nm and a chlorophyll fluorescence imaging system that measures the photosynthetic activity. Linear discriminant classification was used to compare the results of these optical techniques and the visual assessment with the ELISA score. The spectral imaging system was the best optical technique and its error was only slightly larger than the visual assessment error. The experimental results appear to be promising, and they have led to further research to develop an autonomous robot for the detection and removal of diseased tulip plants in the open field. The application of this robot system will reduce the amount of insecticides and the considerable pressure on labor for selecting diseased plants by the crop expert. © 2010 The Author(s

Integrability of a conducting elastic rod in a magnetic field

We consider the equilibrium equations for a conducting elastic rod placed in a uniform magnetic field, motivated by the problem of electrodynamic space tethers. When expressed in body coordinates the equations are found to sit in a hierarchy of non-canonical Hamiltonian systems involving an increasing number of vector fields. These systems, which include the classical Euler and Kirchhoff rods, are shown to be completely integrable in the case of a transversely isotropic rod; they are in fact generated by a Lax pair. For the magnetic rod this gives a physical interpretation to a previously proposed abstract nine-dimensional integrable system. We use the conserved quantities to reduce the equations to a four-dimensional canonical Hamiltonian system, allowing the geometry of the phase space to be investigated through Poincar\'e sections. In the special case where the force in the rod is aligned with the magnetic field the system turns out to be superintegrable, meaning that the phase space breaks down completely into periodic orbits, corresponding to straight twisted rods.Comment: 19 pages, 1 figur

Tension-induced multistability in inextensible helical ribbons

We study the non-monotonic force-extension behaviour of helical ribbons using a new model for inextensible elastic strips. Unlike previous rod models our model predicts hysteresis behaviour for low-pitch ribbons of arbitrary material properties. Associated with it is a first-order transition between two different helical states as observed in experiments with cholesterol ribbons. Numerical solutions show non-uniform uncoiling with hysteresis also occurring under controlled tension. They furthermore reveal a new uncoiling scenario in which a ribbon of very low pitch shears under tension and successively releases a sequence of almost planar loops. Our results may be relevant for nanoscale devices such as force probes.Comment: 11 pages, 6 figure

Using Chao's Estimator as a Stopping Criterion for Technology-Assisted Review

Technology-Assisted Review (TAR) aims to reduce the human effort required for screening processes such as abstract screening for systematic literature reviews. Human reviewers label documents as relevant or irrelevant during this process, while the system incrementally updates a prediction model based on the reviewers' previous decisions. After each model update, the system proposes new documents it deems relevant, to prioritize relevant documentsover irrelevant ones. A stopping criterion is necessary to guide users in stopping the review process to minimize the number of missed relevant documents and the number of read irrelevant documents. In this paper, we propose and evaluate a new ensemble-based Active Learning strategy and a stopping criterion based on Chao's Population Size Estimator that estimates the prevalence of relevant documents in the dataset. Our simulation study demonstrates that this criterion performs well on several datasets and is compared to other methods presented in the literature

Accounting for self-protective responses in randomized response data from a social security survey using the zero-inflated Poisson model

In 2004 the Dutch Department of Social Affairs conducted a survey to assess the extent of noncompliance with social security regulations. The survey was conducted among 870 recipients of social security benefits and included a series of sensitive questions about regulatory noncompliance. Due to the sensitive nature of the questions the randomized response design was used. Although randomized response protects the privacy of the respondent, it is unlikely that all respondents followed the design. In this paper we introduce a model that allows for respondents displaying self-protective response behavior by consistently giving the nonincriminating response, irrespective of the outcome of the randomizing device. The dependent variable denoting the total number of incriminating responses is assumed to be generated by the application of randomized response to a latent Poisson variable denoting the true number of rule violations. Since self-protective responses result in an excess of observed zeros in relation to the Poisson randomized response distribution, these are modeled as observed zero-inflation. The model includes predictors of the Poisson parameters, as well as predictors of the probability of self-protective response behavior.Comment: Published in at http://dx.doi.org/10.1214/07-AOAS135 the Annals of Applied Statistics (http://www.imstat.org/aoas/) by the Institute of Mathematical Statistics (http://www.imstat.org

Academic detailing in oral healthcare - results of the ADVOCATE Field Studies

Background: Academic detailing (AD) is a defined form of educational outreach that can be used to influence decision making and reduce unwarranted variation in healthcare delivery. This paper describes the results of the proof of concept phase of the ADVOCATE Field Studies. This study evaluated the feasibility, acceptability and usefulness of AD reinforced with feedback data, to promote prevention-oriented, patient-centred and evidence-based oral healthcare delivery by general dental practitioners (GDPs). Methods: In the Field Studies, six groups of GDPs (n = 39) were recruited in The Netherlands, Germany and Denmark. Each group had four meetings reinforced with feedback data for open discussions on dental practice and healthcare delivery. Conventional and directed content analysis was used to analyze the qualitative data collected from focus group interviews, debriefing interviews, field notes and evaluation forms. Results: A total of nine themes were identified. Seven themes related to the process of the Field Studies and covered experiences, barriers and facilitators to AD group meetings, data collection and the use of an electronic dashboard for data presentation and storage. Two themes related to the outcomes of the study, describing how GDPs perceived they made changes to their clinical practice as a result of the Field Studies. Conclusions: The ADVOCATE Field Studies approach offers a novel way of collecting and providing feedback to care providers which has the potential to reduce variation oral healthcare delivery. AD plus feedback data is a useful, feasible approach which creates awareness and gives insight into care delivery processes. Some logistic and technical barriers to adoption were identified, which if resolved would further improve the approach and likely increase the acceptability amongst GDPs