134,291 research outputs found
Interactive Data Exploration with Smart Drill-Down
We present {\em smart drill-down}, an operator for interactively exploring a
relational table to discover and summarize "interesting" groups of tuples. Each
group of tuples is described by a {\em rule}. For instance, the rule tells us that there are a thousand tuples with value in the
first column and in the second column (and any value in the third column).
Smart drill-down presents an analyst with a list of rules that together
describe interesting aspects of the table. The analyst can tailor the
definition of interesting, and can interactively apply smart drill-down on an
existing rule to explore that part of the table. We demonstrate that the
underlying optimization problems are {\sc NP-Hard}, and describe an algorithm
for finding the approximately optimal list of rules to display when the user
uses a smart drill-down, and a dynamic sampling scheme for efficiently
interacting with large tables. Finally, we perform experiments on real datasets
on our experimental prototype to demonstrate the usefulness of smart drill-down
and study the performance of our algorithms
Automated data reduction workflows for astronomy
Data from complex modern astronomical instruments often consist of a large
number of different science and calibration files, and their reduction requires
a variety of software tools. The execution chain of the tools represents a
complex workflow that needs to be tuned and supervised, often by individual
researchers that are not necessarily experts for any specific instrument. The
efficiency of data reduction can be improved by using automatic workflows to
organise data and execute the sequence of data reduction steps. To realize such
efficiency gains, we designed a system that allows intuitive representation,
execution and modification of the data reduction workflow, and has facilities
for inspection and interaction with the data. The European Southern Observatory
(ESO) has developed Reflex, an environment to automate data reduction
workflows. Reflex is implemented as a package of customized components for the
Kepler workflow engine. Kepler provides the graphical user interface to create
an executable flowchart-like representation of the data reduction process. Key
features of Reflex are a rule-based data organiser, infrastructure to re-use
results, thorough book-keeping, data progeny tracking, interactive user
interfaces, and a novel concept to exploit information created during data
organisation for the workflow execution. Reflex includes novel concepts to
increase the efficiency of astronomical data processing. While Reflex is a
specific implementation of astronomical scientific workflows within the Kepler
workflow engine, the overall design choices and methods can also be applied to
other environments for running automated science workflows.Comment: 12 pages, 7 figure
Visualization Techniques for Tongue Analysis in Traditional Chinese Medicine
Visual inspection of the tongue has been an important diagnostic method of Traditional Chinese Medicine (TCM). Clinic data have shown significant connections between various viscera cancers and abnormalities in the tongue and the tongue coating. Visual inspection of the tongue is simple and inexpensive, but the current practice in TCM is mainly experience-based and the quality of the visual inspection varies between individuals. The computerized inspection method provides quantitative models to evaluate color, texture and surface features on the tongue. In this paper, we investigate visualization techniques and processes to allow interactive data analysis with the aim to merge computerized measurements with human expert's diagnostic variables based on five-scale diagnostic conditions: Healthy (H), History Cancers (HC), History of Polyps (HP), Polyps (P) and Colon Cancer (C)
- …