B Kang

JW Tukey

K Puolamäki

T Bie De

T De Bie

English

Henelius, Dan Andreas

Oikarinen, Emilia Kristiina

Puolamäki, Kai Rainer

Helsingin yliopiston digitaalinen arkisto

Tiler: Software for Human-Guided DataExplorationAndreas Henelius( ), Emilia Oikarinen, and Kai PuolamäkiDepartment of Computer Science, Aalto University, Helsinki, Finlandfirstname.lastname@aalto.fiAbstract. Understanding relations in datasets is important for the suc-cessful application of data mining and machine learning methods. Thispaper describes tiler, a software tool for interactive visual explorativedata analysis realising the interactive Human-Guided Data Explorationframework. tiler allows a user to formulate different hypotheses con-cerning the relations in a dataset. Data samples corresponding to thesehypotheses are then compared visually, allowing the user to gain insightinto relations in the dataset. The exploration process is iterative and theuser gradually builds up his or her understanding of the data.1 IntroductionAn important goal in Exploratory Data Analysis (EDA) [9] is to gain insight intodifferent relations in the data. Knowledge of relations is essential for successfulapplication of data mining and machine learning methods. Investigating relationscan be efficiently performed using interactive visual EDA software, that presentthe user different views of a dataset, thus leveraging the natural human patternrecognition skills to allow the user to discover interesting relations in the data.Recently, an iterative data mining paradigm [1–4] has been presented and alsorealised in software [6–8] with the emphasis that the user wants to find patternsthat are subjectively interesting given what she or he currently knows about thedata. The system shows the user maximally informative views, i.e., views thatcontrast the most with the user’s current knowledge. As the user explores thedata and discovers patterns concerning relations in the data, these patterns arefed back into the system and taken into account during further exploration, sothat the user is only shown views displaying currently unknown relations in data.Although the knowledge of the user is taken into account one importantproblem still remains: by design, the user cannot know beforehand what views ofthe data that differ the most from her or his present knowledge. Thus, explorationof the most informative views might seem somewhat random to the user and theviews shown might be, even though surprising, not necessarily relevant for thetask at hand. Initially, the user typically wants to test specific ideas (hypotheses)concerning the relations in the data already. These ideas can also develop duringthe exploration. It then becomes essential to be able to focus the explorationprocess to answer specific questions. This is realised in our novel EDA paradigm,termed Human-Guided Data Exploration (HGDE) [5].2 Henelius et al.In this paper we present tiler, a software tool for visual EDA that realisesthe HGDE paradigm for efficient interactive visual EDA. tiler aims to be aneasy-to-use tool for exploring relations in datasets by allowing the user to focusthe exploration to investigate different hypotheses. tiler is an MIT-licensedR-package available from https://github.com/aheneliu/tiler.2 Human-Guided Data ExplorationWe here provide a high-level description of the key concepts in the HGDE frame-work, for a complete discussion and theoretical details we refer to [5].The goal of the user is to discover relations between the attributes in thedata by a comparison of hypotheses, which can be viewed as a comparison oftwo distributions with the same known marginal distributions. A permutation-based scheme is used to obtain samples from the distributions, i.e., we per-mute the given data under a set of constraints defined by the hypotheses.The constraints represent the relations which are assumed to be known aboutthe data: one extreme are unconstrained, column-wise permutations (preserv-ing only the marginals) while the other extreme is the fully constrained casewhere only the identity permutation satisfies the constraints. In general, theconstraints are formulated in terms of tiles: tuples of the form t = (R,C), whereR ⊆ [N ] = {1, . . . , N} and C ⊆ [M ] are subsets of the rows (items) and columns(attributes) of an N ×M data matrix. A tile constrains permutations so thatall items in a tile are permuted together, i.e., there is a single permutation for atile operating on each c ∈ C, thus preserving the relations inside t.Hypotheses are represented in terms of tilings (non-overlapping sets of tiles).The hypotheses are that either all the attributes in the original dataset aredependent or they are all independent can be represented with the following twohypothesis tilings: TH1 = {([N ], [M ])} () and TH2 = {({n}, [M ]) | n ∈ [N ]}.A correlation between two variables i and j in a subset of rows R could bestudied with the following hypothesis tilings: TH1 = {(R, {i, j})} and TH2 ={(R, {i}), (R, {j})}. In the general case, the user can focus on specific data itemsand specific attribute combinations. Focusing allows the user to concentrate onexploring relations in a subset of the data items and attributes, making theinteractive exploration more predictable and allowing specific questions to beanswered.In tiler, the user is shown an informative projection of two data samplescorresponding to the hypotheses and is tasked with comparing these and draw-ing conclusions. In an informative projection the two samples differ the most.A sample from a distribution corresponding to each hypothesis is obtained byrandomly permuting each column in the data, such that the relations betweenattributes enforced by the tilings are preserved. A tiling hence constrains thepermutation of the data. When a user discovers a new pattern, this is added asa constraint (a tile) to both TH1 and TH2 , meaning that the relations expressedby this pattern no longer differs between the two hypotheses. This allows theuser to iteratively build up an understanding of the relations in the data.The Tiler 33 System Designtiler is developed in R (v. 3.4.4) using Shiny (v. 1.0.5) and runs in a webbrowser. The tool supports the full HGDE framework and the usage of tiler isdescribed in the video at http://www.iki.fi/kaip/tiler.html.To explore relations between attributes, the user first specifies the hypothesesbeing compared. The tool implements different modes as shortcuts for typicalhypotheses. The explore-mode (the default) corresponds to iterative data ex-ploration where the two hypotheses to be compared are that (i) all attributesin the original dataset are dependent or (ii) they are all independent. In thefocus-mode the exploration is focused ono investigating all relations within aparticular subset of rows and columns (a focus region). The compare-mode im-plements the general case by allowing the user to specify an arbitrary hypothesisby partitioning the attributes in the focus region into groups.With tiler, the user visually explores a dataset by comparing two data sam-ples corresponding to the two different hypotheses. The exploration is iterativeand the user gradually finds new patterns concerning the relations in the data,which are then added as tiles. The main user interface of tiler is shown inFig. 1 and consists of the following components:Panel allows the mode (explore, focus, or compare) to be selected and containstools for selection of points as well as creation of tiles and focus tiles. Pointscan be selected by brushing in the main view, or by selecting the data froma dropdown menu. Previously added tiles can be selected or deleted. Theprojection in the main view can be changed and the user can show/hide theoriginal data and the two samples corresponding to the combined effect ofthe user and hypotheses tilings. The user can also update the distributionsafter addition of new tiles and then request the next most interesting view.Main view shows the original data (in black) together with samples (in greenand blue) corresponding to the two hypotheses being compared. Points onthe same row in the sampled data matrices are connected using lines. Theselines indicate how points in the data move around due to the randomisation.Since projection of high-dimensional data to lower dimensions can makeinterpretation complicated, we have here chosen to use 2D axis-aligned pro-jections. The x and y axis are hence directly interpretable on their originalscales. We use correlation as measure of informativeness here, as this is oftenintuitive and easy to interpret, but other distance measures between the twosamples being compared can be used too. This measure is used to show themaximally informative view.Selection info shows the five largest classes of the selected points (for datawith class attributes). This helps the user in understanding what type ofpoints are currently selected and gives insight into the relations in the data.Navigation is guided by the bottom right corner showing a scatterplot matrixof the five most interesting attributes in the data. The correlations for bothsamples and their difference using the correlation based measure is shown.The scatterplot helps the user to quickly obtain an overview of the data.4 Henelius et al.Fig. 1: The main user interface of the tiler software tool.Tabs provide functions for loading data, listing tiles, and for defining an at-tribute grouping in the compare mode.Acknowledgements. This work has been supported by the Academy of Finland(decisions 288814 and 313513).References1. De Bie, T.: Subjective interestingness in exploratory data mining. In: IDA. pp. 19–31(2013)2. De Bie, T.: An information theoretic framework for data mining. In: KDD. pp.564–572 (2011)3. De Bie, T.: Maximum entropy models and subjective interestingness: an applicationto tiles in binary databases. Data Min. Knowl. Discov. 23(3), 407–446 (2011)4. Hanhijärvi, S., Ojala, M., Vuokko, N., Puolamäki, K., Tatti, N., Mannila, H.: Tellme something I don’t know: randomization strategies for iterative data mining. In:KDD. pp. 379–388 (2009)5. Henelius, A., Oikarinen, E., Puolamäki, K.: Human-guided data exploration. arXivpreprint, arXiv:1804.03194 (2018)6. Kang, B., Puolamäki, K., Lijffijt, J., De Bie, T.: A tool for subjective and interactivevisual data exploration. In: ECML-PKDD. pp. 3–7 (2016)7. Puolamäki, K., Kang, B., Lijffijt, J., De Bie, T.: Interactive visual data explorationwith subjective feedback. In: ECML-PKDD. pp. 214–229 (2016)8. Puolamäki, K., Oikarinen, E., Kang, B., Lijffijt, J., Bie, T.D.: Interactive visualdata exploration with subjective feedback: An information-theoretic approach. In:ICDE. pp. 1208–1211 (2018)9. Tukey, J.W.: Exploratory data analysis. Addison-Wesley (1977)

Tiler : Software for Human-Guided Data Exploration

Crossref

Tiler: Software for Human-Guided Data Exploration

https://helda.helsinki.fi/bitstream/10138/323325/1/ecmlpkdddemo_HeneliusOP.pdf

Tiler : Software for Human-Guided Data Exploration

Abstract

Similar works

Full text

Available Versions

Helsingin yliopiston digitaalinen arkisto

Crossref