10,062 research outputs found
Analyzing and Visualizing Cosmological Simulations with ParaView
The advent of large cosmological sky surveys - ushering in the era of
precision cosmology - has been accompanied by ever larger cosmological
simulations. The analysis of these simulations, which currently encompass tens
of billions of particles and up to trillion particles in the near future, is
often as daunting as carrying out the simulations in the first place.
Therefore, the development of very efficient analysis tools combining
qualitative and quantitative capabilities is a matter of some urgency. In this
paper we introduce new analysis features implemented within ParaView, a
parallel, open-source visualization toolkit, to analyze large N-body
simulations. The new features include particle readers and a very efficient
halo finder which identifies friends-of-friends halos and determines common
halo properties. In combination with many other functionalities already
existing within ParaView, such as histogram routines or interfaces to Python,
this enhanced version enables fast, interactive, and convenient analyses of
large cosmological simulations. In addition, development paths are available
for future extensions.Comment: 9 pages, 8 figure
What Is One Grain of Sand in the Desert? Analyzing Individual Neurons in Deep NLP Models
Despite the remarkable evolution of deep neural networks in natural language
processing (NLP), their interpretability remains a challenge. Previous work
largely focused on what these models learn at the representation level. We
break this analysis down further and study individual dimensions (neurons) in
the vector representation learned by end-to-end neural models in NLP tasks. We
propose two methods: Linguistic Correlation Analysis, based on a supervised
method to extract the most relevant neurons with respect to an extrinsic task,
and Cross-model Correlation Analysis, an unsupervised method to extract salient
neurons w.r.t. the model itself. We evaluate the effectiveness of our
techniques by ablating the identified neurons and reevaluating the network's
performance for two tasks: neural machine translation (NMT) and neural language
modeling (NLM). We further present a comprehensive analysis of neurons with the
aim to address the following questions: i) how localized or distributed are
different linguistic properties in the models? ii) are certain neurons
exclusive to some properties and not others? iii) is the information more or
less distributed in NMT vs. NLM? and iv) how important are the neurons
identified through the linguistic correlation method to the overall task? Our
code is publicly available as part of the NeuroX toolkit (Dalvi et al. 2019).Comment: AAA 2019, pages 10, AAAI Conference on Artificial Intelligence (AAAI
2019
NodeTrix: Hybrid Representation for Analyzing Social Networks
The need to visualize large social networks is growing as hardware
capabilities make analyzing large networks feasible and many new data sets
become available. Unfortunately, the visualizations in existing systems do not
satisfactorily answer the basic dilemma of being readable both for the global
structure of the network and also for detailed analysis of local communities.
To address this problem, we present NodeTrix, a hybrid representation for
networks that combines the advantages of two traditional representations:
node-link diagrams are used to show the global structure of a network, while
arbitrary portions of the network can be shown as adjacency matrices to better
support the analysis of communities. A key contribution is a set of interaction
techniques. These allow analysts to create a NodeTrix visualization by dragging
selections from either a node-link or a matrix, flexibly manipulate the
NodeTrix representation to explore the dataset, and create meaningful summary
visualizations of their findings. Finally, we present a case study applying
NodeTrix to the analysis of the InfoVis 2004 coauthorship dataset to illustrate
the capabilities of NodeTrix as both an exploration tool and an effective means
of communicating results
- …