Generic 3D Representation via Pose Estimation and Matching

Though a large body of computer vision research has investigated developing generic semantic representations, efforts towards developing a similar representation for 3D has been limited. In this paper, we learn a generic 3D representation through solving a set of foundational proxy 3D tasks: object-centric camera pose estimation and wide baseline feature matching. Our method is based upon the premise that by providing supervision over a set of carefully selected foundational tasks, generalization to novel tasks and abstraction capabilities can be achieved. We empirically show that the internal representation of a multi-task ConvNet trained to solve the above core problems generalizes to novel 3D tasks (e.g., scene layout estimation, object pose estimation, surface normal estimation) without the need for fine-tuning and shows traits of abstraction abilities (e.g., cross-modality pose estimation). In the context of the core supervised tasks, we demonstrate our representation achieves state-of-the-art wide baseline feature matching results without requiring apriori rectification (unlike SIFT and the majority of learned features). We also show 6DOF camera pose estimation given a pair local image patches. The accuracy of both supervised tasks come comparable to humans. Finally, we contribute a large-scale dataset composed of object-centric street view scenes along with point correspondences and camera pose information, and conclude with a discussion on the learned representation and open research questions.Comment: Published in ECCV16. See the project website http://3drepresentation.stanford.edu/ and dataset website https://github.com/amir32002/3D_Street_Vie

Serum potassium levels and outcome in acute heart failure (Data from the PROTECT and COACH Trials)

Serum potassium is routinely measured at admission for acute heart failure (AHF), but information on association with clinical variables and prognosis is limited. Potassium measurements at admission were available in 1,867 patients with AHF in the original cohort of 2,033 patients included in the Patients Hospitalized with acute heart failure and Volume Overload to Assess Treatment Effect on Congestion and Renal FuncTion trial. Patients were grouped according to low potassium ( 5.0 mEq/l) levels. Results were veri fi ed in a validation cohort of 1,023 patients. Mean age of patients was 71 – 11 years, and 66% were men. Low potassium was present in 115 patients (6%), normal potassium in 1,576 (84%), and high potassium in 176 (9%). Potassium levels increased during hospitalization (0.18 – 0.69 mEq/l). Patients with high potassium more often used angiotensin-converting enzyme inhibitors and mineralo- corticoid receptor antagonists before admission, had impaired baseline renal function and a better diuretic response (p [ 0.005), independent of mineralocorticoid receptor antagonist usage. During 180-day follow-up, a total of 330 patients (18%) died. Potassium levels at admission showed a univariate linear association with mortality (hazard ratio [log] 2.36, 95% con fi dence interval 1.07 to 5.23; p [ 0.034) but not after multivariate adjustment. Changes of potassium levels during hospitalization or potassium levels at discharge were not associated with outcome after multivariate analysis. Results in the validation cohort were similar to the index cohort. In conclusion, high potassium levels at admission are associated with an impaired renal function but a better diuretic response. Changes in po- tassium levels are common, and overall levels increase during hospitalization. In conclu- sion, potassium levels at admission or its change during hospitalization are not associated with mortality after multivariate adjustment

A unified data representation theory for network visualization, ordering and coarse-graining

Representation of large data sets became a key question of many scientific disciplines in the last decade. Several approaches for network visualization, data ordering and coarse-graining accomplished this goal. However, there was no underlying theoretical framework linking these problems. Here we show an elegant, information theoretic data representation approach as a unified solution of network visualization, data ordering and coarse-graining. The optimal representation is the hardest to distinguish from the original data matrix, measured by the relative entropy. The representation of network nodes as probability distributions provides an efficient visualization method and, in one dimension, an ordering of network nodes and edges. Coarse-grained representations of the input network enable both efficient data compression and hierarchical visualization to achieve high quality representations of larger data sets. Our unified data representation theory will help the analysis of extensive data sets, by revealing the large-scale structure of complex networks in a comprehensible form.Comment: 13 pages, 5 figure

T cell cytolytic capacity is independent of initial stimulation strength.

How cells respond to myriad stimuli with finite signaling machinery is central to immunology. In naive T cells, the inherent effect of ligand strength on activation pathways and endpoints has remained controversial, confounded by environmental fluctuations and intercellular variability within populations. Here we studied how ligand potency affected the activation of CD8+ T cells in vitro, through the use of genome-wide RNA, multi-dimensional protein and functional measurements in single cells. Our data revealed that strong ligands drove more efficient and uniform activation than did weak ligands, but all activated cells were fully cytolytic. Notably, activation followed the same transcriptional pathways regardless of ligand potency. Thus, stimulation strength did not intrinsically dictate the T cell-activation route or phenotype; instead, it controlled how rapidly and simultaneously the cells initiated activation, allowing limited machinery to elicit wide-ranging responses

Co-regulation map of the human proteome enables identification of protein functions

This is the author accepted manuscript. The final version is available from Nature Research via the DOI in this recordData availability: All mass spectrometry raw files generated in-house have been deposited in the ProteomeXchange Consortium (http://proteomecentral.proteomexchange.org) via the PRIDE partner repository36 with the dataset identifier PXD008888. The co-regulation map is hosted on our website at www.proteomeHD.net, and pair-wise co-regulation scores are available through STRING (https://string-db.org). A network of the top 0.5% co-regulated protein pairs can be explored interactively on NDEx (https://doi.org/10.18119/N9N30Q).Code availability: Data analysis was performed in R 3.5.1. R scripts and input files required to reproduce the results of this manuscript are available in the following GitHub repository: https://github.com/Rappsilber-Laboratory/ProteomeHD. R scripts related specifically to the benchmarking of the treeClust algorithm using synthetic data are available in the following GitHub repository: https://github.com/Rappsilber-Laboratory/treeClust-benchmarking. The R package data.table was used for fast data processing. Figures were prepared using ggplot2, gridExtra, cowplot and viridis.Note that the title of the AAM is different from the published versionThe annotation of protein function is a longstanding challenge of cell biology that suffers from the sheer magnitude of the task. Here we present ProteomeHD, which documents the response of 10,323 human proteins to 294 biological perturbations, measured by isotope-labelling mass spectrometry. We reveal functional associations between human proteins using the treeClust machine learning algorithm, which we show to improve protein co-regulation analysis due to robust selectivity for close linear relationships. Our co-regulation map identifies a functional context for many uncharacterized proteins, including microproteins that are difficult to study with traditional methods. Co-regulation also captures relationships between proteins which do not physically interact or co-localize. For example, co-regulation of the peroxisomal membrane protein PEX11β with mitochondrial respiration factors led us to discover a novel organelle interface between peroxisomes and mitochondria in mammalian cells. The co-regulation map can be explored at www.proteomeHD.net .Biotechnology & Biological Sciences Research Council (BBSRC)European Commissio

The representation of speech in deep neural networks

In this paper, we investigate the connection between how people understand speech and how speech is understood by a deep neural network. A naïve, general feed-forward deep neural network was trained for the task of vowel/consonant classification. Subsequently, the representations of the speech signal in the different hidden layers of the DNN were visualized. The visualizations allow us to study the distance between the representations of different types of input frames and observe the clustering structures formed by these representations. In the different visualizations, the input frames were labeled with different linguistic categories: sounds in the same phoneme class, sounds with the same manner of articulation, and sounds with the same place of articulation. We investigate whether the DNN clusters speech representations in a way that corresponds to these linguistic categories and observe evidence that the DNN does indeed appear to learn structures that humans use to understand speech without being explicitly trained to do so.Accepted author manuscriptMultimedia Computin