59 research outputs found
ActiveNeRF: Learning where to See with Uncertainty Estimation
Recently, Neural Radiance Fields (NeRF) has shown promising performances on
reconstructing 3D scenes and synthesizing novel views from a sparse set of 2D
images. Albeit effective, the performance of NeRF is highly influenced by the
quality of training samples. With limited posed images from the scene, NeRF
fails to generalize well to novel views and may collapse to trivial solutions
in unobserved regions. This makes NeRF impractical under resource-constrained
scenarios. In this paper, we present a novel learning framework, ActiveNeRF,
aiming to model a 3D scene with a constrained input budget. Specifically, we
first incorporate uncertainty estimation into a NeRF model, which ensures
robustness under few observations and provides an interpretation of how NeRF
understands the scene. On this basis, we propose to supplement the existing
training set with newly captured samples based on an active learning scheme. By
evaluating the reduction of uncertainty given new inputs, we select the samples
that bring the most information gain. In this way, the quality of novel view
synthesis can be improved with minimal additional resources. Extensive
experiments validate the performance of our model on both realistic and
synthetic scenes, especially with scarcer training data. Code will be released
at \url{https://github.com/LeapLabTHU/ActiveNeRF}.Comment: Accepted by ECCV202
Anytime Stereo Image Depth Estimation on Mobile Devices
Many applications of stereo depth estimation in robotics require the
generation of accurate disparity maps in real time under significant
computational constraints. Current state-of-the-art algorithms force a choice
between either generating accurate mappings at a slow pace, or quickly
generating inaccurate ones, and additionally these methods typically require
far too many parameters to be usable on power- or memory-constrained devices.
Motivated by these shortcomings, we propose a novel approach for disparity
prediction in the anytime setting. In contrast to prior work, our end-to-end
learned approach can trade off computation and accuracy at inference time.
Depth estimation is performed in stages, during which the model can be queried
at any time to output its current best estimate. Our final model can process
1242375 resolution images within a range of 10-35 FPS on an NVIDIA
Jetson TX2 module with only marginal increases in error -- using two orders of
magnitude fewer parameters than the most competitive baseline. The source code
is available at https://github.com/mileyan/AnyNet .Comment: Accepted by ICRA201
Aggregate Model of District Heating Network for Integrated Energy Dispatch: A Physically Informed Data-Driven Approach
The district heating network (DHN) is essential in enhancing the operational
flexibility of integrated energy systems (IES). Yet, it is hard to obtain an
accurate and concise DHN model for the operation owing to complicated network
features and imperfect measurement. Considering this, this paper proposes a
physically informed data-driven aggregate model (AGM) for DHN, providing a
concise description of the source-load relationship of DHN without exposing
network details. First, we derive the analytical relationship between the state
variables of the source and load nodes of DHN, offering a physical fundament
for the AGM. Second, we propose a physics-informed estimator for AGM that is
robust to low-quality measurement, in which the physical constraints associated
with the parameter normalization and sparsity are embedded to improve the
accuracy and robustness. Finally, we propose a physics-enhanced algorithm to
solve the nonlinear estimator with non-closed constraints efficiently.
Simulation results verify the effectiveness of the proposed method
Learning to Weight Samples for Dynamic Early-exiting Networks
Early exiting is an effective paradigm for improving the inference efficiency
of deep networks. By constructing classifiers with varying resource demands
(the exits), such networks allow easy samples to be output at early exits,
removing the need for executing deeper layers. While existing works mainly
focus on the architectural design of multi-exit networks, the training
strategies for such models are largely left unexplored. The current
state-of-the-art models treat all samples the same during training. However,
the early-exiting behavior during testing has been ignored, leading to a gap
between training and testing. In this paper, we propose to bridge this gap by
sample weighting. Intuitively, easy samples, which generally exit early in the
network during inference, should contribute more to training early classifiers.
The training of hard samples (mostly exit from deeper layers), however, should
be emphasized by the late classifiers. Our work proposes to adopt a weight
prediction network to weight the loss of different training samples at each
exit. This weight prediction network and the backbone model are jointly
optimized under a meta-learning framework with a novel optimization objective.
By bringing the adaptive behavior during inference into the training phase, we
show that the proposed weighting mechanism consistently improves the trade-off
between classification accuracy and inference efficiency. Code is available at
https://github.com/LeapLabTHU/L2W-DEN.Comment: ECCV 202
The dual role of glioma exosomal microRNAs: glioma eliminates tumor suppressor miR-1298-5p via exosomes to promote immunosuppressive effects of MDSCs
Clear evidence shows that tumors could secrete microRNAs (miRNAs) via exosomes to modulate the tumor microenvironment (TME). However, the mechanisms sorting specific miRNAs into exosomes are still unclear. In order to study the biological function and characterization of exosomal miRNAs, we performed whole-transcriptome sequencing in 59 patients’ whole-course cerebrospinal fluid (CSF) small extracellular vesicles (sEV) and matched glioma tissue samples. The results demonstrate that miRNAs could be divided into exosome-enriched miRNAs (ExomiRNAs) and intracellular-retained miRNAs (CLmiRNAs), and exosome-enriched miRNAs generally play a dual role. Among them, miR-1298-5p was enriched in CSF exosomes and suppressed glioma progression in vitro and vivo experiments. Interestingly, exosomal miR-1298-5p could promote the immunosuppressive effects of myeloid-derived suppressor cells (MDSCs) to facilitate glioma. Therefore, we found miR-1298-5p had different effects on glioma cells and MDSCs. Mechanically, downstream signaling pathway analyses showed that miR-1298-5p plays distinct roles in glioma cells and MDSCs via targeting SETD7 and MSH2, respectively. Moreover, reverse verification was performed on the intracellular-retained miRNA miR-9-5p. Thus, we confirmed that tumor-suppressive miRNAs in glioma cells could be eliminated through exosomes and target tumor-associated immune cells to induce tumor-promoting phenotypes. Glioma could get double benefit from it. These findings uncover the mechanisms that glioma selectively sorts miRNAs into exosomes and modulates tumor immunity.publishedVersio
SPI1-induced downregulation of FTO promotes GBM progression by regulating pri-miR-10a processing in an m6A-dependent manner
As one of the most common post-transcriptional modifications of mRNAs and noncoding RNAs, N6-methyladenosine (m6A) modification regulates almost every aspect of RNA metabolism. Evidence indicates that dysregulation of m6A modification and associated proteins contributes to glioblastoma (GBM) progression. However, the function of fat mass and obesity-associated protein (FTO), an m6A demethylase, has not been systematically and comprehensively explored in GBM. Here, we found that decreased FTO expression in clinical specimens correlated with higher glioma grades and poorer clinical outcomes. Functionally, FTO inhibited growth and invasion in GBM cells in vitro and in vivo. Mechanistically, FTO regulated the m6A modification of primary microRNA-10a (pri-miR-10a), which could be recognized by reader HNRNPA2B1, recruiting the microRNA microprocessor complex protein DGCR8 and mediating pri-miR-10a processing. Furthermore, the transcriptional activity of FTO was inhibited by the transcription factor SPI1, which could be specifically disrupted by the SPI1 inhibitor DB2313. Treatment with this inhibitor restored endogenous FTO expression and decreased GBM tumor burden, suggesting that FTO may serve as a novel prognostic indicator and therapeutic molecular target of GBM.publishedVersio
The United States COVID-19 Forecast Hub dataset
Academic researchers, government agencies, industry groups, and individuals have produced forecasts at an unprecedented scale during the COVID-19 pandemic. To leverage these forecasts, the United States Centers for Disease Control and Prevention (CDC) partnered with an academic research lab at the University of Massachusetts Amherst to create the US COVID-19 Forecast Hub. Launched in April 2020, the Forecast Hub is a dataset with point and probabilistic forecasts of incident cases, incident hospitalizations, incident deaths, and cumulative deaths due to COVID-19 at county, state, and national, levels in the United States. Included forecasts represent a variety of modeling approaches, data sources, and assumptions regarding the spread of COVID-19. The goal of this dataset is to establish a standardized and comparable set of short-term forecasts from modeling teams. These data can be used to develop ensemble models, communicate forecasts to the public, create visualizations, compare models, and inform policies regarding COVID-19 mitigation. These open-source data are available via download from GitHub, through an online API, and through R packages
Large expert-curated database for benchmarking document similarity detection in biomedical literature search
Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical research.Peer reviewe
- …