64 research outputs found
Discovering Class-Specific Pixels for Weakly-Supervised Semantic Segmentation
We propose an approach to discover class-specific pixels for the
weakly-supervised semantic segmentation task. We show that properly combining
saliency and attention maps allows us to obtain reliable cues capable of
significantly boosting the performance. First, we propose a simple yet powerful
hierarchical approach to discover the class-agnostic salient regions, obtained
using a salient object detector, which otherwise would be ignored. Second, we
use fully convolutional attention maps to reliably localize the class-specific
regions in a given image. We combine these two cues to discover class-specific
pixels which are then used as an approximate ground truth for training a CNN.
While solving the weakly supervised semantic segmentation task, we ensure that
the image-level classification task is also solved in order to enforce the CNN
to assign at least one pixel to each object present in the image.
Experimentally, on the PASCAL VOC12 val and test sets, we obtain the mIoU of
60.8% and 61.9%, achieving the performance gains of 5.1% and 5.2% compared to
the published state-of-the-art results. The code is made publicly available
Bipolar Latissimus Dorsi Transfer through a Single Incision: First Key-Step in Poland Syndrome Chest Deformity.
Poland syndrome is a rare congenital anomaly characterized by a unilateral congenital absence of the sternocostal head of the pectoralis major muscle. The absence of the pectoralis major does not only result in chest asymmetry but also in a missing anterior axillary fold, which is essential for natural anatomical appearance in both male and female patients. In Poland syndrome patients, we perform bipolar latissimus dorsi flap transfer, which can be associated with a sublatissimus implant in women. All procedures are performed through a single short midaxillary incision, and tendon translocation in this technique allows the creation of the anterior axillary fold and thus a natural chest appearance. Moreover, this technique can be performed by any plastic surgeon operating under a basic operating room setting
Continual Learning in Low-rank Orthogonal Subspaces
In continual learning (CL), a learner is faced with a sequence of tasks,
arriving one after the other, and the goal is to remember all the tasks once
the continual learning experience is finished. The prior art in CL uses
episodic memory, parameter regularization or extensible network structures to
reduce interference among tasks, but in the end, all the approaches learn
different tasks in a joint vector space. We believe this invariably leads to
interference among different tasks. We propose to learn tasks in different
(low-rank) vector subspaces that are kept orthogonal to each other in order to
minimize interference. Further, to keep the gradients of different tasks coming
from these subspaces orthogonal to each other, we learn isometric mappings by
posing network training as an optimization problem over the Stiefel manifold.
To the best of our understanding, we report, for the first time, strong results
over experience-replay baseline with and without memory on standard
classification benchmarks in continual learning. The code is made publicly
available.Comment: The paper is accepted at NeurIPS'2
Using Hindsight to Anchor Past Knowledge in Continual Learning
In continual learning, the learner faces a stream of data whose distribution
changes over time. Modern neural networks are known to suffer under this
setting, as they quickly forget previously acquired knowledge. To address such
catastrophic forgetting, many continual learning methods implement different
types of experience replay, re-learning on past data stored in a small buffer
known as episodic memory. In this work, we complement experience replay with a
new objective that we call anchoring, where the learner uses bilevel
optimization to update its knowledge on the current task, while keeping intact
the predictions on some anchor points of past tasks. These anchor points are
learned using gradient-based optimization to maximize forgetting, which is
approximated by fine-tuning the currently trained model on the episodic memory
of past tasks. Experiments on several supervised learning benchmarks for
continual learning demonstrate that our approach improves the standard
experience replay in terms of both accuracy and forgetting metrics and for
various sizes of episodic memories.Comment: Accepted at AAAI 202
The Optimization and Mathematical Modeling of Quality Attributes of Parboiled Rice Using a Response Surface Method
The response surface methodology was used to optimize the hydrothermal processing conditions based on the rice quality parameters of the Rong Youhua Zhan rice variety (Indica). The effect of soaking temperature (29.77, 40, 55, 70, and 80.23°C), soaking time (67.55, 90, 120, 150, and 170.45 min), and steaming time (1.59, 5, 10, 15, and 18.41 min), each tested at five levels, on percentage of head rice yield (HRY), hardness, cooking time, lightness, and color were determined, with R2 values of 0.96, 0.94, 0.90, 0.88, and 0.94, respectively. HRY, hardness, cooking time, and color increased with process severity while lightness decreased, although HRY decreased after reaching a maximum. The predicted optimum soaking temperature, soaking time, and steaming time were 69.88°C, 150 min, and 6.73 min, respectively, and the predicted HRY, hardness, cooking time, lightness, and color under these conditions were 73.43%, 29.95 N, 32.14 min, 83.03 min, and 12.24 min, respectively, with a composite desirability of 0.9658. The parboiling industry could use the findings of the current study to obtain the desired quality of parboiled rice. This manuscript will be helpful for researchers working on commercializing parboiled rice processes in China as well as in other countries
Wide Neural Networks Forget Less Catastrophically
A primary focus area in continual learning research is alleviating the
"catastrophic forgetting" problem in neural networks by designing new
algorithms that are more robust to the distribution shifts. While the recent
progress in continual learning literature is encouraging, our understanding of
what properties of neural networks contribute to catastrophic forgetting is
still limited. To address this, instead of focusing on continual learning
algorithms, in this work, we focus on the model itself and study the impact of
"width" of the neural network architecture on catastrophic forgetting, and show
that width has a surprisingly significant effect on forgetting. To explain this
effect, we study the learning dynamics of the network from various perspectives
such as gradient orthogonality, sparsity, and lazy training regime. We provide
potential explanations that are consistent with the empirical results across
different architectures and continual learning benchmarks.Comment: ICML 202
Synthesis and applications of graphene and graphene-based nanocomposites: Conventional to artificial intelligence approaches
Recent advances in graphene research have enabled the utilization of its nanocomposites for numerous energy-based and environmental applications. Recently, the advancement in graphene-based polymer nanocomposites has received much attention with special emphasis on synthesis and application. Graphene-based nanocomposites show astonishing electrical, mechanical, chemical, and thermal characteristics. Graphene nanocomposites (GNCs) are synthesized using a variety of methods, including covalent and non-covalent methods, a chemical-based deposition approach, hydrothermal growth, electrophoresis deposition, and physical deposition. Chemical methods are the most viable route for producing graphene in small quantities at low temperatures. The technique can also produce graphene films on a variety of substrate materials. The use of artificial intelligence (AI) for the synthesis of AI-created nanoparticles has recently received a lot of attention. These nanocomposite materials have excellent applications in the environmental, energy, and agricultural sectors. Due to high carrier mobility, graphene-based materials enhance the photocatalytic performance of semiconductor materials. Similarly, these materials have high potential for pollutant removal, especially heavy metals, due to their high surface area. This article highlights the synthesis of graphene-based nanocomposites with special reference to harnessing the power of modern AI tools to better understand GNC material properties and the way this knowledge can be used for its better applications in the development of a sustainable future
Impacts of climate change on Capparis spinosa L. based on ecological niche modeling
Recent changes in climate are transforming the situation of life on Earth, including impacting the conservation status of many plant and animal species. This study aims to evaluate potential impacts of climate change on a medicinal plant that is known to be heat-tolerant, Capparis spinosa L. We used ecological niche modeling to estimate current and future potential distributions for the species, considering two emissions scenarios and five climate models for two time periods (2050 and 2070). The results in terms of areal coverage at different suitability levels in the future were closely similar to its present-day distribution; indeed, only minor differences existed in highly suitable area, with increases of only 0.2–0.3% in suitable area for 2050 and 2070 under representative concentration pathway 4.5. Given that climate-mediated range shifts in the species are expected to be minor, conservation attention to this species can focus on minimizing local effects of anthropogenic activity
- …