3,659 research outputs found
Out-of-Distribution Detection of Melanoma using Normalizing Flows
Generative modelling has been a topic at the forefront of machine learning
research for a substantial amount of time. With the recent success in the field
of machine learning, especially in deep learning, there has been an increased
interest in explainable and interpretable machine learning. The ability to
model distributions and provide insight in the density estimation and exact
data likelihood is an example of such a feature. Normalizing Flows (NFs), a
relatively new research field of generative modelling, has received substantial
attention since it is able to do exactly this at a relatively low cost whilst
enabling competitive generative results. While the generative abilities of NFs
are typically explored, we focus on exploring the data distribution modelling
for Out-of-Distribution (OOD) detection. Using one of the state-of-the-art NF
models, GLOW, we attempt to detect OOD examples in the ISIC dataset. We notice
that this model under performs in conform related research. To improve the OOD
detection, we explore the masking methods to inhibit co-adaptation of the
coupling layers however find no substantial improvement. Furthermore, we
utilize Wavelet Flow which uses wavelets that can filter particular frequency
components, thus simplifying the modeling process to data-driven conditional
wavelet coefficients instead of complete images. This enables us to efficiently
model larger resolution images in the hopes that it would capture more relevant
features for OOD. The paper that introduced Wavelet Flow mainly focuses on its
ability of sampling high resolution images and did not treat OOD detection. We
present the results and propose several ideas for improvement such as
controlling frequency components, using different wavelets and using other
state-of-the-art NF architectures
Generative Adversarial Networks (GANs): Challenges, Solutions, and Future Directions
Generative Adversarial Networks (GANs) is a novel class of deep generative
models which has recently gained significant attention. GANs learns complex and
high-dimensional distributions implicitly over images, audio, and data.
However, there exists major challenges in training of GANs, i.e., mode
collapse, non-convergence and instability, due to inappropriate design of
network architecture, use of objective function and selection of optimization
algorithm. Recently, to address these challenges, several solutions for better
design and optimization of GANs have been investigated based on techniques of
re-engineered network architectures, new objective functions and alternative
optimization algorithms. To the best of our knowledge, there is no existing
survey that has particularly focused on broad and systematic developments of
these solutions. In this study, we perform a comprehensive survey of the
advancements in GANs design and optimization solutions proposed to handle GANs
challenges. We first identify key research issues within each design and
optimization technique and then propose a new taxonomy to structure solutions
by key research issues. In accordance with the taxonomy, we provide a detailed
discussion on different GANs variants proposed within each solution and their
relationships. Finally, based on the insights gained, we present the promising
research directions in this rapidly growing field.Comment: 42 pages, Figure 13, Table
- …