257 research outputs found
Glioma Diagnosis Aid through CNNs and Fuzzy-C Means for MRI
Glioma is a type of brain tumor that causes mortality in many cases. Early diagnosis is an important factor.
Typically, it is detected through MRI and then either a treatment is applied, or it is removed through surgery.
Deep-learning techniques are becoming popular in medical applications and image-based diagnosis.
Convolutional Neural Networks are the preferred architecture for object detection and classification in images.
In this paper, we present a study to evaluate the efficiency of using CNNs for diagnosis aids in glioma
detection and the improvement of the method when using a clustering method (Fuzzy C-means) for preprocessing
the input MRI dataset. Results offered an accuracy improvement from 0.77 to 0.81 when using
Fuzzy C-Means.Ministerio de Economía y Competitividad TEC2016-77785-
Small steps and giant leaps: Minimal Newton solvers for Deep Learning
We propose a fast second-order method that can be used as a drop-in
replacement for current deep learning solvers. Compared to stochastic gradient
descent (SGD), it only requires two additional forward-mode automatic
differentiation operations per iteration, which has a computational cost
comparable to two standard forward passes and is easy to implement. Our method
addresses long-standing issues with current second-order solvers, which invert
an approximate Hessian matrix every iteration exactly or by conjugate-gradient
methods, a procedure that is both costly and sensitive to noise. Instead, we
propose to keep a single estimate of the gradient projected by the inverse
Hessian matrix, and update it once per iteration. This estimate has the same
size and is similar to the momentum variable that is commonly used in SGD. No
estimate of the Hessian is maintained. We first validate our method, called
CurveBall, on small problems with known closed-form solutions (noisy Rosenbrock
function and degenerate 2-layer linear networks), where current deep learning
solvers seem to struggle. We then train several large models on CIFAR and
ImageNet, including ResNet and VGG-f networks, where we demonstrate faster
convergence with no hyperparameter tuning. Code is available
- …