Data-free parameter pruning for Deep Neural Networks

Deep Neural nets (NNs) with millions of parameters are at the heart of many state-of-the-art computer vision systems today. However, recent works have shown that much smaller models can achieve similar levels of performance. In this work, we address the problem of pruning parameters in a trained NN model. Instead of removing individual weights one at a time as done in previous works, we remove one neuron at a time. We show how similar neurons are redundant, and propose a systematic way to remove them. Our experiments in pruning the densely connected layers show that we can remove upto 85\% of the total parameters in an MNIST-trained network, and about 35\% for AlexNet without significantly affecting performance. Our method can be applied on top of most networks with a fully connected layer to give a smaller network.Comment: BMVC 201

Laparoscopy Pneumoperitoneum Fuzzy Modeling

Abstract: Gas volume to intra-peritoneal pressure fuzzy modeling for evaluating pneumoperitoneum in videolaparoscopic surgery is proposed in this paper. The proposed approach innovates in using fuzzy logic and fuzzy set theory for evaluating the accuracy of the prognosis value in order to minimize or avoid iatrogenic injuries due to the blind needle puncture. In so doing, it demonstrates the feasibility of fuzzy analysis to contribute to medicine and health care. Fuzzy systems is employed here in synergy with artificial neural network based on backpropaga tion, multilayer perceptron architecture for building up numerical functions. Experimental data employed for analysis were collected in the accomplishment of the pneumoperitoneum in a random population of patients submitted to videolaparoscopic surgeries. Numerical results indicate that the proposed fuzzy mapping for describing the relation from the intra peritoneal pressure measures as function injected gas volumes succeeded in determinining a fuzzy model for this nonlinear system when compared to the statistical model