Feature Fusion for Online Mutual Knowledge Distillation

We propose a learning framework named Feature Fusion Learning (FFL) that efficiently trains a powerful classifier through a fusion module which combines the feature maps generated from parallel neural networks. Specifically, we train a number of parallel neural networks as sub-networks, then we combine the feature maps from each sub-network using a fusion module to create a more meaningful feature map. The fused feature map is passed into the fused classifier for overall classification. Unlike existing feature fusion methods, in our framework, an ensemble of sub-network classifiers transfers its knowledge to the fused classifier and then the fused classifier delivers its knowledge back to each sub-network, mutually teaching one another in an online-knowledge distillation manner. This mutually teaching system not only improves the performance of the fused classifier but also obtains performance gain in each sub-network. Moreover, our model is more beneficial because different types of network can be used for each sub-network. We have performed a variety of experiments on multiple datasets such as CIFAR-10, CIFAR-100 and ImageNet and proved that our method is more effective than other alternative methods in terms of performance of both sub-networks and the fused classifier.Comment: International Conference on Pattern Recognitio

Effect of current step-down on the growth and hardness of PEO coatings on Al6061 alloy

AbstractIn this study, plasma electrolytic oxidation (PEO) treatments were conducted on Al6061 plates using silicate containing alkaline electrolyte. The hardness variation with the growth of the PEO coating was investigated under two different regimes of applied AC current. The first was a continuous supply with a constant current density of 500mA/cm2 for 60 or 90min. The other was a current supply of 500mA/cm2 for 60min followed by a current step-down to 200mA/cm2 and continuous treatment for 30min. In the case of a constant current for 60min, the coating thickness and Vickers hardness increased to 150μm and 1300 Hv, respectively. With further processing in the same manner, the coating grew thicker while its hardness gradually decreased to 900 Hv. In the case of a current step-down, no significant thickness increase was observed, but there was a hardness increase up to 1800 Hv. Analysis of the PEO coatings by SEM/EDS and XRD revealed that all their function layers were comprised mainly of α-Al2O3 with hardness dependent on density. The current step-down method contributes to the densification of the function layer in a PEO coating, and thus increases the hardness

Effect of a Er, Cr:YSGG laser and a Er:YAG laser treatment on oral biofilm-contaminated titanium

Implant surface decontamination is a challenging procedure for therapy of peri-implant disease. Objective: This study aimed to compare the effectiveness of decontamination on oral biofilm-contaminated titanium surfaces in Er:YAG laser, Er, Cr:YSGG laser, and plastic curette. Methodology: For oral biofilms formation, six participants wore an acrylic splint with eight titanium discs in the maxillary arch for 72 hours. A total of 48 contaminated discs were distributed among four groups: untreated control; decontamination with plastic curettes; Er, Cr:YSGG laser; and Er:YAG laser irradiation. Complete plaque removal was estimated using naked-eye and the time taken was recorded; the residual plaque area was measured and the morphological alteration of the specimen surface was observed by scanning electron microscopy. The total bacterial load and the viability of adherent bacteria were quantified by live or dead cell labeling with fluorescence microscopy. Results: The mean treatment time significantly decreased based on the treatment used in the following order: Er:YAG, Er, Cr:YSGG laser, and plastic curettes (234.9±25.4 sec, 156.1±12.7 sec, and 126.4±18.6 sec, P=0.000). The mean RPA in the Er, Cr:YSGG laser group (7.0±2.5%) was lower than Er:YAG and plastic curettes groups (10.3±2.4%, 12.3±3.6%, p=0.023). The viable bacteria on the titanium surface after Er, Cr:YSGG laser irradiation was significantly lower compared to the decontamination with plastic curette (P=0.05) but it was not significantly different from the Er:YAG laser irradiation. Conclusion: We found that Er:YAG laser and Er, Cr:YSGG laser irradiation were effective methods for decontaminations without surface alterations