Unifying and Merging Well-trained Deep Neural Networks for Inference Stage

We propose a novel method to merge convolutional neural-nets for the inference stage. Given two well-trained networks that may have different architectures that handle different tasks, our method aligns the layers of the original networks and merges them into a unified model by sharing the representative codes of weights. The shared weights are further re-trained to fine-tune the performance of the merged model. The proposed method effectively produces a compact model that may run original tasks simultaneously on resource-limited devices. As it preserves the general architectures and leverages the co-used weights of well-trained networks, a substantial training overhead can be reduced to shorten the system development time. Experimental results demonstrate a satisfactory performance and validate the effectiveness of the method.Comment: To appear in the 27th International Joint Conference on Artificial Intelligence and the 23rd European Conference on Artificial Intelligence, 2018. (IJCAI-ECAI 2018

Structural study in Highly Compressed BiFeO3 Epitaxial Thin Films on YAlO3

We report a study on the thermodynamic stability and structure analysis of the epitaxial BiFeO3 (BFO) thin films grown on YAlO3 (YAO) substrate. First we observe a phase transition of MC-MA-T occurs in thin sample (<60 nm) with an utter tetragonal-like phase (denoted as MII here) with a large c/a ratio (~1.23). Specifically, MII phase transition process refers to the structural evolution from a monoclinic MC structure at room temperature to a monoclinic MA at higher temperature (150oC) and eventually to a presence of nearly tetragonal structure above 275oC. This phase transition is further confirmed by the piezoforce microscopy measurement, which shows the rotation of polarization axis during the phase transition. A systematic study on structural evolution with thickness to elucidate the impact of strain state is performed. We note that the YAO substrate can serve as a felicitous base for growing T-like BFO because this phase stably exists in very thick film. Thick BFO films grown on YAO substrate exhibit a typical "morphotropic-phase-boundary"-like feature with coexisting multiple phases (MII, MI, and R) and a periodic stripe-like topography. A discrepancy of arrayed stripe morphology in different direction on YAO substrate due to the anisotropic strain suggests a possibility to tune the MPB-like region. Our study provides more insights to understand the strain mediated phase co-existence in multiferroic BFO system.Comment: 18 pages, 6 figures, submitted to Journal of Applied Physic