A Comparative Study on Regularization Strategies for Embedding-based Neural Networks

This paper aims to compare different regularization strategies to address a common phenomenon, severe overfitting, in embedding-based neural networks for NLP. We chose two widely studied neural models and tasks as our testbed. We tried several frequently applied or newly proposed regularization strategies, including penalizing weights (embeddings excluded), penalizing embeddings, re-embedding words, and dropout. We also emphasized on incremental hyperparameter tuning, and combining different regularizations. The results provide a picture on tuning hyperparameters for neural NLP models.Comment: EMNLP '1

Interfacial Properties of Bilayer and Trilayer Graphene on Metal Substrates

One popular approach to prepare graphene is to grow them on transition metal substrates via chemical vapor deposition. By using the density functional theory with dispersion correction, we systematically investigate for the first time the interfacial properties of bilayer (BLG) and trilayer graphene (TLG) on metal substrates. Three categories of interfacial structures are revealed. The adsorption of B(T)LG on Al, Ag, Cu, Au, and Pt substrates is a weak physisorption, but a band gap can be opened. The adsorption of B(T)LG on Ti, Ni, and Co substrates is a strong chemisorption, and a stacking-insensitive band gap is opened for the two uncontacted layers of TLG. The adsorption of B(T)LG on Pd substrate is a weaker chemisorption, with a band gap opened for the uncontacted layers. This fundamental study also helps for B(T)LG device study due to inevitable graphene/metal contact.Comment: 1 table, 8 figure

Does the Dirac Cone Exist in Silicene on Metal Substrates?

Absence of the Dirac cone due to a strong band hybridization is revealed to be a common feature for epitaxial silicene on metal substrates according to our first-principles calculations for silicene on Ir, Cu, Mg, Au, Pt, Al, and Ag substrates. The destroyed Dirac cone of silicene, however, can be effectively restored with linear or parabolic dispersion by intercalating alkali metal atoms between silicene and the metal substrates, offering an opportunity to study the intriguing properties of silicene without further transfer of silicene from the metal substrates