1,174 research outputs found
A Comparative Study on Regularization Strategies for Embedding-based Neural Networks
This paper aims to compare different regularization strategies to address a
common phenomenon, severe overfitting, in embedding-based neural networks for
NLP. We chose two widely studied neural models and tasks as our testbed. We
tried several frequently applied or newly proposed regularization strategies,
including penalizing weights (embeddings excluded), penalizing embeddings,
re-embedding words, and dropout. We also emphasized on incremental
hyperparameter tuning, and combining different regularizations. The results
provide a picture on tuning hyperparameters for neural NLP models.Comment: EMNLP '1
Interfacial Properties of Bilayer and Trilayer Graphene on Metal Substrates
One popular approach to prepare graphene is to grow them on transition metal
substrates via chemical vapor deposition. By using the density functional
theory with dispersion correction, we systematically investigate for the first
time the interfacial properties of bilayer (BLG) and trilayer graphene (TLG) on
metal substrates. Three categories of interfacial structures are revealed. The
adsorption of B(T)LG on Al, Ag, Cu, Au, and Pt substrates is a weak
physisorption, but a band gap can be opened. The adsorption of B(T)LG on Ti,
Ni, and Co substrates is a strong chemisorption, and a stacking-insensitive
band gap is opened for the two uncontacted layers of TLG. The adsorption of
B(T)LG on Pd substrate is a weaker chemisorption, with a band gap opened for
the uncontacted layers. This fundamental study also helps for B(T)LG device
study due to inevitable graphene/metal contact.Comment: 1 table, 8 figure
Does the Dirac Cone Exist in Silicene on Metal Substrates?
Absence of the Dirac cone due to a strong band hybridization is revealed to
be a common feature for epitaxial silicene on metal substrates according to our
first-principles calculations for silicene on Ir, Cu, Mg, Au, Pt, Al, and Ag
substrates. The destroyed Dirac cone of silicene, however, can be effectively
restored with linear or parabolic dispersion by intercalating alkali metal
atoms between silicene and the metal substrates, offering an opportunity to
study the intriguing properties of silicene without further transfer of
silicene from the metal substrates
- …