Knowledge-Augmented Language Model Verification

Recent Language Models (LMs) have shown impressive capabilities in generating texts with the knowledge internalized in parameters. Yet, LMs often generate the factually incorrect responses to the given queries, since their knowledge may be inaccurate, incomplete, and outdated. To address this problem, previous works propose to augment LMs with the knowledge retrieved from an external knowledge source. However, such approaches often show suboptimal text generation performance due to two reasons: 1) the model may fail to retrieve the knowledge relevant to the given query, or 2) the model may not faithfully reflect the retrieved knowledge in the generated text. To overcome these, we propose to verify the output and the knowledge of the knowledge-augmented LMs with a separate verifier, which is a small LM that is trained to detect those two types of errors through instruction-finetuning. Then, when the verifier recognizes an error, we can rectify it by either retrieving new knowledge or generating new text. Further, we use an ensemble of the outputs from different instructions with a single verifier to enhance the reliability of the verification processes. We validate the effectiveness of the proposed verification steps on multiple question answering benchmarks, whose results show that the proposed verifier effectively identifies retrieval and generation errors, allowing LMs to provide more factually correct outputs. Our code is available at https://github.com/JinheonBaek/KALMV.Comment: EMNLP 202

Direct Probing of Oxygen Loss from the Surface Lattice of Correlated Oxides during Hydrogen Spillover

Hydrogen spillover is a catalytic process that occurs by surface reaction and subsequent diffusion to reversibly provide a massive amount of hydrogen dopants in correlated oxides, but the mechanism at the surface of correlated oxides with metal catalyst are not well understood. Here we show that a significant amount of oxygen is released from the surface of correlated VO2 films during hydrogen spillover, contrary to the well-established observation of the formation of hydrogen interstitials in the bulk part of VO2 films. By using ambient-pressure X-ray photoelectron spectroscopy, we prove that the formation of surface oxygen vacancies is a consequence of a favorable reaction for the generation of weakly adsorbed H2O from surface O atoms that have low coordination and weak binding strength. Our results reveal the importance of in situ characterization to prove the dynamic change during redox reaction and present an opportunity to control intrinsic defects at the surface.11Nsciescopu

Heterogeneous integration of single-crystalline rutile nanomembranes with steep phase transition on silicon substrates

Unrestricted integration of single-crystal oxide films on arbitrary substrates has been of great interest to exploit emerging phenomena from transition metal oxides for practical applications. Here, we demonstrate the release and transfer of a freestanding single-crystalline rutile oxide nanomembranes to serve as an epitaxial template for heterogeneous integration of correlated oxides on dissimilar substrates. By selective oxidation and dissolution of sacrificial VO2 buffer layers from TiO2/VO2/TiO2 by H2O2, millimeter-size TiO2 single-crystalline layers are integrated on silicon without any deterioration. After subsequent VO2 epitaxial growth on the transferred TiO2 nanomembranes, we create artificial single-crystalline oxide/Si heterostructures with excellent sharpness of metal-insulator transition (Delta rho/rho > 10(3)) even in ultrathin (<10 nm) VO2 films that are not achievable via direct growth on Si. This discovery offers a synthetic strategy to release the new single-crystalline oxide nanomembranes and an integration scheme to exploit emergent functionality from epitaxial oxide heterostructures in mature silicon devices.11Nsciescopu