Bag of Tricks for In-Distribution Calibration of Pretrained Transformers

While pre-trained language models (PLMs) have become a de-facto standard promoting the accuracy of text classification tasks, recent studies find that PLMs often predict over-confidently. Although various calibration methods have been proposed, such as ensemble learning and data augmentation, most of the methods have been verified in computer vision benchmarks rather than in PLM-based text classification tasks. In this paper, we present an empirical study on confidence calibration for PLMs, addressing three categories, including confidence penalty losses, data augmentations, and ensemble methods. We find that the ensemble model overfitted to the training set shows sub-par calibration performance and also observe that PLMs trained with confidence penalty loss have a trade-off between calibration and accuracy. Building on these observations, we propose the Calibrated PLM (CALL), a combination of calibration techniques. The CALL complements the drawbacks that may occur when utilizing a calibration method individually and boosts both classification and calibration accuracy. Design choices in CALL's training procedures are extensively studied, and we provide a detailed analysis of how calibration techniques affect the calibration performance of PLMs

Validation Study of Kim's Sham Needle by Measuring Facial Temperature: An N-of-1 Randomized Double-Blind Placebo-Controlled Clinical Trial

Introduction. In 2008, Kim's sham needle was developed to improve the quality of double-blinded studies. The aim of this study is to validate Kim's sham needle by measuring facial temperature. Methods. We designed “N-of-1” trials involving 7 smokers. One session was composed of 2 stimulations separated by a 2 h washout period. Six sessions were applied daily for all subjects. Infrared thermal imaging was used to examine the effects of acupuncture (HT8, KI2) on facial temperature following smoking-induced decrease. Results. All subjects demonstrated decreased temperatures after sham needle treatment, but 5 of the 7 subjects showed increased temperatures after real needle treatment. 6 of the 7 subjects showed a significant difference (P < 0.05) between treatments with real and sham needles. Thus, the physiological stimulation of Kim's sham needle is different from that of a real needle, suggesting that Kim's sham needle is a potential inactive control intervention

Schottky Barrier Modulation of Metal/4H-SiC Junction with Thin Interface Spacer Driven by Surface Polarization Charge on 4H-SiC Substrate

The Au/Ni/Al2O3/4H-SiC junction with the Al2O3 film as a thin spacer layer was found to show the electrical characteristics of a typical rectifying Schottky contact, which is considered to be due to the leakiness of the spacer layer. The Schottky barrier of the junction was measured to be higher than an Au/Ni/4H-SiC junction with no spacer layer. It is believed that the negative surface bound charge originating from the spontaneous polarization of 4H-SiC causes the Schottky barrier increase. The use of a thin spacer layer can be an efficient experimental method to modulate Schottky barriers of metal/4H-SiC junctions.open

SAO-based semantic mining of patents for semi-automatic construction of a customer job map

The Outcome-Driven Innovation (ODI) method based on the &apos;Jobs-to-be-done&apos; concept is very useful in the identification of unmet customer needs and has been adopted widely in the industry. The Job Map, a tool of the ODI method, is used to understand customers by defining their behavioral process. Complications must be overcome before the Job Map can be applied to the specific problem in question, such as a time-consuming process, dealing with a large amount of data, and experts&apos; biased work. To solve these problems, this study develops a patent mining-based method based on the subject-action-object (SAO) structure to support the creation of a Job Map by semi-automatizing data collection and analysis. This effort at better utilizing computers in customer analysis for product design will contribute to expanding computerized methods for solving design and engineering problems in practice