Knowledge Corpus Error in Question Answering

Recent works in open-domain question answering (QA) have explored generating context passages from large language models (LLMs), replacing the traditional retrieval step in the QA pipeline. However, it is not well understood why generated passages can be more effective than retrieved ones. This study revisits the conventional formulation of QA and introduces the concept of knowledge corpus error. This error arises when the knowledge corpus used for retrieval is only a subset of the entire string space, potentially excluding more helpful passages that exist outside the corpus. LLMs may mitigate this shortcoming by generating passages in a larger space. We come up with an experiment of paraphrasing human-annotated gold context using LLMs to observe knowledge corpus error empirically. Our results across three QA benchmarks reveal an increased performance (10% - 13%) when using paraphrased passage, indicating a signal for the existence of knowledge corpus error. Our code is available at https://github.com/xfactlab/emnlp2023-knowledge-corpus-errorComment: Findings of EMNLP 202

A Novel, Automated, and Real-Time Method for the Analysis of Non-Human Primate Behavioral Patterns Using a Depth Image Sensor

By virtue of their upright locomotion, similar to that of humans, motion analysis of non-human primates has been widely used in order to better understand musculoskeletal biomechanics and neuroscience problems. Given the difficulty of conducting a marker-based infrared optical tracking system for the behavior analysis of primates, a 2-dimensional (D) video analysis has been applied. Distinct from a conventional marker-based optical tracking system, a depth image sensor system provides 3-D information on movement without any skin markers. The specific aim of this study was to develop a novel algorithm to analyze the behavioral patterns of non-human primates in a home cage using a depth image sensor. The behavioral patterns of nine monkeys in their home cage, including sitting, standing, and pacing, were captured using a depth image sensor. Thereafter, these were analyzed by observers’ manual assessment and the newly written automated program. We confirmed that the measurement results from the observers’ manual assessments and the automated program with depth image analysis were statistically identical

A Novel, Automated, and Real-Time Method for the Analysis of Non-Human Primate Behavioral Patterns Using a Depth Image Sensor

By virtue of their upright locomotion, similar to that of humans, motion analysis of non-human primates has been widely used in order to better understand musculoskeletal biomechanics and neuroscience problems. Given the difficulty of conducting a marker-based infrared optical tracking system for the behavior analysis of primates, a 2-dimensional (D) video analysis has been applied. Distinct from a conventional marker-based optical tracking system, a depth image sensor system provides 3-D information on movement without any skin markers. The specific aim of this study was to develop a novel algorithm to analyze the behavioral patterns of non-human primates in a home cage using a depth image sensor. The behavioral patterns of nine monkeys in their home cage, including sitting, standing, and pacing, were captured using a depth image sensor. Thereafter, these were analyzed by observers’ manual assessment and the newly written automated program. We confirmed that the measurement results from the observers’ manual assessments and the automated program with depth image analysis were statistically identical

Organometal Halide Perovskite-Based Photoelectrochemical Module Systems for Scalable Unassisted Solar Water Splitting.

Despite achievements in the remarkable photoelectrochemical (PEC) performance of photoelectrodes based on organometal halide perovskites (OHPs), the scaling up of small-scale OHP-based PEC systems to large-scale systems remains a great challenge for their practical application in solar water splitting. Significant resistive losses and intrinsic defects are major obstacles to the scaling up of OHP-based PEC systems, leading to the PEC performance degradation of large-scale OHP photoelectrodes. Herein, a scalable design of the OHP-based PEC systems by modularization of the optimized OHP photoelectrodes exhibiting a high solar-to-hydrogen conversion efficiency of 10.4% is suggested. As a proof-of-concept, the OHP-based PEC module achieves an optimal PEC performance by avoiding major obstacles in the scaling up of the OHP photoelectrodes. The constructed OHP module is composed of a total of 16 OHP photoelectrodes, and a photocurrent of 11.52 mA is achieved under natural sunlight without external bias. The successful operation of unassisted solar water splitting using the OHP module without external bias can provide insights into the design of scalable OHP-based PEC systems for future practical application and commercialization