168 research outputs found
MedEdit: Model Editing for Medical Question Answering with External Knowledge Bases
Large Language Models (LLMs), although powerful in general domains, often
perform poorly on domain-specific tasks like medical question answering (QA).
Moreover, they tend to function as "black-boxes," making it challenging to
modify their behavior. Addressing this, our study delves into model editing
utilizing in-context learning, aiming to improve LLM responses without the need
for fine-tuning or retraining. Specifically, we propose a comprehensive
retrieval strategy to extract medical facts from an external knowledge base,
and then we incorporate them into the query prompt for the LLM. Focusing on
medical QA using the MedQA-SMILE dataset, we evaluate the impact of different
retrieval models and the number of facts provided to the LLM. Notably, our
edited Vicuna model exhibited an accuracy improvement from 44.46% to 48.54%.
This work underscores the potential of model editing to enhance LLM
performance, offering a practical approach to mitigate the challenges of
black-box LLMs.Comment: 6 page
Vernier Ring Based Pre-bond Through Silicon Vias Test in 3D ICs
Defects in TSV will lead to variations in the propagation delay of the net connected to the faulty TSV. A non-invasive Vernier Ring based method for TSV pre-bond testing is proposed to detect resistive open and leakage faults. TSVs are used as capacitive loads of their driving gates, then time interval compared with the fault-free TSVs will be detected. The time interval can be detected with picosecond level resolution, and digitized into a digital code to compare with an expected value of fault-free. Experiments on fault detection are presented through HSPICE simulations using realistic models for a 45 nm CMOS technology. The results show the effectiveness in the detection of time interval 10 ps, resistive open defects 0.2 kΩ above and equivalent leakage resistance less than 18 MΩ. Compared with existing methods, detection precision, area overhead, and test time are effectively improved, furthermore, the fault degree can be digitalized into digital code
Coupling Artificial Neurons in BERT and Biological Neurons in the Human Brain
Linking computational natural language processing (NLP) models and neural
responses to language in the human brain on the one hand facilitates the effort
towards disentangling the neural representations underpinning language
perception, on the other hand provides neurolinguistics evidence to evaluate
and improve NLP models. Mappings of an NLP model's representations of and the
brain activities evoked by linguistic input are typically deployed to reveal
this symbiosis. However, two critical problems limit its advancement: 1) The
model's representations (artificial neurons, ANs) rely on layer-level
embeddings and thus lack fine-granularity; 2) The brain activities (biological
neurons, BNs) are limited to neural recordings of isolated cortical unit (i.e.,
voxel/region) and thus lack integrations and interactions among brain
functions. To address those problems, in this study, we 1) define ANs with
fine-granularity in transformer-based NLP models (BERT in this study) and
measure their temporal activations to input text sequences; 2) define BNs as
functional brain networks (FBNs) extracted from functional magnetic resonance
imaging (fMRI) data to capture functional interactions in the brain; 3) couple
ANs and BNs by maximizing the synchronization of their temporal activations.
Our experimental results demonstrate 1) The activations of ANs and BNs are
significantly synchronized; 2) the ANs carry meaningful linguistic/semantic
information and anchor to their BN signatures; 3) the anchored BNs are
interpretable in a neurolinguistic context. Overall, our study introduces a
novel, general, and effective framework to link transformer-based NLP models
and neural activities in response to language and may provide novel insights
for future studies such as brain-inspired evaluation and development of NLP
models
Recommended from our members
Integrated molecular diode as 10 MHz half-wave rectifier based on an organic nanostructure heterojunction
Considerable efforts have been made to realize nanoscale diodes based on single molecules or molecular ensembles for implementing the concept of molecular electronics. However, so far, functional molecular diodes have only been demonstrated in the very low alternating current frequency regime, which is partially due to their extremely low conductance and the poor degree of device integration. Here, we report about fully integrated rectifiers with microtubular soft-contacts, which are based on a molecularly thin organic heterojunction and are able to convert alternating current with a frequency of up to 10 MHz. The unidirectional current behavior of our devices originates mainly from the intrinsically different surfaces of the bottom planar and top microtubular Au electrodes while the excellent high frequency response benefits from the charge accumulation in the phthalocyanine molecular heterojunction, which not only improves the charge injection but also increases the carrier density
Burst phase distribution of SGR J1935+2154 based on Insight-HXMT
On April 27, 2020, the soft gamma ray repeater SGR J1935+2154 entered its
intense outburst episode again. Insight-HXMT carried out about one month
observation of the source. A total number of 75 bursts were detected during
this activity episode by Insight-HXMT, and persistent emission data were also
accumulated. We report on the spin period search result and the phase
distribution of burst start times and burst photon arrival times of the
Insight-HXMT high energy detectors and Fermi Gamma-ray Burst Monitor (GBM). We
find that the distribution of burst start times is uniform within its spin
phase for both Insight-HXMT and Fermi-GBM observations, whereas the phase
distribution of burst photons is related to the type of a burst's energy
spectrum. The bursts with the same spectrum have different distribution
characteristics in the initial and decay episodes for the activity of magnetar
SGR J1935+2154.Comment: 12 pages, 9 figure
AGI for Agriculture
Artificial General Intelligence (AGI) is poised to revolutionize a variety of
sectors, including healthcare, finance, transportation, and education. Within
healthcare, AGI is being utilized to analyze clinical medical notes, recognize
patterns in patient data, and aid in patient management. Agriculture is another
critical sector that impacts the lives of individuals worldwide. It serves as a
foundation for providing food, fiber, and fuel, yet faces several challenges,
such as climate change, soil degradation, water scarcity, and food security.
AGI has the potential to tackle these issues by enhancing crop yields, reducing
waste, and promoting sustainable farming practices. It can also help farmers
make informed decisions by leveraging real-time data, leading to more efficient
and effective farm management. This paper delves into the potential future
applications of AGI in agriculture, such as agriculture image processing,
natural language processing (NLP), robotics, knowledge graphs, and
infrastructure, and their impact on precision livestock and precision crops. By
leveraging the power of AGI, these emerging technologies can provide farmers
with actionable insights, allowing for optimized decision-making and increased
productivity. The transformative potential of AGI in agriculture is vast, and
this paper aims to highlight its potential to revolutionize the industry
Limitations and Challenges of the Application of Phages in the Field of Microbial Food Safety
In recent years, an increasing number of studies have demonstrated the role of phages in controlling harmful microorganisms in foods. Due to their host specificity, phages are considered as an ideal tool to guarantee food safety. However, there are a series of limitations to the application of phages, so there have been few cases of the application of phages in the food industry. In this context, this paper discusses the frontier and hot issues in the application of phages in food safety, with a focus on the acceptability of the application of phages in the food industry, the potential risk of drug resistance transmission, the problem of phage resistance of bacteria, and the influence of complex food matrices on the effect of phages. Moreover, scientific and reasonable suggestions on the application of phages in the food industry are put forward. We hope that this review will promote the shift from basic research on phages to their application in the food industry
- …