3,077 research outputs found
Beyond Static Datasets: A Deep Interaction Approach to LLM Evaluation
Large Language Models (LLMs) have made progress in various real-world tasks,
which stimulates requirements for the evaluation of LLMs. Existing LLM
evaluation methods are mainly supervised signal-based which depends on static
datasets and cannot evaluate the ability of LLMs in dynamic real-world
scenarios where deep interaction widely exists. Other LLM evaluation methods
are human-based which are costly and time-consuming and are incapable of
large-scale evaluation of LLMs. To address the issues above, we propose a novel
Deep Interaction-based LLM-evaluation framework. In our proposed framework,
LLMs' performances in real-world domains can be evaluated from their deep
interaction with other LLMs in elaborately designed evaluation tasks.
Furthermore, our proposed framework is a general evaluation method that can be
applied to a host of real-world tasks such as machine translation and code
generation. We demonstrate the effectiveness of our proposed method through
extensive experiments on four elaborately designed evaluation tasks
Oscillation of second-order nonlinear delay differential equations with nonpositive neutral coefficients
Responsible Urban Intelligence: Towards a Research Agenda
Acceleration of urbanisation is posing great challenges to sustainable
development. Growing accessibility to big data and artificial intelligence (AI)
technologies have revolutionised many fields and offered great potential for
addressing pressing urban problems. However, using these technologies without
explicitly considering responsibilities would bring new societal and
environmental issues. To maximise the benefits of big data and AI while
minimising potential issues, we envisage a conceptual framework of Responsible
Urban Intelligence (RUI) and advocate an agenda for action. We first define RUI
as consisting of three major components including urban problems, enabling
technologies, and responsibilities; then introduce transparency, fairness, and
eco-friendliness as the three dimensions of responsibilities which naturally
link with the human, space, and time dimensions of cities; and further develop
a four-stage implementation framework for responsibilities as consisting of
solution design, data preparation, model building, and practical application;
and finally present a research agenda for RUI addressing challenging issues
including data and model transparency, tension between performance and
fairness, and solving urban problems in an eco-friendly manner
Transformation Optics Approach to Plasmon-Exciton Strong Coupling in Nanocavities
We investigate the conditions yielding plasmon-exciton strong coupling at the
single emitter level in the gap between two metal nanoparticles. A
quasi-analytical transformation optics approach is developed that makes
possible a thorough exploration of this hybrid system incorporating the full
richness of its plasmonic spectrum. This allows us to reveal that by placing
the emitter away from the cavity center, its coupling to multipolar dark modes
of both even and odd parity increases remarkably. This way, reversible dynamics
in the population of the quantum emitter takes place in feasible
implementations of this archetypal nanocavity.Comment: 5 pages, 4 figure
Estimates on the isospin-violating decays and the mixing
We analyse the two purely isospin-violating decays and , proceed merely via
the exchange topologies, in the framework of perturbative QCD approach.
Assuming baryon belongs to the idealized isospin triplet with quark
components of , the branching ratios of the two decay modes are predicted
to be tiny, of the order , leading to a difficulty in
observing them. We then extend our study to include the
mixing.It is found that the mixing has significant effect on the
decays, especially it can greatly increase the
rate of the process, by as much as two orders of magnitude, yield
, which should be searchable in the future. We also estimate a set of
asymmetry observables with and without the mixing effect, which will be tested
in coming experiments.Comment: 23 pages, 1 figure, 10 tables; to appear in PR
Progress on Modified Polyurethane for Preservation of Paper Cultural Relic
Paper cultural relics have extremely high value in research and collection. However, as the time goes on and the environment changes, there will be unfavorable conditions on paper relics, like yellowing, moulding, chalking, aging and embrittlement to some extent. Nowadays, the protection and repair of paper cultural relics are the research emphasis in the field of relics protection. The modified Polyurethane (PU) is an effective material for protecting paper cultural relics and overcome the disadvantages of traditional PU material, including poor polar-solvent resistance and poor heat resistance. Therefore, in this article, the synthesis, properties, applications of modified PU material were summarized and prospects for the research development in the future were look forward
- …