Beyond Static Datasets: A Deep Interaction Approach to LLM Evaluation

Large Language Models (LLMs) have made progress in various real-world tasks, which stimulates requirements for the evaluation of LLMs. Existing LLM evaluation methods are mainly supervised signal-based which depends on static datasets and cannot evaluate the ability of LLMs in dynamic real-world scenarios where deep interaction widely exists. Other LLM evaluation methods are human-based which are costly and time-consuming and are incapable of large-scale evaluation of LLMs. To address the issues above, we propose a novel Deep Interaction-based LLM-evaluation framework. In our proposed framework, LLMs' performances in real-world domains can be evaluated from their deep interaction with other LLMs in elaborately designed evaluation tasks. Furthermore, our proposed framework is a general evaluation method that can be applied to a host of real-world tasks such as machine translation and code generation. We demonstrate the effectiveness of our proposed method through extensive experiments on four elaborately designed evaluation tasks

Responsible Urban Intelligence: Towards a Research Agenda

Acceleration of urbanisation is posing great challenges to sustainable development. Growing accessibility to big data and artificial intelligence (AI) technologies have revolutionised many fields and offered great potential for addressing pressing urban problems. However, using these technologies without explicitly considering responsibilities would bring new societal and environmental issues. To maximise the benefits of big data and AI while minimising potential issues, we envisage a conceptual framework of Responsible Urban Intelligence (RUI) and advocate an agenda for action. We first define RUI as consisting of three major components including urban problems, enabling technologies, and responsibilities; then introduce transparency, fairness, and eco-friendliness as the three dimensions of responsibilities which naturally link with the human, space, and time dimensions of cities; and further develop a four-stage implementation framework for responsibilities as consisting of solution design, data preparation, model building, and practical application; and finally present a research agenda for RUI addressing challenging issues including data and model transparency, tension between performance and fairness, and solving urban problems in an eco-friendly manner

Transformation Optics Approach to Plasmon-Exciton Strong Coupling in Nanocavities

We investigate the conditions yielding plasmon-exciton strong coupling at the single emitter level in the gap between two metal nanoparticles. A quasi-analytical transformation optics approach is developed that makes possible a thorough exploration of this hybrid system incorporating the full richness of its plasmonic spectrum. This allows us to reveal that by placing the emitter away from the cavity center, its coupling to multipolar dark modes of both even and odd parity increases remarkably. This way, reversible dynamics in the population of the quantum emitter takes place in feasible implementations of this archetypal nanocavity.Comment: 5 pages, 4 figure

Estimates on the isospin-violating Λb→Σ0ϕ,Σ0J/ψ\Lambda_b\rightarrow \Sigma^0 \phi, \Sigma^0 J/\psi decays and the Σ−Λ\Sigma-\Lambda mixing

We analyse the two purely isospin-violating decays $\Lambda_b\rightarrow \Sigma^0 \phi$ and $\Lambda_b\rightarrow \Sigma^0 J/\psi$, proceed merely via the exchange topologies, in the framework of perturbative QCD approach. Assuming $\Sigma^0$ baryon belongs to the idealized isospin triplet with quark components of $usd$, the branching ratios of the two decay modes are predicted to be tiny, of the order $10^{-8}-10^{-9}$, leading to a difficulty in observing them. We then extend our study to include the $\Sigma-\Lambda$ mixing.It is found that the mixing has significant effect on the $\Lambda_b\rightarrow \Sigma$ decays, especially it can greatly increase the rate of the $J/\psi$ process, by as much as two orders of magnitude, yield $10^{-7}$, which should be searchable in the future. We also estimate a set of asymmetry observables with and without the mixing effect, which will be tested in coming experiments.Comment: 23 pages, 1 figure, 10 tables; to appear in PR

Asymptotic Properties of Solutions to Third-Order Nonlinear Neutral Differential Equations

The aim of this work is to discuss asymptotic properties of a class of third-order nonlinear neutral functional differential equations. The results obtained extend and improve some related known results. Two examples are given to illustrate the main results