ASSISTGUI: Task-Oriented Desktop Graphical User Interface Automation

Graphical User Interface (GUI) automation holds significant promise for assisting users with complex tasks, thereby boosting human productivity. Existing works leveraging Large Language Model (LLM) or LLM-based AI agents have shown capabilities in automating tasks on Android and Web platforms. However, these tasks are primarily aimed at simple device usage and entertainment operations. This paper presents a novel benchmark, AssistGUI, to evaluate whether models are capable of manipulating the mouse and keyboard on the Windows platform in response to user-requested tasks. We carefully collected a set of 100 tasks from nine widely-used software applications, such as, After Effects and MS Word, each accompanied by the necessary project files for better evaluation. Moreover, we propose an advanced Actor-Critic Embodied Agent framework, which incorporates a sophisticated GUI parser driven by an LLM-agent and an enhanced reasoning mechanism adept at handling lengthy procedural tasks. Our experimental results reveal that our GUI Parser and Reasoning mechanism outshine existing methods in performance. Nevertheless, the potential remains substantial, with the best model attaining only a 46% success rate on our benchmark. We conclude with a thorough analysis of the current methods' limitations, setting the stage for future breakthroughs in this domain.Comment: Project Page: https://showlab.github.io/assistgui

Long- and short-range correlations and their event-scale dependence in high-multiplicity pp collisions at 1as = 13 TeV

Two-particle angular correlations are measured in high-multiplicity proton-proton collisions at s = 13 TeV by the ALICE Collaboration. The yields of particle pairs at short-( 06\u3b7 3c 0) and long-range (1.6 < | 06\u3b7| < 1.8) in pseudorapidity are extracted on the near-side ( 06\u3c6 3c 0). They are reported as a function of transverse momentum (pT) in the range 1 < pT< 4 GeV/c. Furthermore, the event-scale dependence is studied for the first time by requiring the presence of high-pT leading particles or jets for varying pT thresholds. The results demonstrate that the long-range \u201cridge\u201d yield, possibly related to the collective behavior of the system, is present in events with high-pT processes as well. The magnitudes of the short- and long-range yields are found to grow with the event scale. The results are compared to EPOS LHC and PYTHIA 8 calculations, with and without string-shoving interactions. It is found that while both models describe the qualitative trends in the data, calculations from EPOS LHC show a better quantitative agreement for the pT dependency, while overestimating the event-scale dependency. [Figure not available: see fulltext.

ϒ production in p–Pb collisions at √sNN=8.16 TeV

ϒ production in p–Pb interactions is studied at the centre-of-mass energy per nucleon–nucleon collision √sNN = 8.16 TeV with the ALICE detector at the CERN LHC. The measurement is performed reconstructing bottomonium resonances via their dimuon decay channel, in the centre-of-mass rapidity intervals 2.03 < ycms < 3.53 and −4.46 < ycms < −2.96, down to zero transverse momentum. In this work, results on the ϒ(1S) production cross section as a function of rapidity and transverse momentum are presented. The corresponding nuclear modification factor shows a suppression of the ϒ(1S) yields with respect to pp collisions, both at forward and backward rapidity. This suppression is stronger in the low transverse momentum region and shows no significant dependence on the centrality of the interactions. Furthermore, the ϒ(2S) nuclear modification factor is evaluated, suggesting a suppression similar to that of the ϒ(1S). A first measurement of the ϒ(3S) has also been performed. Finally, results are compared with previous ALICE measurements in p–Pb collisions at √sNN = 5.02 TeV and with theoretical calculations.publishedVersio

f0(980) production in inelastic pp collisions at s = 5.02 TeV

The measurement of the production of f0(980) in inelastic pp collisions at sqrt(s) = 5.02 TeV is presented. This is the first reported measurement of inclusive f0(980) yield at LHC energies. The production is measured at midrapidity, |y| pi+pi- hadronic decay channel using the ALICE detector. The pT-differential yields are compared to those of pions, protons and ϕ mesons as well as to predictions from the HERWIG 7.2 QCD-inspired Monte Carlo event generator and calculations from a coalescence model that uses the AMPT model as an input. The ratio of the pT-integrated yield of f0(980) relative to pions is compared to measurements in e+e- and pp collisions at lower energies and predictions from statistical hadronisation models and HERWIG 7.2. A mild collision energy dependence of the f0(980) to pion production is observed in pp collisions from SPS to LHC energies. All considered models underpredict the pT-integrated 2f0(980)/(pi+ + pi-) ratio. The prediction from the canonical statistical hadronisation model assuming a zero total strangeness content of f0(980) is consistent with the data within 1.9σ and is the closest to the data. The results provide an essential reference for future measurements of the particle yield and nuclear modification in p–Pb and Pb–Pb collisions, which have been proposed to be instrumental to probe the elusive nature and quark composition of the f0(980) scalar meson

Pion-kaon femtoscopy and the lifetime of the hadronic phase in Pb-Pb collisions at root(S)(NN)=2.76 TeV

In this paper, the first femtoscopic analysis of pion-kaon correlations at the LHC is reported. The analysis was performed on the Pb-Pb collision data at root(S)(NN) = 2.76 TeV recorded with the ALICE detector. The non-identical particle correlations probe the spatio-temporal separation between sources of different particle species as well as the average source size of the emitting system. The sizes of the pion and kaon sources increase with centrality, and pions are emitted closer to the centre of the system and/or later than kaons. This is naturally expected in a system with strong radial flow and is qualitatively reproduced by hydrodynamic models. ALICE data on pion-kaon emission asymmetry are consistent with (3+1)-dimensional viscous hydrodynamics coupled to a statistical hadronisation model, resonance propagation, and decay code THERMINATOR 2 calculation, with an additional time delay between 1 and 2 fm/c for kaons. The delay can be interpreted as evidence for a significant hadronic rescattering phase in heavy-ion collisions at the LHC. (C) 2020 The Author. Published by Elsevier B.V.Peer reviewe

Elliptic and triangular flow of (anti)deuterons in Pb-Pb collisions at sNN =5.02 TeV

The measurements of the (anti)deuteron elliptic flow (v2) and the first measurements of triangular flow (v3) in Pb-Pb collisions at a center-of-mass energy per nucleon-nucleon collision √sNN = 5.02 TeV are presented. A mass ordering at low transverse momentum (pT) is observed when comparing these measurements with those of other identified hadrons, as expected from relativistic hydrodynamics. The measured (anti)deuteron v2 lies between the predictions from the simple coalescence and blast-wave models, which provide a good description of the data only for more peripheral and for more central collisions, respectively. The mass number scaling, which is violated for v2, is approximately valid for the (anti)deuterons v3. The measured v2 and v3 are also compared with the predictions from a coalescence approach with phase-space distributions of nucleons generated by IEBEVISHNU with AMPT initial conditions coupled with URQMD, and from a dynamical model based on relativistic hydrodynamics coupled to the hadronic afterburner SMASH. The model predictions are consistent with the data within the uncertainties in midcentral collisions, while a deviation is observed in the most central collisions

Neutral to charged kaon yield fluctuations in Pb – Pb collisions at sNN=2.76 TeV

We present the first measurement of event-by-event fluctuations in the kaon sector in Pb – Pb collisions at √sNN = 2.76 TeV with the ALICE detector at the LHC. The robust fluctuation correlator νdyn is used to evaluate the magnitude of fluctuations of the relative yields of neutral and charged kaons, as well as the relative yields of charged kaons, as a function of collision centrality and selected kinematic ranges. While the correlator νdyn[K+, K− ] exhibits a scaling approximately in inverse proportion of the charged particle multiplicity, νdyn[K0 S , K± ] features a significant deviation from such scaling. Within uncertainties, the value of νdyn[K0S , K± ] is independent of the selected transverse momentum interval, while it exhibits a pseudorapidity dependence. The results are compared with HIJING, AMPT and EPOS–LHC predictions, and are further discussed in the context of the possible production of disoriented chiral condensates in central Pb – Pb collisions