SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents

Graphical User Interface (GUI) agents are designed to automate complex tasks on digital devices, such as smartphones and desktops. Most existing GUI agents interact with the environment through extracted structured data, which can be notably lengthy (e.g., HTML) and occasionally inaccessible (e.g., on desktops). To alleviate this issue, we propose a novel visual GUI agent -- SeeClick, which only relies on screenshots for task automation. In our preliminary study, we have discovered a key challenge in developing visual GUI agents: GUI grounding -- the capacity to accurately locate screen elements based on instructions. To tackle this challenge, we propose to enhance SeeClick with GUI grounding pre-training and devise a method to automate the curation of GUI grounding data. Along with the efforts above, we have also created ScreenSpot, the first realistic GUI grounding benchmark that encompasses mobile, desktop, and web environments. After pre-training, SeeClick demonstrates significant improvement in ScreenSpot over various baselines. Moreover, comprehensive evaluations on three widely used benchmarks consistently support our finding that advancements in GUI grounding directly correlate with enhanced performance in downstream GUI agent tasks. The model, data and code are available at https://github.com/njucckevin/SeeClick

Constant Light Exposure Alters Gut Microbiota and Promotes the Progression of Steatohepatitis in High Fat Diet Rats

Background: Non-alcoholic fatty liver disease (NAFLD) poses a significant health concern worldwide. With the progression of urbanization, light pollution may be a previously unrecognized risk factor for NAFLD/NASH development. However, the role of light pollution on NAFLD is insufficiently understood, and the underlying mechanism remains unclear. Interestingly, recent studies indicate the gut microbiota affects NAFLD/NASH development. Therefore, the present study explored effects of constant light exposure on NAFLD and its related microbiotic mechanisms. Material and method: Twenty-eight SD male rats were divided into four groups (n=7 each): rats fed a normal chow diet, and exposed to standard light-dark cycle (ND-LD); rats fed a normal chow diet, and exposed to constant light (ND-LL); rats fed a high fat diet, and exposed to standard light-dark cycle (HFD-LD); and rats on a high fat diet, and exposed to constant light (HFD-LL). Body weight, hepatic pathophysiology, gut microbiota, and short/medium chain fatty acids in colon contents, serum lipopolysaccharide (LPS) and liver LPS-binding protein (LBP) mRNA expression were documented post intervention and compared among groups. Result: In normal chow fed groups, rats exposed to constant light displayed glucose abnormalities and dyslipidemia. In HFD-fed rats, constant light exposure exacerbated glucose abnormalities, insulin resistance, inflammation and liver steatohepatitis. Constant light exposure altered composition of gut microbiota in both normal chow and HFD fed rats. Compared with HFD-LD group, HFD-LL rats displayed less Butyricicoccus, Clostridium and Turicibacter, butyrate levels in colon contents, decreased colon expression of occludin-1 and zonula occluden‐1 (ZO-1) , and increased serum LPS and liver LBP mRNA expression. Conclusion: Constant light exposure impacts gut microbiota and its metabolic products, impairs gut barrier function and gut-liver axis, promotes NAFLD/NASH progression in HFD rats

Efficient Fabrication of Ti6Al4V Alloy by Means of Multi-Laser Beam Selective Laser Melting

A self-developed four-laser beam selective laser melting (SLM) system was used to fabricate Ti6Al4V alloy samples in this study. The relative density, micro-hardness and mechanical properties of all isolated processing areas were compared under optimized processing parameters to ensure the consistency of this system. Microstructures in overlap areas are dominated by columnar grains along the building direction and matensitic needles αˊ inclined at about ± 45° to the building direction, which are similar with those in isolated areas. Mechanical properties in overlap areas are also not inferior to those in isolated areas. The results prove the feasibility to fabricate large-scale components with a uniform microstructure and mechanical property by this SLM system. By the use of four lasers, this system can provide a high building rate of 80 cm3/h.Mechanical Engineerin

Tensile Test and Numerical Simulation Investigations on the Mechanical Properties of a New Type of Slightly Curved Arc HRB400 Steel Bars in Mass Concrete

Abstract The temperature stress in mass concrete structure is relatively high during construction, which usually leads to temperature cracks. To solve this problem, concrete blocks are usually placed by setting wide slots. Connecting the truncated steel bars at the position of the wide slots by welding or extruding sleeves has many disadvantages. To solve the problem of temperature-induced stress loss, a new type of slightly curved arc HRB400 (SCAHRB400) steel bars was proposed without cutting off the steel bars in this article. Tensile tests and numerical simulations were performed for five types of SCAHRB400 steel bars considering geometric and material nonlinearity. Based on the test results and numerical simulation results, the equivalent stress–strain relationships of SCAHRB400 steel bars were established, and the emergence of the plastic zone of SCAHRB400 steel bars in the tensile process were observed, the tensile properties of SCAHRB400 steel bars were analyzed and discussed. The test results indicate that SCAHRB400 steel bars are prone to local yielding near the crown of large arches and at the connection of horizontal and arc sections. The numerical simulation equivalent stress–strain curves have good regularity. The equivalent stress–strain curves of slightly curved arc HRB400 and HRB335 steel bars have the similar changing law. When the stress is small, the tensile stiffness and compressive axial stiffness of slightly curved arc HRB400 and HRB335 steel bars are similar; when the stress is large, the axial stiffness of SCAHRB400 steel bars is greater than that of slight curved arc HRB335 steel bars. Through test and numerical simulation studies, the theoretical basis can be established for the engineering application of new slightly curved arc steel bars in mass concrete

Permeability of N, P, K-fertilizer nutrient and water vapor through PLA, PLA/PS, and PLA/HA membranes

To collect permeability data and establish its database of fertilizer nutrients and water vapor through different polymer membranes for the development of polymer-coated fertilizer, the permeabilities of N-, P-, and K-nutrient from saturated aqueous of urea, NaH2PO4 and KCl solution and the permeability of water vapor through the membranes of poly lactic acid (PLA), its blends with polystyrene (PS), and its composites with humic acid (HA) particles were determined experimentally at the temperatures of 288, 298, and 308 K, respectively. The effects of the addition of PS and HA particles, temperature, and coating thickness on the permeability of fertilizer nutrient and water vapor were investigated. It was found that the addition of PS and HA increased the permeability for both the fertilizer nutrients and water vapor. The increase in temperature raised the permeability of N-, P-, and K-nutrient while decrease the permeability of water vapor in the range studied

Sonochemical fabrication and optical properties of ZnO stelliform dendrites containing Bi₂O₃

51-56Sonochemical synthesis and optical properties of the ZnO- Bi₂O₃ nanocomposite materials have been reported. SEM and TEM studies show the morphology to be stelliform dendrite. The sonication time appears to be a critical parameter for shape determination. Also, the presence of Bi³⁺ is vital to the formation of the stelliform dentrites. UV and photoluminescence spectra at room temperature of the products show that the synthesized materials possess good optical properties. The mechanism of the stelliform dendrite growth has also been discussed

Thermal degradation of the green-emitting SrSi2O 2N2:Eu2+ phosphor for solid state lighting

A phase pure SrSi2O2N2:Eu2+ green phosphor was synthesized by a solid state reaction through careful control of the Sr:Si ratio in the starting powder consisting of SrCO3, Si3N4 and Eu2O3. The thermal degradation of the phosphor was investigated by baking it at high temperatures for 2 h. The surface states of the samples before and after baking were analyzed by SEM, HRTEM, XPS, TGA/DTA, and high temperature in situ X-ray diffraction. The results showed that the thermal degradation became intense when the temperature was higher than 500°C, and the degradation was caused by the formation of SrSiO3 on the particle surface and the oxidation of Eu2+ to Eu3+. It is suggested that the thermal stability can be enhanced by achieving high crystallinity as well as high phase purity of the phosphor. This journal is ? the Partner Organisations 2014

Permeability of N, P, K-fertilizer nutrient and water vapor through PLA, PLA/PS, and PLA/HA membranes

To collect permeability data and establish its database of fertilizer nutrients and water vapor through different polymer membranes for the development of polymer-coated fertilizer, the permeabilities of N-, P-, and K-nutrient from saturated aqueous of urea, NaH2PO4 and KCl solution and the permeability of water vapor through the membranes of poly lactic acid (PLA), its blends with polystyrene (PS), and its composites with humic acid (HA) particles were determined experimentally at the temperatures of 288, 298, and 308 K, respectively. The effects of the addition of PS and HA particles, temperature, and coating thickness on the permeability of fertilizer nutrient and water vapor were investigated. It was found that the addition of PS and HA increased the permeability for both the fertilizer nutrients and water vapor. The increase in temperature raised the permeability of N-, P-, and K-nutrient while decrease the permeability of water vapor in the range studied

Metal dopants adjusted perovskite stannates: Conductivity and optical properties

Perovskite-type transparent conductive oxides have attracted continuous attentions due to their applications in optoelectronic devices, but the optimization of their transmittance and conductivity is under way. In this work, the energetics, electronic and optical properties of the perovskite stannates (ASnO3, A = Ca, Sr, Ba) with diverse dopants La, Sb and Nb are studied using density functional theory. The energetically preferred substitution positions are predicted as A site for La but Sn site for Sb and Nb. Therefore, the doped perovskite stannates are all identified as n-type semiconductors due to the extra electron from the dopants. The calculated absorption coefficient and reflectivity in La, Sb and Nb doped perovskite stannates decrease but their transmittance in the visible light range increases as a result of the adjusted band structures. In addition, the carrier concentration dependent electric conductivity of the doped perovskites is predicted. The uncovered mechanism of improved electronic and optical properties for doped perovskite stannates is expected to benefit the design of high performance perovskite transparent conductive materials