SmartTrim: Adaptive Tokens and Attention Pruning for Efficient Vision-Language Models

Despite achieving remarkable performance on various vision-language tasks, Transformer-based Vision-Language Models (VLMs) suffer from redundancy in inputs and parameters, significantly hampering their efficiency in real-world applications. Moreover, the degree of redundancy in token representations and model parameters, such as attention heads, varies significantly for different inputs. In light of the challenges, we propose SmartTrim, an adaptive acceleration framework for VLMs, which adjusts the computational overhead per instance. Specifically, we integrate lightweight modules into the original backbone to identify and prune redundant token representations and attention heads within each layer. Furthermore, we devise a self-distillation strategy to enhance the consistency between the predictions of the pruned model and its fully-capacity counterpart. Experimental results across various vision-language tasks consistently demonstrate that SmartTrim accelerates the original model by 2-3 times with minimal performance degradation, highlighting the effectiveness and efficiency compared to previous approaches. Code will be available at https://github.com/kugwzk/SmartTrim.Comment: COLING-LREC 202

Stability and sensitivity characteristic analysis for the hydropower unit considering the sloping roof tailrace tunnel and coupling effect of the power grid

This paper focuses on the stability and dynamic characteristics of the coupled system of nonlinear hydraulic turbine regulating system (HTRS) and power grid (PG). By establishing a nonlinear mathematical model considering the downstream surge chamber and sloping roof tailrace tunnel, the coupling effect and influence mechanism between the hydropower station and power grid are revealed. First, with regard to the coupled system, HTRS considering downstream surge chamber and sloping roof tailrace tunnel and PG model is established. Then, dynamic performance of the coupled system is investigated based on the nonlinear mathematical model as well as Hopf bifurcation theory and validated by numerical simulation. Meanwhile, the impact mechanism of HTRS and PG is revealed by investigating dynamic characteristics. In addition, stability is studied by using eigenvalue method according to the Jacobian matrix of the coupled system. Finally, parameter sensitivity is investigated to quantify parameter effects on system performance. The experimental results indicate that bifurcation line divides the whole proportional–integral adjustment coefficient plane into two parts and the region at the bottom of bifurcation line is stability region. HTRS and PG possess a coupling effect on stable domain and dynamic properties of the coupled system. The variation of HTRS parameters is most significant for the coupled system, especially for the inertia time constant of the hydraulic turbine unit and penstock flow inertia time constant

Multicolor Combinatorial Probe Coding for Real-Time PCR

The target volume of multiplex real-time PCR assays is limited by the number of fluorescent dyes available and the number of fluorescence acquisition channels present in the PCR instrument. We hereby explored a probe labeling strategy that significantly increased the target volume of real-time PCR detection in one reaction. The labeling paradigm, termed “Multicolor Combinatorial Probe Coding” (MCPC), uses a limited number (n) of differently colored fluorophores in various combinations to label each probe, enabling one of 2n-1 genetic targets to be detected in one reaction. The proof-of-principle of MCPC was validated by identification of one of each possible 15 human papillomavirus types, which is the maximum target number theoretically detectable by MCPC with a 4-color channel instrument, in one reaction. MCPC was then improved from a one-primer-pair setting to a multiple-primer-pair format through Homo-Tag Assisted Non-Dimer (HAND) system to allow multiple primer pairs to be included in one reaction. This improvement was demonstrated via identification of one of the possible 10 foodborne pathogen candidates with 10 pairs of primers included in one reaction, which had limit of detection equivalent to the uniplex PCR. MCPC was further explored in detecting combined genotypes of five β-globin gene mutations where multiple targets were co-amplified. MCPC strategy could expand the scope of real-time PCR assays in applications which are unachievable by current labeling strategy

An Experimental Study on the Effect of Nanofluids on the Thermal Conductivity and Rheological Properties of a Coolant for Liquids

Thermal conductivity and viscosity are important properties for nanofluids as they significantly affect the flow and heat transfer process. To date, the rheological properties of water-based nanofluids have been well studied, while the results are scarce for non-aqueous nanofluids. In this study, the thermal conductivity and rheological properties of two different kinds of oxide nanofluids (CuO and Al2O3) in a typical commercial data center focusing on liquid coolants were systematically investigated at different mass fractions and temperatures. The results showed that the addition of nanoparticles can significantly improve the heat conduction capacity of mineral oil coolants. There is an average increase in thermal conductivity of up to 20–25%. The shear rate–shear stress and shear rate–viscosity curves all showed that mineral oil coolant-based oxide nanofluids behaved as Newtonian fluids and that nanoparticles did not cause the increment in viscosity. The effect of temperature on rheological properties was also studied, and the result showed that high temperatures resulted in low viscosity and shear stress. Finally, the effect of particle type was investigated, and it was found that no matter what kind of nanoparticles were added, their effects on the rheological behaviors were the same

Physical Modeling and Intelligent Prediction for Instability of High Backfill Slope Moisturized under the Influence of Rainfall Disasters

The stability of high backfill slopes emerges in practice due to the expansion of transportation infrastructures. The seepage and infiltration of rainfall into the backfills brings challenges to engineers in predicting the stability of the slope, weakening the shear strength and modulus of the soil. This study carried out a series of model tests under a plane strain condition to investigate the stability of a high backfill slope moisturized by rainfalls, considering the influences of rainfall duration and intensity. The slope displacements were monitored by a laser displacement sensor and the moisture content in the backfill mass were obtained by a soil moisture sensor. The test results show that increasing the rainfall intensity and duration caused the slope near the surface to be saturated, resulting in significant influences on the lateral displacement of the slope and the reduction of stability as well as the sizes of the sliding mass. Based on the model tests, the numerical analysis was adopted to extend the analysis cases, and the backpropagation (BP) neural network model was further adopted to build a model for predicting the stability of a high backfill slope under rainfall. The trained BP model shows the average relative error of 1.02% and the goodness of fitness of 0.999, indicating a good prediction effect

Robust Adaptive Backstepping Motion Control of Underwater Cable-Driven Parallel Mechanism Using Improved Linear Model Predictive Control

This paper proposes a novel motion-tracking control methodology for an underwater cable-driven parallel mechanism (CDPM) that achieves calculation of dynamic tension constraint values, tension planning, parameter linearization, and motion tracking. The control objective is divided into three sub-objectives: motion tracking, horizontal displacement suppression, and cable-tension restriction. A linear model predictive control (LMPC) method is designed to plan cable tensions for motion-tracking and displacement suppression. The robust adaptive backstepping controller converts cable tension into winch speed based on the joint-space method and command filtering. Moreover, the X−swapping method is used to linearize and identify the time−varying nonlinear parameters. An essential prerequisite for restricting cable tension is to obtain cable-tension constraint values. A novel dynamic minimum tension control (DMTC) method, based on the equivalent control concept, is proposed for this aim. The DMTC can adaptively obtain the lower cable-tension threshold through the platform posture and motion status, anchor distribution position, and cable integrity status. Compared to traditional fixed tension constraint values, DMTC can more effectively cope with sudden changes in cable tension than fixed tension constraints. Finally, several simulations are carried out to verify the effectiveness and robustness of the proposed approach

Intercomparison of Cloud Vertical Structures over Four Different Sites of the Eastern Slope of the Tibetan Plateau in Summer Using Ka-Band Millimeter-Wave Radar Measurements

The eastern slope of the Tibetan Plateau is a crucial corridor of water-vapor transport from the Tibetan Plateau to Eastern China. This is also a region with active cloud initiation, and the locally hatched cloud systems have a profound impact on the radiation budget and hydrological cycle over the downstream Sichuan Basin and the middle reach of the Yangtze River. It is noteworthy that there is a strong diversification in the characteristics and evolution of the ESTP cloud systems due to the complex terrain. Therefore, in this study, ground-based Ka-band millimeter-wave cloud radar measurements collected at the Ganzi (GZ), Litang (LT), Daocheng (DC), and Jiulong (JL) sites of the ESTP in 2019 were analyzed to compare the vertical structures of summer nonprecipitating clouds, including cloud occurrence frequency, radar reflectivity factor, cloud base height, cloud top height, and cloud thickness. The occurrence frequency exhibits two peaks on the ESTP with maximum values of ~20% (2–4 km) and 15% (7–9 km), respectively. The greatest (smallest) occurrence frequency occurs in the JL (GZ). The cloud occurrence frequency of all sites increases rapidly in the afternoon, and the occurrence frequency of the DC presents larger values at 2–4 km. In contrast, the occurrence frequency in the JL shows another increase from 2000 LT to midnight at 7–11 km. Stronger radar echoes occur most frequently in the LT at 5–7 km, and hydrometeor sizes and phase states vary dramatically in mixed-phase clouds. A small number of radar echoes occur at midnight in the JL. A characteristic bimodality of the cloud base height and top height for single-layer, double-layer, and triple-layer clouds was observed. Clouds show a higher base height in the GZ and higher top height in the JL. The ESTP is dominated by thin clouds with thicknesses of 200–400 m. The cloud base height, top height, and thickness exhibit an increase in the afternoon, and higher top height occurs more frequently from midnight to the next early morning in the JL because of its mountain-valley terrain

Changes in Disposition of Ezetimibe and Its Active Metabolites Induced by Impaired Hepatic Function: The Influence of Enzyme and Transporter Activities

Ezetimibe (EZE) is a selective cholesterol absorption inhibitor. Hepatic impairment significantly increases the systemic exposure of EZE and its main active phenolic glucuronide, EZE-Ph. Although changes in efflux transporter activity partly explain the changes in EZE-Ph pharmacokinetics, the causes of the changes to EZE and the effects of the administration route on EZE-Ph remain unclear. A carbon tetrachloride (CCl4)-induced hepatic failure rat model was combined with in vitro experiments to explore altered EZE and EZE-Ph disposition caused by hepatic impairment. The plasma exposure of EZE and EZE-Ph increased by 11.1- and 4.4-fold in CCl4-induced rats following an oral administration of 10 mg/kg EZE, and by 2.1- and 16.4-fold after an intravenous injection. The conversion of EZE to EZE-Ph decreased concentration-dependently in CCl4-induced rat liver S9 fractions, but no change was observed in the intestinal metabolism. EZE-Ph was a substrate for multiple efflux and uptake transporters, unlike EZE. In contrast to efflux transporters, no difference was seen in the hepatic uptake of EZE-Ph between control and CCl4-induced rats. However, bile acids that accumulated due to liver injury inhibited the uptake of EZE-Ph by organic anion transporting polypeptides (OATPs) (glycochenodeoxycholic acid and taurochenodeoxycholic acid had IC50 values of 15.1 and 7.94 μM in OATP1B3-overexpressed cells). In conclusion, the increased plasma exposure of the parent drug EZE during hepatic dysfunction was attributed to decreased hepatic glucuronide conjugation, whereas the increased exposure of the metabolite EZE-Ph was mainly related to transporter activity, particularly the inhibitory effects of bile acids on OATPs after oral administration