Influence Function Based Second-Order Channel Pruning-Evaluating True Loss Changes For Pruning Is Possible Without Retraining

A challenge of channel pruning is designing efficient and effective criteria to select channels to prune. A widely used criterion is minimal performance degeneration. To accurately evaluate the truth performance degeneration requires retraining the survived weights to convergence, which is prohibitively slow. Hence existing pruning methods use previous weights (without retraining) to evaluate the performance degeneration. However, we observe the loss changes differ significantly with and without retraining. It motivates us to develop a technique to evaluate true loss changes without retraining, with which channels to prune can be selected more reliably and confidently. We first derive a closed-form estimator of the true loss change per pruning mask change, using influence functions without retraining. Influence function which is from robust statistics reveals the impacts of a training sample on the model's prediction and is repurposed by us to assess impacts on true loss changes. We then show how to assess the importance of all channels simultaneously and develop a novel global channel pruning algorithm accordingly. We conduct extensive experiments to verify the effectiveness of the proposed algorithm. To the best of our knowledge, we are the first that shows evaluating true loss changes for pruning without retraining is possible. This finding will open up opportunities for a series of new paradigms to emerge that differ from existing pruning methods. The code is available at https://github.com/hrcheng1066/IFSO.Comment: chrome-extension://ogjibjphoadhljaoicdnjnmgokohngcc/assets/icon-50207e67.pn

A Survey on Deep Neural Network Pruning-Taxonomy, Comparison, Analysis, and Recommendations

Modern deep neural networks, particularly recent large language models, come with massive model sizes that require significant computational and storage resources. To enable the deployment of modern models on resource-constrained environments and accelerate inference time, researchers have increasingly explored pruning techniques as a popular research direction in neural network compression. However, there is a dearth of up-to-date comprehensive review papers on pruning. To address this issue, in this survey, we provide a comprehensive review of existing research works on deep neural network pruning in a taxonomy of 1) universal/specific speedup, 2) when to prune, 3) how to prune, and 4) fusion of pruning and other compression techniques. We then provide a thorough comparative analysis of seven pairs of contrast settings for pruning (e.g., unstructured/structured) and explore emerging topics, including post-training pruning, different levels of supervision for pruning, and broader applications (e.g., adversarial robustness) to shed light on the commonalities and differences of existing methods and lay the foundation for further method development. To facilitate future research, we build a curated collection of datasets, networks, and evaluations on different applications. Finally, we provide some valuable recommendations on selecting pruning methods and prospect promising research directions. We build a repository at https://github.com/hrcheng1066/awesome-pruning

Modeling Study of the Air Quality Impact of Record-Breaking Southern California Wildfires in December 2017

We investigate the air quality impact of record‐breaking wildfires in Southern California during 5–18 December 2017 using the Weather Research and Forecasting model with Chemistry in combination with satellite and surface observations. This wildfire event was driven by dry and strong offshore Santa Ana winds, which played a critical role in fire formation and air pollutant transport. By utilizing fire emissions derived from the high‐resolution (375 × 375 m²) Visible Infrared Imaging Radiometer Suite active fire detections, the simulated magnitude and temporal evolution of fine particulate matter (PM_(2.5)) concentrations agree reasonably well with surface observations (normalized mean bias = 4.0%). Meanwhile, the model could generally capture the spatial pattern of aerosol optical depth from satellite observations. Sensitivity tests reveal that using a high spatial resolution for fire emissions and a reasonable treatment of plume rise (a fair split between emissions injected at surface and those lifted to upper levels) is important for achieving decent PM_(2.5) simulation results. Biases in PM_(2.5) simulation are relatively large (about 50%) during the period with the strongest Santa Ana wind, due to a possible underestimation of burning area and uncertainty in wind field variation. The 2017 December fire event increases the 14‐day averaged PM_(2.5) concentrations by up to 231.2 μg/m³ over the downwind regions, which substantially exceeds the U.S. air quality standards, potentially leading to adverse health impacts. The human exposure to fire‐induced PM_(2.5) accounts for 14–42% of the annual total PM_(2.5) exposure in areas impacted by the fire plumes

Responses of gaseous sulfuric acid and particulate sulfate to reduced SO2 concentration : A perspective from long-term measurements in Beijing

SO2 concentration decreased rapidly in recent years in China due to the implementation of strict control policies by the government. Particulate sulfate (pSO(4)(2-)) and gaseous H2SO4 (SA) are two major products of SO2 and they play important roles in the haze formation and new particle formation (NPF), respectively. We examined the change in pSO(4)(2-) and SA concentrations in response to reduced SO2 concentration using long-term measurement data in Beijing. Simulations from the Community Multiscale Air Quality model with a 2-D Volatility Basis Set (CMAQ/2D-VBS) were used for comparison. From 2013 to 2018, SO2 concentration in Beijing decreased by similar to 81% (from 9.1 ppb to 1.7 ppb). pSO(4)(2-) concentration in submicrometer particles decreased by similar to 60% from 2012-2013 (monthly average of similar to 10 mu g.m(-3)) to 2018-2019 (monthly average of similar to 4 mu g.m(-3)). Accordingly, the fraction of pSO(4)(2-) in these particles decreased from20-30% to b10%. Increased sulfur oxidation ratio was observed both in the measurements and the CMAQ/2D-VBS simulations. Despite the reduction in SO2 concentration, there was no obvious decrease in SA concentration based on data from several measuring periods from 2008 to 2019. This was supported by the increased SA:SO2 ratio with reduced SO2 concentration and condensation sink. NPF frequency in Beijing between 2004 and 2019 remains relatively constant. This constant NPF frequency is consistent with the relatively stable SA concentration in Beijing, while different from some other cities where NPF frequency was reported to decrease with decreased SO2 concentrations. (C) 2020 Elsevier B.V. All rights reserved.Peer reviewe

Multidifferential study of identified charged hadron distributions in ZZ-tagged jets in proton-proton collisions at s=\sqrt{s}=13 TeV

Jet fragmentation functions are measured for the first time in proton-proton collisions for charged pions, kaons, and protons within jets recoiling against a $Z$ boson. The charged-hadron distributions are studied longitudinally and transversely to the jet direction for jets with transverse momentum 20 $< p_{\textrm{T}} < 100$ GeV and in the pseudorapidity range $2.5 < \eta < 4$. The data sample was collected with the LHCb experiment at a center-of-mass energy of 13 TeV, corresponding to an integrated luminosity of 1.64 fb$^{-1}$. Triple differential distributions as a function of the hadron longitudinal momentum fraction, hadron transverse momentum, and jet transverse momentum are also measured for the first time. This helps constrain transverse-momentum-dependent fragmentation functions. Differences in the shapes and magnitudes of the measured distributions for the different hadron species provide insights into the hadronization process for jets predominantly initiated by light quarks.Comment: All figures and tables, along with machine-readable versions and any supplementary material and additional information, are available at https://cern.ch/lhcbproject/Publications/p/LHCb-PAPER-2022-013.html (LHCb public pages

Study of the B−→Λc+Λˉc−K−B^{-} \to \Lambda_{c}^{+} \bar{\Lambda}_{c}^{-} K^{-} decay

The decay $B^{-} \to \Lambda_{c}^{+} \bar{\Lambda}_{c}^{-} K^{-}$ is studied in proton-proton collisions at a center-of-mass energy of $\sqrt{s}=13$ TeV using data corresponding to an integrated luminosity of 5 $\mathrm{fb}^{-1}$ collected by the LHCb experiment. In the $\Lambda_{c}^+ K^{-}$ system, the $\Xi_{c}(2930)^{0}$ state observed at the BaBar and Belle experiments is resolved into two narrower states, $\Xi_{c}(2923)^{0}$ and $\Xi_{c}(2939)^{0}$, whose masses and widths are measured to be $$m(\Xi_{c}(2923)^{0}) = 2924.5 \pm 0.4 \pm 1.1 \,\mathrm{MeV}, \\ m(\Xi_{c}(2939)^{0}) = 2938.5 \pm 0.9 \pm 2.3 \,\mathrm{MeV}, \\ \Gamma(\Xi_{c}(2923)^{0}) = \phantom{000}4.8 \pm 0.9 \pm 1.5 \,\mathrm{MeV},\\ \Gamma(\Xi_{c}(2939)^{0}) = \phantom{00}11.0 \pm 1.9 \pm 7.5 \,\mathrm{MeV},$$ where the first uncertainties are statistical and the second systematic. The results are consistent with a previous LHCb measurement using a prompt $\Lambda_{c}^{+} K^{-}$ sample. Evidence of a new $\Xi_{c}(2880)^{0}$ state is found with a local significance of $3.8\,\sigma$, whose mass and width are measured to be $2881.8 \pm 3.1 \pm 8.5\,\mathrm{MeV}$ and $12.4 \pm 5.3 \pm 5.8 \,\mathrm{MeV}$, respectively. In addition, evidence of a new decay mode $\Xi_{c}(2790)^{0} \to \Lambda_{c}^{+} K^{-}$ is found with a significance of $3.7\,\sigma$. The relative branching fraction of $B^{-} \to \Lambda_{c}^{+} \bar{\Lambda}_{c}^{-} K^{-}$ with respect to the $B^{-} \to D^{+} D^{-} K^{-}$ decay is measured to be $2.36 \pm 0.11 \pm 0.22 \pm 0.25$, where the first uncertainty is statistical, the second systematic and the third originates from the branching fractions of charm hadron decays.Comment: All figures and tables, along with any supplementary material and additional information, are available at https://cern.ch/lhcbproject/Publications/p/LHCb-PAPER-2022-028.html (LHCb public pages

Measurement of the ratios of branching fractions R(D∗)\mathcal{R}(D^{*}) and R(D0)\mathcal{R}(D^{0})

The ratios of branching fractions $\mathcal{R}(D^{*})\equiv\mathcal{B}(\bar{B}\to D^{*}\tau^{-}\bar{\nu}_{\tau})/\mathcal{B}(\bar{B}\to D^{*}\mu^{-}\bar{\nu}_{\mu})$ and $\mathcal{R}(D^{0})\equiv\mathcal{B}(B^{-}\to D^{0}\tau^{-}\bar{\nu}_{\tau})/\mathcal{B}(B^{-}\to D^{0}\mu^{-}\bar{\nu}_{\mu})$ are measured, assuming isospin symmetry, using a sample of proton-proton collision data corresponding to 3.0 fb${ }^{-1}$ of integrated luminosity recorded by the LHCb experiment during 2011 and 2012. The tau lepton is identified in the decay mode $\tau^{-}\to\mu^{-}\nu_{\tau}\bar{\nu}_{\mu}$. The measured values are $\mathcal{R}(D^{*})=0.281\pm0.018\pm0.024$ and $\mathcal{R}(D^{0})=0.441\pm0.060\pm0.066$, where the first uncertainty is statistical and the second is systematic. The correlation between these measurements is $\rho=-0.43$. Results are consistent with the current average of these quantities and are at a combined 1.9 standard deviations from the predictions based on lepton flavor universality in the Standard Model.Comment: All figures and tables, along with any supplementary material and additional information, are available at https://cern.ch/lhcbproject/Publications/p/LHCb-PAPER-2022-039.html (LHCb public pages

Evaluation of a Method for Calculating the Height of the Stable Boundary Layer Based on Wind Profile Lidar and Turbulent Fluxes

The height of the stable boundary layer (SBL), known as the nocturnal boundary layer height, is controlled by numerous factors of different natures. The SBL height defines the state of atmospheric turbulence and describes the diffusion capacity of the atmosphere. Therefore, it is unsurprising that many alternative (sometimes contradictory) formulations for the SBL height have been proposed to date, and no consensus has been achieved. In our study, we propose an iterative algorithm to determine the SBL height h based on the flux–profile relationship using wind profiles and turbulent fluxes. This iterative algorithm can obtain temporally continuous, accurate estimates of h and is widely applicable. The predicted h presents relatively good agreement with four observation-derived SBL heights, hJ, h1, hi, and hθ (hJ: maximum wind speed height, h1: zero wind shear height, hi: temperature inversion height, and hθ: height at which 0.8 times the inversion strength appears for the first time), especially with hθ, which shows the best fit. In addition, h exhibits a low absolute difference and relative difference with hJ, which presents the second-best result. The agreement with hi and h1 may be satisfactory, but small differences are observed, and the one standard deviation of the mean relative difference is large. In addition, the predicted h is compared with other SBL height estimation methods, including diagnostic, λ1, λ2 and λ3 (three typical dimensional scale height parameters) and prognostic equation-based methods, λ(h) (an equation for the growth of h developed). The diagnostic formulas are found to be appropriate, especially under extremely stable conditions. Additionally, the equation of λ3 presents the best result of all the dimensional scale height parameters. However, the prognostic equation λ(h) in our study is very unsatisfactory

Advances in sunphotometer-measured aerosol optical properties and related topics in China: Impetus and perspectives

International audienceAerosol is a critical trace component of the atmosphere. Many processes in the Earth's climate system are intimately related to aerosols via their direct and indirect radiative effects. Aerosol effects are not limited to these climatic aspects, however. They are also closely related to human health, photosynthesis, new energy, etc., which makes aerosol a central focus in many research fields. A fundamental requirement for improving our understanding of the diverse aerosol effects is to accumulate high-quality aerosol data by various measurement techniques. Sunphotometer remote sensing is one of the techniques that has been playing an increasingly important role in characterizing aerosols across the world. Much progress has been made on this aspect in China during the past decade, which is the work reviewed in this paper. Three sunphotometer networks have been established to provide high-quality observations of long-term aerosol optical properties across the country. Using this valuable dataset, our understanding of spatiotemporal variability and long-term trends of aerosol optical properties has been much improved. The radiative effects of aerosols both at the bottom and at the top of the atmosphere are comprehensively assessed. Substantial warming of the atmosphere by aerosol absorption is revealed. The long-range transport of dust from the Taklimakan Desert in Northwest China and anthropogenic aerosols from South Asia to the Tibetan Plateau is characterized based on ground-based and satellite remote sensing as well as model simulations. Effective methods to estimate chemical compositions from sunphotometer aerosol products are developed. Dozens of satellite and model aerosol products are validated, shedding new light on how to improve these products. These advances improve our understanding of the critical role played by aerosols in both the climate and environment. Finally, a perspective on future research is presented