Neural Network Pruning as Spectrum Preserving Process

Neural networks have achieved remarkable performance in various application domains. Nevertheless, a large number of weights in pre-trained deep neural networks prohibit them from being deployed on smartphones and embedded systems. It is highly desirable to obtain lightweight versions of neural networks for inference in edge devices. Many cost-effective approaches were proposed to prune dense and convolutional layers that are common in deep neural networks and dominant in the parameter space. However, a unified theoretical foundation for the problem mostly is missing. In this paper, we identify the close connection between matrix spectrum learning and neural network training for dense and convolutional layers and argue that weight pruning is essentially a matrix sparsification process to preserve the spectrum. Based on the analysis, we also propose a matrix sparsification algorithm tailored for neural network pruning that yields better pruning result. We carefully design and conduct experiments to support our arguments. Hence we provide a consolidated viewpoint for neural network pruning and enhance the interpretability of deep neural networks by identifying and preserving the critical neural weights.Comment: arXiv admin note: substantial text overlap with arXiv:2304.0345

Effects of Nonaerated Circulation Water Velocity on Nutrient Release from Aquaculture Pond Sediments

Sustaining good water quality in aquaculture ponds is vital. Without an aerator, the dissolved oxygen in ponds comes primarily from mass transfer at the water-ambient atmosphere interface. As sediment can seriously affect water quality, this study used indoor experiments to examine the nutrient (nitrogen and phosphorus) release mechanisms and fluxes from sediment in aquaculture ponds with moving water but no aeration. The results showed that the ammonia nitrogen (NH3-N) concentration in the overlying water was inversely proportional to flow velocity and that a higher flow velocity tended to result in a lower concentration in the overlying water, a steeper vertical gradient of concentration within the bed sediments, and a faster release rate from the sediments. The sediment disturbed by flowing water released more nitrate nitrogen (NO3-N) and nitrite nitrogen (NO2-N) into the overlying water and NO2-N could become oxidized into NO3-N. In still water, NO3-N was released gradually and some anaerobic NO3-N was nitrified into NO2-N. Phosphorus release from the sediments was controlled by the adsorption-desorption balance, with the phosphorus concentration in the overlying water dropping gradually to a steady value from its initial maximum. The relationship between NH3-N release flux and flow rate is described by a cubic function

Social distancing cut down the prevalence of acute otitis media in children

ObjectivesTo evaluate the additional, unintended benefits of social distancing in cutting down the prevalence of acute otitis media (AOM) in children, especially during coronavirus disease 2019 (COVID-19) periods.MethodsThe daily outpatient attendance of AOM for childhood (from 6 months to 12 years) was compared in the tertiary hospital in Shanghai during pre-COVID-19 and COVID-19 year.ResultsA total of 24,543 AOM cases were included from 2015 to 2020. When age was taken into account, children in kindergarten (aged 4–6) constitute 66.2% (16,236/24,543) of all case, followed by primary school students (6,441/24,543, 26.2%) and preschoolers <3 years old (1,866/24,543, 7.6%). There was an estimated 63.6% (54.32–70.36%) reduction in the daily outpatient attendance of AOM associated with the introduction of social distancing in 2020 (COVID-19 year). The epidemic trend of AOM in 2015–2019 was characterized by seasonal fluctuations, with highest incidence in December (18.8 ± 0.5%) and lower in February (4.5 ± 0.2%), June (3.7 ± 0.7%) and August (3.5 ± 0.5%). And distribution characteristics of different ages in COVID-19 period broadly in line with that in non-pandemic period.ConclusionSeasonal fluctuation in the prevalence of AOM was observed in pre-COVID-19 period (2015–2019), with a peak in winter and a nadir in summer. The >50% drop of outpatient attendance of AOM in 2020 (COVID-19 year) suggest that social distancing, mask effects and good hand hygiene can significantly reduce the incidence of AOM, which provides a preventive and therapeutic point of view for AOM

Characterizing the Particle Composition and Cloud Condensation Nuclei from Shipping Emission in Western Europe

Commercial shipping is considered as an important source of air pollution and cloud condensation nuclei (CCN). To assess the climatic and environmental impacts of shipping, detailed characterization of ship plumes near the point of emission and understanding of ship plume evolution further downwind are essential. This airborne measurement study presents the online characterization of particulate phase ship emissions in the region of Western Europe in 2019 prior to new international sulfur emission controls becoming enacted. More than 30 ships from both the sulfur emission control area (SECA) in the English Channel and the open sea (OS) are measured and compared. Ships within the SECA emitted much less sulfate (SO4) compared with those at OS. When shifted to a lower apparent fuel sulfur content (FSC) at similar engine loads, the peak of the fresh ship emitting the particle number size distribution shifted from around 60-80 nm in diameter to below 40 nm in diameter. The emission factors (EFs) of sulfate are predicted to decrease by around 94% after the 2020 regulation on ship sulfur emission in the open ocean. The EFs of refractory black carbon (rBC) and organic compounds (Org) do not appear to be directly affected by the lower sulfur contents. The total number concentration for condensation nuclei (CN) >2.5 nm and >0.1 μm are predicated to be reduced by 69 and 56%, respectively. Measured plume evolution results indicate that the S(IV) to S(VI) conversion rate was around 23.4% per hour at the beginning of plume evolution, and the CCN and CN >2.5 nm ratio increased with plume age primarily due to condensation and coagulation. We estimate that the new sulfur emission regulation will lead to a reduction of more than 80% in CCN from fresh ship emissions. The ship-emitted EFs results presented here will also inform emission inventories, policymaking, climate, and human health studies

Enhanced heating rate of black carbon above planetary boundary layer over megacities in summertime

The fast development of a secondary aerosol layer was observed over megacities in eastern Asia during summertime. Within three hours, from midday to early afternoon, the contribution of secondary aerosols above the planetary boundary layer (PBL) increased by a factor of 3-5, and the coatings on the black carbon (BC) also increased and enhanced its absorption efficiency by 50%. This tended to result from the intensive actinic flux received above the PBL which promoted the photochemical reactions. The absorption of BC could be further amplified by the strong reflection of solar radiation over the cloud top across the PBL. This enhanced heating effect of BC introduced by combined processes (intensive solar radiation, secondary formation and cloud reflection) may considerably increase the temperature inversion above the PBL. This mechanism should be considered when evaluating the radiative impact of BC, especially for the polluted regions receiving strong solar radiation