Efficient Latency-Aware CNN Depth Compression via Two-Stage Dynamic Programming

Recent works on neural network pruning advocate that reducing the depth of the network is more effective in reducing run-time memory usage and accelerating inference latency than reducing the width of the network through channel pruning. In this regard, some recent works propose depth compression algorithms that merge convolution layers. However, the existing algorithms have a constricted search space and rely on human-engineered heuristics. In this paper, we propose a novel depth compression algorithm which targets general convolution operations. We propose a subset selection problem that replaces inefficient activation layers with identity functions and optimally merges consecutive convolution operations into shallow equivalent convolution operations for efficient end-to-end inference latency. Since the proposed subset selection problem is NP-hard, we formulate a surrogate optimization problem that can be solved exactly via two-stage dynamic programming within a few seconds. We evaluate our methods and baselines by TensorRT for a fair inference latency comparison. Our method outperforms the baseline method with higher accuracy and faster inference speed in MobileNetV2 on the ImageNet dataset. Specifically, we achieve $1.41\times$ speed-up with $0.11$\%p accuracy gain in MobileNetV2-1.0 on the ImageNet.Comment: ICML 2023; Codes at https://github.com/snu-mllab/Efficient-CNN-Depth-Compressio

Observation of superabsorption by correlated atoms

Emission and absorption of light lie at the heart of light-matter interaction. Although the emission and absorption rates are regarded as intrinsic properties of atoms and molecules, various ways to modify these rates have been sought in critical applications such as quantum information processing, metrology and light-energy harvesting. One of the promising approaches is to utilize collective behavior of emitters as in superradiance. Although superradiance has been observed in diverse systems, its conceptual counterpart in absorption has never been realized. Here, we demonstrate superabsorption, enhanced cooperative absorption, by correlated atoms of phase-matched superposition state. By implementing an opposite-phase-interference idea on a superradiant state or equivalently a time-reversal process of superradiance, we realized the superabsorption with its absorption rate much faster than that of the ordinary ground-state absorption. The number of photons completely absorbed for a given time interval was measured to be proportional to the square of the number of atoms. Our approach, breaking the limitation of the conventional absorption, can help weak-signal sensing and advance efficient light-energy harvesting as well as light-matter quantum interfaces.Comment: 7 pages, 5 figure

Third-order exceptional point in an ion-cavity system

We investigate a scheme for observing the third-order exceptional point (EP3) in an ion-cavity setting. In the lambda-type level configuration, the ion is driven by a pump field, and the resonator is probed with another weak laser field. We exploit the highly asymmetric branching ratio of an ion's excited state to satisfy the weak-excitation limit, which allows us to construct the non-Hermitian Hamiltonian $(H_{\textrm{nH}})$. Via fitting the cavity-transmission spectrum, the eigenvalues of $H_{\textrm{nH}}$ are obtained. The EP3 appears at a point where the Rabi frequency of the pump laser and the atom-cavity coupling constant balance the loss rates of the system. Feasible experimental parameters are provided.Comment: 9 pages, 6 figure

Optimal Band Selection for Airborne Hyperspectral Imagery to Retrieve a Wide Range of Cyanobacterial Pigment Concentration Using a Data-Driven Approach

Understanding the concentration and distribution of cyanobacteria blooms is an important aspect of managing water quality problems and protecting aquatic ecosystems. Airborne hyperspectral imagery (HSI)-which has high temporal, spatial, and spectral resolutions-is widely used to remotely sense cyanobacteria bloom, and it provides the distribution of the bloom over a wide area. In this study, we determined the input spectral bands that were relevant in effectively estimating the main two pigments (PC, Phycocyanin; Chl-a, Chlorophyll-a) of cyanobacteria by applying data-driven algorithms to HSI and then evaluating the change in the spatio-temporal distribution of cyanobacteria. The input variables for the algorithms consisted of reflectance band ratios associated with the optical properties of PC and Chl-a, which were calculated by the selected hyperspectral bands using a feature selection method. The selected input variable was composed of six reflectance bands (465.7-589.6, 603.6-631.8, 641.2-655.35, 664.8-679.0, 698.0-712.3, and 731.4-784.1 nm). The artificial neural network showed the best results for the estimation of the two pigments with average coefficients of determination 0.80 and 0.74. This study proposes relevant input spectral information and an algorithm that can effectively detect the occurrence of cyanobacteria in the weir pool along the Geum river, South Korea. The algorithm is expected to help establish a preemptive response to the formation of cyanobacterial blooms, and to contribute to the preparation of suitable water quality management plans for freshwater environments

Comparing the Performance of Machine Learning and Deep Learning Algorithms in Wastewater Treatment Process

This study assessed the performance of single and modified algorithms based on machine learning and deep learning for wastewater treatment process. More specifically, this study adopted support vector machine (SVM), random forest (RF), and artificial neural network (ANN) for machine learning as well as long short-term memory (LSTM) for deep learning. The performance of these (single) algorithms were compared with that of modified ones processed through hyperparameter tuning, ensemble learning (only for machine learning), and multi-layer stacking (i.e., two layers of LSTM units). The daily effluent of wastewater treatment process observed between 2017 and 2022 in the Cheong-Ju National Industrial Complex was used as input to all tested algorithms, which was evaluated with respect to mean squared error. For the model performance evaluation, discharge and biochemical oxygen demand are selected as dependent variables out of nine measured parameters. Results showed that the performance of any machine learning algorithms was superior to their competitor LSTM. This is mainly attributed to a small amount of input data provided to the LSTM algorithm and unstable effluent wastewater characteristics. Meanwhile, hyperparameter tuning improved the performance of all tested algorithms. However, ensemble learning for machine learning and two-layer stacking for LSTM generally resulted in performance degradation as compared to that of single algorithms, regardless of dependent variables. Therefore, this calls for a careful design and evaluation of modified algorithms, specifically for model architecture and performance improvement processes

Interface Structure in Li-Metal/[Pyr_(14)][TFSI]-Ionic Liquid System from Ab Initio Molecular Dynamics Simulations

Ionic liquids (ILs) are promising materials for application in a new generation of Li batteries. They can be used as electrolyte or interlayer or incorporated into other materials. ILs have the ability to form a stable solid electrochemical interface (SEI), which plays an important role in protecting the Li-based electrode from oxidation and the electrolyte from extensive decomposition. Experimentally, it is hardly possible to elicit fine details of the SEI structure. To remedy this situation, we have performed a comprehensive computational study (density functional theory-based molecular dynamics) to determine the composition and structure of the SEI compact layer formed between the Li anode and [Pyr_(14)][TFSI] IL. We found that the [TFSI] anions quickly reacted with Li and decomposed, unlike the [Pyr_(14)] cations which remained stable. The obtained SEI compact layer structure is nonhomogeneous and consists of the atomized S, N, O, F, and C anions oxidized by Li atoms

Application of airborne hyperspectral imagery to retrieve spatiotemporal CDOM distribution using machine learning in a reservoir

Colored dissolved organic matter (CDOM) in inland waters is used as a proxy to estimate dissolved organic carbon (DOC) and may be a key indicator of water quality and nutrient enrichment. CDOM is optically active fraction of DOC so that remote sensing techniques can remotely monitor CDOM with wide spatial coverage. However, to effectively retrieve CDOM using optical algorithms, it may be critical to select the absorption co-efficient at an appropriate wavelength as an output variable and to optimize input reflectance wavelengths. In this study, we constructed a CDOM retrieval model using airborne hyperspectral reflectance data and a machine learning model such as random forest. We evaluated the best combination of input wavelength bands and the CDOM absorption coefficient at various wavelengths. Seven sampling events for airborne hyperspectral imagery and CDOM absorption coefficient data from 350 nm to 440 nm over two years (2016-2017) were used, and the collected data helped train and validate the random forest model in a freshwater reservoir. An absorption co-efficient of 355 nm was selected to best represent the CDOM concentration. The random forest exhibited the best performance for CDOM estimation with an R2 of 0.85, Nash-Sutcliffe efficiency of 0.77, and percent bias of 3.88, by using a combination of three reflectance bands: 475, 497, and 660 nm. The results show that our model can be utilized to construct a CDOM retrieving algorithm and evaluate its spatiotemporal variation across a reservoir