Muti-Scale And Token Mergence: Make Your ViT More Efficient

Since its inception, Vision Transformer (ViT) has emerged as a prevalent model in the computer vision domain. Nonetheless, the multi-head self-attention (MHSA) mechanism in ViT is computationally expensive due to its calculation of relationships among all tokens. Although some techniques mitigate computational overhead by discarding tokens, this also results in the loss of potential information from those tokens. To tackle these issues, we propose a novel token pruning method that retains information from non-crucial tokens by merging them with more crucial tokens, thereby mitigating the impact of pruning on model performance. Crucial and non-crucial tokens are identified by their importance scores and merged based on similarity scores. Furthermore, multi-scale features are exploited to represent images, which are fused prior to token pruning to produce richer feature representations. Importantly, our method can be seamlessly integrated with various ViTs, enhancing their adaptability. Experimental evidence substantiates the efficacy of our approach in reducing the influence of token pruning on model performance. For instance, on the ImageNet dataset, it achieves a remarkable 33% reduction in computational costs while only incurring a 0.1% decrease in accuracy on DeiT-S

A Novel Spatio-Temporal Data Storage and Index Method for ARM-Based Hadoop Server

This project is supported by Science and Technology Development Plan of Jilin Province (20140204010SF) and Chinese National Natural Science Foundation (61472159). WP is supported by the PECE bursary from The Scottish Informatics and Computer Science Alliance (SICSA).Postprin

A General Framework for Accelerating Swarm Intelligence Algorithms on FPGAs, GPUs and Multi-core CPUs

Swarm intelligence algorithms (SIAs) have demonstrated excellent performance when solving optimization problems including many real-world problems. However, because of their expensive computational cost for some complex problems, SIAs need to be accelerated effectively for better performance. This paper presents a high-performance general framework to accelerate SIAs (FASI). Different from the previous work which accelerate SIAs through enhancing the parallelization only, FASI considers both the memory architectures of hardware platforms and the dataflow of SIAs, and it reschedules the framework of SIAs as a converged dataflow to improve the memory access efficiency. FASI achieves higher acceleration ability by matching the algorithm framework to the hardware architectures. We also design deep optimized structures of the parallelization and convergence of FASI based on the characteristics of specific hardware platforms. We take the quantum behaved particle swarm optimization algorithm (QPSO) as a case to evaluate FASI. The results show that FASI improves the throughput of SIAs and provides better performance through optimizing the hardware implementations. In our experiments, FASI achieves a maximum of 290.7Mbit/s throughput which is higher than several existing systems, and FASI on FPGAs achieves a better speedup than that on GPUs and multi-core CPUs. FASI is up to 123 times and not less than 1.45 times faster in terms of optimization time on Xilinx Kintex Ultrascale xcku040 when compares to Intel Core i7-6700 CPU/ NVIDIA GTX1080 GPU. Finally, we compare the differences of deploying FASI on hardware platforms and provide some guidelines for promoting the acceleration performance according to the hardware architectures

Pattern Classification and PSO Optimal Weights Based Sky Images Cloud Motion Speed Calculation Method for Solar PV Power Forecasting

The motion of cloud over a photovoltaic (PV) power station will directly cause the change of solar irradiance, which indirectly affects the prediction of minute-level PV power. Therefore, the calculation of cloud motion speed is very crucial for PV power forecasting. However, due to the influence of complex cloud motion process, it is very difficult to achieve accurate result using a single traditional algorithm. In order to improve the computation accuracy, a pattern classification and particle swarm optimization optimal weights based sky images cloud motion speed calculation method for solar PV power forecasting (PCPOW) is proposed. The method consists of two parts. First, we use a k-means clustering method and texture features based on a gray-level co-occurrence matrix to classify the clouds. Second, for different cloud classes, we build the corresponding combined calculation model to obtain cloud motion speed. Real data recorded at Yunnan Electric Power Research Institute are used for simulation; the results show that the cloud classification and optimal combination model are effective, and the PCPOW can improve the accuracy of displacement calculation.© 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.fi=vertaisarvioitu|en=peerReviewed

Pomegranate seed oil stabilized with ovalbumin glycated by inulin: Physicochemical stability and oxidative stability

Pomegranate seed oil is rich of conjugated fatty acids which are highly appealing for a variety of applications in food industry. In this research, ovalbumin (OVA) and ovalbumin-inulin glycoconjugates with different Maillard reaction times were used to stabilize pomegranate seed oil emulsions and their impact on physicochemical stability and oxidative stability of the products was investigated. The OVA-inulin glycoconjugate produced on 10th day of Maillard reaction has exhibited significantly higher conjugation efficiency, lower surface hydrophobicity and lower surface tension than other glycoconjugates. The secondary conformation of OVA and conjugates determined by far-UV circular dichroism spectroscopy has remarkably changed. The reduction in intensity of Trp-fluorescence observed in glycated proteins with inulin indicated that the glycation affected partially the side chains of protein in tertiary structure through the Maillard reaction without great disruption of native structure. The emulsion stabilized by OVA-inulin glycoconjugate obtained by 10 days Maillard reaction has shown the best physicochemical stability. Compared with the OVA emulsion, the oxidative stability of the glycated OVA emulsion system was significantly improved (p < 0.05). Fatty acid profile results also confirmed that OVA-inulin glycoconjugates were able to prevent the pomegranate seed oil from oxidation. It is suggested that the inulin attached to OVA by glycation played a vital role in physicochemical stability and oxidative stability of pomegranate seed oil emulsions

Comprehensive analysis of passive generation of parabolic similaritons in tapered hydrogenated amorphous silicon photonic wires

Parabolic pulses have important applications in both basic and applied sciences, such as high power optical amplification, optical communications, all-optical signal processing, etc. The generation of parabolic similaritons in tapered hydrogenated amorphous silicon photonic wires at telecom (λ~1550 nm) and mid-IR (λ≥2100 nm) wavelengths is demonstrated and analyzed. The self-similar theory of parabolic pulse generation in passive waveguides with increasing nonlinearity is presented. A generalized nonlinear Schrödinger equation is used to describe the coupled dynamics of optical field in the tapered hydrogenated amorphous silicon photonic wires with either decreasing dispersion or increasing nonlinearity. The impacts of length dependent higher-order effects, linear and nonlinear losses including two-photon absorption, and photongenerated free carriers, on the pulse evolutions are characterized. Numerical simulations show that initial Gaussian pulses will evolve into the parabolic pulses in the waveguide taper designed

Transformational leadership and trust in leadership impacts on employee commitment

Purpose -This study explores the effects of leadership style and trust in leadership on employees' affective commitment in the context of a global pandemic. Design/methodology/approach -A total of 580 valid questionnaires were collected online, targeting hospitality and tourism employees working from home during a particular period of the COVID-19 Coronavirus crisis. Structural equation modeling was used to analyze the data with AMOS software. Findings -The findings indicated that perceived transformational leadership was a positive predictor of trust in leadership and affective commitment. In addition to the positive contribution to commitment, trust in leadership also mediated the relationship between transformational leadership and organizational commitment. Originality/value -The current study contributes to the literature on leadership and organizational commitment. The results of this study may provide a valuable guide to organizations, leaders, and young employees

Mid-infrared octave-spanning supercontinuum and frequency comb generation in a suspended germanium-membrane ridge waveguide

Stable octave-spanning supercontinuum (SC) in the mid-infrared (MIR) region finds extensive applications in spectroscopy, metrology, biochemistry, etc. The absorption of conventional silicon- or silicon oxide-dominated nonlinear media makes SC generation in MIR region technically challenging. In this paper, we propose ultra-broadband MIR-SC generation using a suspended germanium-membrane ridge waveguide. We theoretically showed that when pump pulses centered at 4.8 um with pulse width at 180 fs and peak power at 800 W are injected into a 4-mm long proposed ridge waveguide, the SC generated ranges from 1.96 ~ 12 um (about 2.6 octaves), extending deep into the “fingerprint” region. The first-order coherence is calculated to confirm the stability of the generated SC. The performance of the SC-based frequency comb is also investigated by assuming a 100-pulses pump source at a repetition rate of 100 KHz

Mid-Infrared Self-Similar Compression of Picosecond Pulse in an Inversely Tapered Silicon Ridge Waveguide

On chip high quality and high degree pulse compression is desirable in the realization of integrated ultrashort pulse sources, which are important for nonlinear photonics and spectroscopy. In this paper, we design a simple inversely tapered silicon ridge waveguide with exponentially decreasing dispersion profile along the propagation direction, and numerically investigate self-similar pulse compression of the fundamental soliton within the mid-infrared spectral region. When higher-order dispersion (HOD), higher-order nonlinearity (HON), losses (α), and variation of the Kerr nonlinear coefficient γ(z) are considered in the extended nonlinear Schrödinger equation, a 1 ps input pulse at the wavelength of 2490 nm is successfully compressed to 57.29 fs in only 5.1-cm of propagation, along with a compression factor Fc of 17.46. We demonstrated that the impacts of HOD and HON are minor on the pulse compression process, compared with that of α and variation of γ(z). Our research results provide a promising solution to realize integrated mid-infrared ultrashort pulse sources