The Effects of JPEG and JPEG2000 Compression on Attacks using Adversarial Examples

Adversarial examples are known to have a negative effect on the performance of classifiers which have otherwise good performance on undisturbed images. These examples are generated by adding non-random noise to the testing samples in order to make classifier misclassify the given data. Adversarial attacks use these intentionally generated examples and they pose a security risk to the machine learning based systems. To be immune to such attacks, it is desirable to have a pre-processing mechanism which removes these effects causing misclassification while keeping the content of the image. JPEG and JPEG2000 are well-known image compression techniques which suppress the high-frequency content taking the human visual system into account. JPEG has been also shown to be an effective method for reducing adversarial noise. In this paper, we propose applying JPEG2000 compression as an alternative and systematically compare the classification performance of adversarial images compressed using JPEG and JPEG2000 at different target PSNR values and maximum compression levels. Our experiments show that JPEG2000 is more effective in reducing adversarial noise as it allows higher compression rates with less distortion and it does not introduce blocking artifacts

Wavelet transform - artificial neural network receiver with adaptive equalisation for a diffuse indoor optical wireless OOK link

This paper presents an alternative approach for signal detection and equalization using the continuous wavelet transform (CWT) and the artificial neural network (ANN) in diffuse indoor optical wireless links (OWL). The wavelet analysis is used for signal preprocessing (feature extraction) and the ANN for signal detection. Traditional receiver architectures based on matched filter (MF) experience significant performance degradation in the presence of artificial light interference (ALI) and multipath induced intersymbol interference (ISI). The proposed receiver structure reduces the effect of ALI and ISI by selecting a particular scale of CWT that corresponds to the desired signal and classifying the signal into binary 1 and 0 based on an observation vector. By selecting particular scales corresponding to the signal, the effect of ALI is reduced. We show that there is little variation when using 30 and 5 neurons in the first layer, with one layer ANN model showing a consistently worse BER performance than other models, whilst the 15 neuron model show some behaviour anomalies from a BER of approximately 10-3. The simulation results show that the Wavelet-ANN architecture outperforms the traditional MF based receiver even with the filter is matched to the ISI affected pulse shape. The Wavelet-ANN receiver is also capable of providing a bit error rate (BER) performance comparable to the equalized forms of traditional receiver structure

Bidirectional-Convolutional LSTM Based Spectral-Spatial Feature Learning for Hyperspectral Image Classification

This paper proposes a novel deep learning framework named bidirectional-convolutional long short term memory (Bi-CLSTM) network to automatically learn the spectral-spatial feature from hyperspectral images (HSIs). In the network, the issue of spectral feature extraction is considered as a sequence learning problem, and a recurrent connection operator across the spectral domain is used to address it. Meanwhile, inspired from the widely used convolutional neural network (CNN), a convolution operator across the spatial domain is incorporated into the network to extract the spatial feature. Besides, to sufficiently capture the spectral information, a bidirectional recurrent connection is proposed. In the classification phase, the learned features are concatenated into a vector and fed to a softmax classifier via a fully-connected operator. To validate the effectiveness of the proposed Bi-CLSTM framework, we compare it with several state-of-the-art methods, including the CNN framework, on three widely used HSIs. The obtained results show that Bi-CLSTM can improve the classification performance as compared to other methods

The hippocampus and cerebellum in adaptively timed learning, recognition, and movement

The concepts of declarative memory and procedural memory have been used to distinguish two basic types of learning. A neural network model suggests how such memory processes work together as recognition learning, reinforcement learning, and sensory-motor learning take place during adaptive behaviors. To coordinate these processes, the hippocampal formation and cerebellum each contain circuits that learn to adaptively time their outputs. Within the model, hippocampal timing helps to maintain attention on motivationally salient goal objects during variable task-related delays, and cerebellar timing controls the release of conditioned responses. This property is part of the model's description of how cognitive-emotional interactions focus attention on motivationally valued cues, and how this process breaks down due to hippocampal ablation. The model suggests that the hippocampal mechanisms that help to rapidly draw attention to salient cues could prematurely release motor commands were not the release of these commands adaptively timed by the cerebellum. The model hippocampal system modulates cortical recognition learning without actually encoding the representational information that the cortex encodes. These properties avoid the difficulties faced by several models that propose a direct hippocampal role in recognition learning. Learning within the model hippocampal system controls adaptive timing and spatial orientation. Model properties hereby clarify how hippocampal ablations cause amnesic symptoms and difficulties with tasks which combine task delays, novelty detection, and attention towards goal objects amid distractions. When these model recognition, reinforcement, sensory-motor, and timing processes work together, they suggest how the brain can accomplish conditioning of multiple sensory events to delayed rewards, as during serial compound conditioning.Air Force Office of Scientific Research (F49620-92-J-0225, F49620-86-C-0037, 90-0128); Advanced Research Projects Agency (ONR N00014-92-J-4015); Office of Naval Research (N00014-91-J-4100, N00014-92-J-1309, N00014-92-J-1904); National Institute of Mental Health (MH-42900

A study of discrete wavelet transform based denoising to reduce the effect of artificial light interferences for indoor optical wireless communication

The optical power penalty (OPP) due to the artificial light interferences (ALIs) can be significantly high in an indoor optical wireless communication (OWC) channel making such link practically infeasible. A discrete wavelet transform (DWT) is an effective technique in reducing the ALI effects. The DWT has the advantage over the high pass filtering (HPF) to reduce ALI in terms of complexity and performance. In this paper, a comprehensive study of the DWT based denoising for the on-off keying (OOK), pulse position modulation (PPM) and digital pulse interval modulation (DPIM) is provided. The OPPs due to ALIs and DWT based denoising for these modulation techniques are presented

Performance of the wavelet-transform-neural network based receiver for DPIM in diffuse indoor optical wireless links in presence of artificial light interference

Artificial neural network (ANN) has application in communication engineering in diverse areas such as channel equalization, channel modeling, error control code because of its capability of nonlinear processing, adaptability, and parallel processing. On the other hand, wavelet transform (WT) with both the time and the frequency resolution provides the exact representation of signal in both domains. Applying these signal processing tools for channel compensation and noise reduction can provide an enhanced performance compared to the traditional tools. In this paper, the slot error rate (SER) performance of digital pulse interval modulation (DPIM) in diffuse indoor optical wireless (OW) links subjected to the artificial light interference (ALI) is reported with new receiver structure based on the discrete WT (DWT) and ANN. Simulation results show that the DWT-ANN based receiver is very effective in reducing the effect of multipath induced inter-symbol interference (ISI) and ALI