Adversarial Attacks on Deep Neural Networks for Time Series Classification

Time Series Classification (TSC) problems are encountered in many real life data mining tasks ranging from medicine and security to human activity recognition and food safety. With the recent success of deep neural networks in various domains such as computer vision and natural language processing, researchers started adopting these techniques for solving time series data mining problems. However, to the best of our knowledge, no previous work has considered the vulnerability of deep learning models to adversarial time series examples, which could potentially make them unreliable in situations where the decision taken by the classifier is crucial such as in medicine and security. For computer vision problems, such attacks have been shown to be very easy to perform by altering the image and adding an imperceptible amount of noise to trick the network into wrongly classifying the input image. Following this line of work, we propose to leverage existing adversarial attack mechanisms to add a special noise to the input time series in order to decrease the network's confidence when classifying instances at test time. Our results reveal that current state-of-the-art deep learning time series classifiers are vulnerable to adversarial attacks which can have major consequences in multiple domains such as food safety and quality assurance.Comment: Accepted at IJCNN 201

Neuro-Fuzzy Based Intelligent Approaches to Nonlinear System Identification and Forecasting

Nearly three decades back nonlinear system identification consisted of several ad-hoc approaches, which were restricted to a very limited class of systems. However, with the advent of the various soft computing methodologies like neural networks and the fuzzy logic combined with optimization techniques, a wider class of systems can be handled at present. Complex systems may be of diverse characteristics and nature. These systems may be linear or nonlinear, continuous or discrete, time varying or time invariant, static or dynamic, short term or long term, central or distributed, predictable or unpredictable, ill or well defined. Neurofuzzy hybrid modelling approaches have been developed as an ideal technique for utilising linguistic values and numerical data. This Thesis is focused on the development of advanced neurofuzzy modelling architectures and their application to real case studies. Three potential requirements have been identified as desirable characteristics for such design: A model needs to have minimum number of rules; a model needs to be generic acting either as Multi-Input-Single-Output (MISO) or Multi-Input-Multi-Output (MIMO) identification model; a model needs to have a versatile nonlinear membership function. Initially, a MIMO Adaptive Fuzzy Logic System (AFLS) model which incorporates a prototype defuzzification scheme, while utilising an efficient, compared to the Takagi–Sugeno–Kang (TSK) based systems, fuzzification layer has been developed for the detection of meat spoilage using Fourier transform infrared (FTIR) spectroscopy. The identification strategy involved not only the classification of beef fillet samples in their respective quality class (i.e. fresh, semi-fresh and spoiled), but also the simultaneous prediction of their associated microbiological population directly from FTIR spectra. In the case of AFLS, the number of memberships for each input variable was directly associated to the number of rules, hence, the “curse of dimensionality” problem was significantly reduced. Results confirmed the advantage of the proposed scheme against Adaptive Neurofuzzy Inference System (ANFIS), Multilayer Perceptron (MLP) and Partial Least Squares (PLS) techniques used in the same case study. In the case of MISO systems, the TSK based structure, has been utilized in many neurofuzzy systems, like ANFIS. At the next stage of research, an Adaptive Fuzzy Inference Neural Network (AFINN) has been developed for the monitoring the spoilage of minced beef utilising multispectral imaging information. This model, which follows the TSK structure, incorporates a clustering pre-processing stage for the definition of fuzzy rules, while its final fuzzy rule base is determined by competitive learning. In this specific case study, AFINN model was also able to predict for the first time in the literature, the beef’s temperature directly from imaging information. Results again proved the superiority of the adopted model. By extending the line of research and adopting specific design concepts from the previous case studies, the Asymmetric Gaussian Fuzzy Inference Neural Network (AGFINN) architecture has been developed. This architecture has been designed based on the above design principles. A clustering preprocessing scheme has been applied to minimise the number of fuzzy rules. AGFINN incorporates features from the AFLS concept, by having the same number of rules as well as fuzzy memberships. In spite of the extensive use of the standard symmetric Gaussian membership functions, AGFINN utilizes an asymmetric function acting as input linguistic node. Since the asymmetric Gaussian membership function’s variability and flexibility are higher than the traditional one, it can partition the input space more effectively. AGFINN can be built either as an MISO or as an MIMO system. In the MISO case, a TSK defuzzification scheme has been implemented, while two different learning algorithms have been implemented. AGFINN has been tested on real datasets related to electricity price forecasting for the ISO New England Power Distribution System. Its performance was compared against a number of alternative models, including ANFIS, AFLS, MLP and Wavelet Neural Network (WNN), and proved to be superior. The concept of asymmetric functions proved to be a valid hypothesis and certainly it can find application to other architectures, such as in Fuzzy Wavelet Neural Network models, by designing a suitable flexible wavelet membership function. AGFINN’s MIMO characteristics also make the proposed architecture suitable for a larger range of applications/problems

Computer image analysis for intramuscular fat segmentation in dry-cured ham slices using convolutional neural networks

Determination of intramuscular fat (IMF) content in dry cured meats is critical because it affects the sensory quality and consumer's acceptability. Recently, deep learning has become one of the most promising techniques in machine learning for image analysis. However, few applications in food products are found in the literature. This study presents the application of deep learning for the detection of intramuscular fat (IMF) in images of slices of dry cured ham. 8 convolutional neural networks (CNNs) have been studied and compared using segmented images (252 for training, 61 for validation and 62 for testing). The performance was compared to other simple CNNs. CNNs were able to segment IMF with an overall pixel accuracy of 0.99 and a recall and precision rates for fat near 0.82 and 0.84, respectively, using a limited number of training images. However, performance is affected by the quality of the ground truth due to the difficulty of labelling correctly pixels.info:eu-repo/semantics/acceptedVersio

Simulation of site-specific irrigation control strategies with sparse input data

Crop and irrigation water use efficiencies may be improved by managing irrigation application timing and volumes using physical and agronomic principles. However, the crop water requirement may be spatially variable due to different soil properties and genetic variations in the crop across the field. Adaptive control strategies can be used to locally control water applications in response to in-field temporal and spatial variability with the aim of maximising both crop development and water use efficiency. A simulation framework ‘VARIwise’ has been created to aid the development, evaluation and management of spatially and temporally varied adaptive irrigation control strategies (McCarthy et al., 2010). VARIwise enables alternative control strategies to be simulated with different crop and environmental conditions and at a range of spatial resolutions. An iterative learning controller and model predictive controller have been implemented in VARIwise to improve the irrigation of cotton. The iterative learning control strategy involves using the soil moisture response to the previous irrigation volume to adjust the applied irrigation volume applied at the next irrigation event. For field implementation this controller has low data requirements as only soil moisture data is required after each irrigation event. In contrast, a model predictive controller has high data requirements as measured soil and plant data are required at a high spatial resolution in a field implementation. Model predictive control involves using a calibrated model to determine the irrigation application and/or timing which results in the highest predicted yield or water use efficiency. The implementation of these strategies is described and a case study is presented to demonstrate the operation of the strategies with various levels of data availability. It is concluded that in situations of sparse data, the iterative learning controller performs significantly better than a model predictive controller

Air pollution and livestock production

The air in a livestock farming environment contains high concentrations of dust particles and gaseous pollutants. The total inhalable dust can enter the nose and mouth during normal breathing and the thoracic dust can reach into the lungs. However, it is the respirable dust particles that can penetrate further into the gas-exchange region, making it the most hazardous dust component. Prolonged exposure to high concentrations of dust particles can lead to respiratory health issues for both livestock and farming staff. Ammonia, an example of a gaseous pollutant, is derived from the decomposition of nitrous compounds. Increased exposure to ammonia may also have an effect on the health of humans and livestock. There are a number of technologies available to ensure exposure to these pollutants is minimised. Through proactive means, (the optimal design and management of livestock buildings) air quality can be improved to reduce the likelihood of risks associated with sub-optimal air quality. Once air problems have taken hold, other reduction methods need to be applied utilising a more reactive approach. A key requirement for the control of concentration and exposure of airborne pollutants to an acceptable level is to be able to conduct real-time measurements of these pollutants. This paper provides a review of airborne pollution including methods to both measure and control the concentration of pollutants in livestock buildings

OCM 2021 - Optical Characterization of Materials : Conference Proceedings

The state of the art in the optical characterization of materials is advancing rapidly. New insights have been gained into the theoretical foundations of this research and exciting developments have been made in practice, driven by new applications and innovative sensor technologies that are constantly evolving. The great success of past conferences proves the necessity of a platform for presentation, discussion and evaluation of the latest research results in this interdisciplinary field

OCM 2021 - Optical Characterization of Materials

The state of the art in the optical characterization of materials is advancing rapidly. New insights have been gained into the theoretical foundations of this research and exciting developments have been made in practice, driven by new applications and innovative sensor technologies that are constantly evolving. The great success of past conferences proves the necessity of a platform for presentation, discussion and evaluation of the latest research results in this interdisciplinary field

Visible hyperspectral imaging for predicting intra-muscular fat content from sheep carcasses

Intramuscular fat (IMF) content plays a key role in the quality attributes of meat, such as sensory properties and health considerations. The tenderness, flavour and juiciness of meat are examples of sensory attributes influenced by IMF content. Traditionally, IMF content in meat was determined using destructive, time consuming and at times unsuitable methods in industry applications. However, with recent advancement of technology, there has been an interest in exlporing ways to ascertain meat quality without damage. Hyperspectral imaging analysis is an emerging technology that combines the use of spectroscopy and computer imaging analysis to obtain both the spectral and spatial information of objects of interest. Hyperspectral imaging was initially developed for remote sensing, but has recently emerged as powerful tool for non-destructive analysis of quality in the food industry and has had very accurate results in the prediction of meat qualities such as IMF content. In this thesis, we use a data set of 101 hyperspectral images of sheep carcasses to investigate the ability of multivariate statistical methods to accurately predict IMF content