Adaptive spatial image steganography and steganalysis using perceptual modelling and machine learning

Image steganography is a method for communicating secret messages under the cover images. A sender will embed the secret messages into the cover images according to an algorithm, and then the resulting image will be sent to the receiver. The receiver can extract the secret messages with the predefined algorithm. To counter this kind of technique, image steganalysis is proposed to detect the presence of secret messages. After many years of development, current image steganography uses the adaptive algorithm for embedding the secrets, which automatically finds the complex area in the cover source to avoid being noticed. Meanwhile, image steganalysis has also been advanced to universal steganalysis, which does not require the knowledge of the steganographic algorithm. With the development of the computational hardware, i.e., Graphical Processing Units (GPUs), some computational expensive techniques are now available, i.e., Convolutional Neural Networks (CNNs), which bring a large improvement in the detection tasks in image steganalysis. To defend against the attacks, new techniques are also being developed to improve the security of image steganography, these include designing more scientific cost functions, the key in adaptive steganography, and generating stego images from the knowledge of the CNNs. Several contributions are made for both image steganography and steganalysis in this thesis. Firstly, inspired by the Ranking Priority Profile (RPP), a new cost function for adaptive image steganography is proposed, which uses the two-dimensional Singular Spectrum Analysis (2D-SSA) and Weighted Median Filter (WMF) in the design. The RPP mainly includes three rules, i.e., the Complexity-First rule, the Clustering rule and the Spreading rule, to design a cost function. The 2D-SSA is employed in selecting the key components and clustering the embedding positions, which follows the Complexity-First rule and the Clustering rule. Also, the Spreading rule is followed to smooth the resulting image produced by 2D-SSA with WMF. The proposed algorithm has improved performance over four benchmarking approaches against non-shared selection channel attacks. It also provides comparable performance in selection-channel-aware scenarios, where the best results are observed when the relative payload is 0.3 bpp or larger. The approach is much faster than other model-based methods. Secondly, for image steganalysis, to tackle more complex datasets that are close to the real scenarios and to push image steganalysis further to real-life applications, an Enhanced Residual Network with self-attention ability, i.e., ERANet, is proposed. By employing a more mathematically sophisticated way to extract more effective features in the images and the global self-Attention technique, the ERANet can further capture the stego signal in the deeper layers, hence it is suitable for the more complex situations in the new datasets. The proposed Enhanced Low-Level Feature Representation Module can be easily mounted on other CNNs in selecting the most representative features. Although it comes with a slightly extra computational cost, comprehensive experiments on the BOSSbase and ALASKA#2 datasets have demonstrated the effectiveness of the proposed methodology. Lastly, for image steganography, with the knowledge from the CNNs, a novel postcost-optimization algorithm is proposed. Without modifying the original stego image and the original cost function of the steganography, and no need for training a Generative Adversarial Network (GAN), the proposed method mainly uses the gradient maps from a well-trained CNN to represent the cost, where the original cost map of the steganography is adopted to indicate the embedding positions. This method will smooth the gradient maps before adjusting the cost, which solves the boundary problem of the CNNs having multiple subnets. Extensive experiments have been carried out to validate the effectiveness of the proposed method, which provides state-of-the-art performance. In addition, compared to existing work, the proposed method is effcient in computing time as well. In short, this thesis has made three major contributions to image steganography and steganalysis by using perceptual modelling and machine learning. A novel cost function and a post-cost-optimization function have been proposed for adaptive spatial image steganography, which helps protect the secret messages. For image steganalysis, a new CNN architecture has also been proposed, which utilizes multiple techniques for providing state of-the-art performance. Future directions are also discussed for indicating potential research.Image steganography is a method for communicating secret messages under the cover images. A sender will embed the secret messages into the cover images according to an algorithm, and then the resulting image will be sent to the receiver. The receiver can extract the secret messages with the predefined algorithm. To counter this kind of technique, image steganalysis is proposed to detect the presence of secret messages. After many years of development, current image steganography uses the adaptive algorithm for embedding the secrets, which automatically finds the complex area in the cover source to avoid being noticed. Meanwhile, image steganalysis has also been advanced to universal steganalysis, which does not require the knowledge of the steganographic algorithm. With the development of the computational hardware, i.e., Graphical Processing Units (GPUs), some computational expensive techniques are now available, i.e., Convolutional Neural Networks (CNNs), which bring a large improvement in the detection tasks in image steganalysis. To defend against the attacks, new techniques are also being developed to improve the security of image steganography, these include designing more scientific cost functions, the key in adaptive steganography, and generating stego images from the knowledge of the CNNs. Several contributions are made for both image steganography and steganalysis in this thesis. Firstly, inspired by the Ranking Priority Profile (RPP), a new cost function for adaptive image steganography is proposed, which uses the two-dimensional Singular Spectrum Analysis (2D-SSA) and Weighted Median Filter (WMF) in the design. The RPP mainly includes three rules, i.e., the Complexity-First rule, the Clustering rule and the Spreading rule, to design a cost function. The 2D-SSA is employed in selecting the key components and clustering the embedding positions, which follows the Complexity-First rule and the Clustering rule. Also, the Spreading rule is followed to smooth the resulting image produced by 2D-SSA with WMF. The proposed algorithm has improved performance over four benchmarking approaches against non-shared selection channel attacks. It also provides comparable performance in selection-channel-aware scenarios, where the best results are observed when the relative payload is 0.3 bpp or larger. The approach is much faster than other model-based methods. Secondly, for image steganalysis, to tackle more complex datasets that are close to the real scenarios and to push image steganalysis further to real-life applications, an Enhanced Residual Network with self-attention ability, i.e., ERANet, is proposed. By employing a more mathematically sophisticated way to extract more effective features in the images and the global self-Attention technique, the ERANet can further capture the stego signal in the deeper layers, hence it is suitable for the more complex situations in the new datasets. The proposed Enhanced Low-Level Feature Representation Module can be easily mounted on other CNNs in selecting the most representative features. Although it comes with a slightly extra computational cost, comprehensive experiments on the BOSSbase and ALASKA#2 datasets have demonstrated the effectiveness of the proposed methodology. Lastly, for image steganography, with the knowledge from the CNNs, a novel postcost-optimization algorithm is proposed. Without modifying the original stego image and the original cost function of the steganography, and no need for training a Generative Adversarial Network (GAN), the proposed method mainly uses the gradient maps from a well-trained CNN to represent the cost, where the original cost map of the steganography is adopted to indicate the embedding positions. This method will smooth the gradient maps before adjusting the cost, which solves the boundary problem of the CNNs having multiple subnets. Extensive experiments have been carried out to validate the effectiveness of the proposed method, which provides state-of-the-art performance. In addition, compared to existing work, the proposed method is effcient in computing time as well. In short, this thesis has made three major contributions to image steganography and steganalysis by using perceptual modelling and machine learning. A novel cost function and a post-cost-optimization function have been proposed for adaptive spatial image steganography, which helps protect the secret messages. For image steganalysis, a new CNN architecture has also been proposed, which utilizes multiple techniques for providing state of-the-art performance. Future directions are also discussed for indicating potential research

Persistent Homology Tools for Image Analysis

Topological Data Analysis (TDA) is a new field of mathematics emerged rapidly since the first decade of the century from various works of algebraic topology and geometry. The goal of TDA and its main tool of persistent homology (PH) is to provide topological insight into complex and high dimensional datasets. We take this premise onboard to get more topological insight from digital image analysis and quantify tiny low-level distortion that are undetectable except possibly by highly trained persons. Such image distortion could be caused intentionally (e.g. by morphing and steganography) or naturally in abnormal human tissue/organ scan images as a result of onset of cancer or other diseases. The main objective of this thesis is to design new image analysis tools based on persistent homological invariants representing simplicial complexes on sets of pixel landmarks over a sequence of distance resolutions. We first start by proposing innovative automatic techniques to select image pixel landmarks to build a variety of simplicial topologies from a single image. Effectiveness of each image landmark selection demonstrated by testing on different image tampering problems such as morphed face detection, steganalysis and breast tumour detection. Vietoris-Rips simplicial complexes constructed based on the image landmarks at an increasing distance threshold and topological (homological) features computed at each threshold and summarized in a form known as persistent barcodes. We vectorise the space of persistent barcodes using a technique known as persistent binning where we demonstrated the strength of it for various image analysis purposes. Different machine learning approaches are adopted to develop automatic detection of tiny texture distortion in many image analysis applications. Homological invariants used in this thesis are the 0 and 1 dimensional Betti numbers. We developed an innovative approach to design persistent homology (PH) based algorithms for automatic detection of the above described types of image distortion. In particular, we developed the first PH-detector of morphing attacks on passport face biometric images. We shall demonstrate significant accuracy of 2 such morph detection algorithms with 4 types of automatically extracted image landmarks: Local Binary patterns (LBP), 8-neighbour super-pixels (8NSP), Radial-LBP (R-LBP) and centre-symmetric LBP (CS-LBP). Using any of these techniques yields several persistent barcodes that summarise persistent topological features that help gaining insights into complex hidden structures not amenable by other image analysis methods. We shall also demonstrate significant success of a similarly developed PH-based universal steganalysis tool capable for the detection of secret messages hidden inside digital images. We also argue through a pilot study that building PH records from digital images can differentiate breast malignant tumours from benign tumours using digital mammographic images. The research presented in this thesis creates new opportunities to build real applications based on TDA and demonstrate many research challenges in a variety of image processing/analysis tasks. For example, we describe a TDA-based exemplar image inpainting technique (TEBI), superior to existing exemplar algorithm, for the reconstruction of missing image regions

Recent Application in Biometrics

In the recent years, a number of recognition and authentication systems based on biometric measurements have been proposed. Algorithms and sensors have been developed to acquire and process many different biometric traits. Moreover, the biometric technology is being used in novel ways, with potential commercial and practical implications to our daily activities. The key objective of the book is to provide a collection of comprehensive references on some recent theoretical development as well as novel applications in biometrics. The topics covered in this book reflect well both aspects of development. They include biometric sample quality, privacy preserving and cancellable biometrics, contactless biometrics, novel and unconventional biometrics, and the technical challenges in implementing the technology in portable devices. The book consists of 15 chapters. It is divided into four sections, namely, biometric applications on mobile platforms, cancelable biometrics, biometric encryption, and other applications. The book was reviewed by editors Dr. Jucheng Yang and Dr. Norman Poh. We deeply appreciate the efforts of our guest editors: Dr. Girija Chetty, Dr. Loris Nanni, Dr. Jianjiang Feng, Dr. Dongsun Park and Dr. Sook Yoon, as well as a number of anonymous reviewers

Antennas and Electromagnetics Research via Natural Language Processing.

Advanced techniques for performing natural language processing (NLP) are being utilised to devise a pioneering methodology for collecting and analysing data derived from scientific literature. Despite significant advancements in automated database generation and analysis within the domains of material chemistry and physics, the implementation of NLP techniques in the realms of metamaterial discovery, antenna design, and wireless communications remains at its early stages. This thesis proposes several novel approaches to advance research in material science. Firstly, an NLP method has been developed to automatically extract keywords from large-scale unstructured texts in the area of metamaterial research. This enables the uncovering of trends and relationships between keywords, facilitating the establishment of future research directions. Additionally, a trained neural network model based on the encoder-decoder Long Short-Term Memory (LSTM) architecture has been developed to predict future research directions and provide insights into the influence of metamaterials research. This model lays the groundwork for developing a research roadmap of metamaterials. Furthermore, a novel weighting system has been designed to evaluate article attributes in antenna and propagation research, enabling more accurate assessments of impact of each scientific publication. This approach goes beyond conventional numeric metrics to produce more meaningful predictions. Secondly, a framework has been proposed to leverage text summarisation, one of the primary NLP tasks, to enhance the quality of scientific reviews. It has been applied to review recent development of antennas and propagation for body-centric wireless communications, and the validation has been made available for comparison with well-referenced datasets for text summarisation. Lastly, the effectiveness of automated database building in the domain of tunable materials and their properties has been presented. The collected database will use as an input for training a surrogate machine learning model in an iterative active learning cycle. This model will be utilised to facilitate high-throughput material processing, with the ultimate goal of discovering novel materials exhibiting high tunability. The approaches proposed in this thesis will help to accelerate the discovery of new materials and enhance their applications in antennas, which has the potential to transform electromagnetic material research

Cyber Security Politics

This book examines new and challenging political aspects of cyber security and presents it as an issue defined by socio-technological uncertainty and political fragmentation. Structured along two broad themes and providing empirical examples for how socio-technical changes and political responses interact, the first part of the book looks at the current use of cyber space in conflictual settings, while the second focuses on political responses by state and non-state actors in an environment defined by uncertainties. Within this, it highlights four key debates that encapsulate the complexities and paradoxes of cyber security politics from a Western perspective – how much political influence states can achieve via cyber operations and what context factors condition the (limited) strategic utility of such operations; the role of emerging digital technologies and how the dynamics of the tech innovation process reinforce the fragmentation of the governance space; how states attempt to uphold stability in cyberspace and, more generally, in their strategic relations; and how the shared responsibility of state, economy, and society for cyber security continues to be re-negotiated in an increasingly trans-sectoral and transnational governance space. This book will be of much interest to students of cyber security, global governance, technology studies, and international relations

2022-2023 Catalog

The 2022-2023 Governors State University Undergraduate and Graduate Catalog is a comprehensive listing of current information regarding:Degree RequirementsCourse OfferingsUndergraduate and Graduate Rules and Regulation

An Integrated Immunopeptidomics and Proteogenomics Framework to Discover Non-Canonical Targets for Cancer Immunotherapy

Un élément essentiel de l’immunothérapie appliquée au cancer est l’identification de peptides liant les antigènes des leucocytes humains (HLA) et capables d’induire une puissante réponse T anti-tumorale. La spectrométrie de masse (MS) constitue actuellement la seule méthode non-biaisée permettant une analyse détaillée du panel d’antigènes susceptibles d’être présentés aux lymphocytes T in vivo. L’utilisation de cette méthode en clinique requiert toutefois des améliorations significatives de la méthodologie utilisée lors de l’identification des peptides HLA. Un consortium multidisciplinaire de chercheurs a récemment mis en lumière les problèmes actuellement liés à l’utilisation de la MS en immunopeptidomique, soulignant le besoin de développer de nouvelles méthodes et mettant en évidence le défi que représente la standardisation de l’immuno-purification des molécules HLA. La première partie de cette thèse vise à optimiser les méthodes expérimentales permettant l’extraction des peptides apprêtés aux HLA. L’optimisation de la méthodologie de base a permis des améliorations notables en terme de débit, de reproductibilité, de sensibilité et a permis une purification séquentielle des molécules de HLA de classe I de classe II ainsi que de leurs peptides, à partir de lignées cellulaires ou de tissus. En comparaison avec les méthodes existantes, ce protocole comprend moins d’étapes et permet de limiter la manipulation des échantillons ainsi que le temps de purification. Cette méthode, pour les peptides HLA extraits, a permis d’obtenir des taux de reproductibilité et de sensibilité sans précédents (corrélations de Pearson jusqu'à 0,98 et 0,97 pour les HLA de classe I et de classe II, respectivement). De plus, la faisabilité d’études comparatives robustes a été démontrée à partir d’une lignée cellulaire de cancer de l’ovaire, traitée à l'interféron gamma. En effet, cette nouvelle méthode a mis en évidence des changements quantitatifs et qualitatifs du catalogue de peptides présentés aux HLA. Les résultats obtenus ont mis en avant une augmentation de la présentation de longs ligands chymotryptiques de classe I. Ce phénomène est probablement lié à la modulation de la machinerie de traitement et de présentation des antigènes. Dans cette première partie de thèse, nous avons développé une méthodologie robuste et rationalisée, facilitant la purification des HLA et pouvant être appliquée en recherche fondamentale et translationnelle. Bien que les néoantigènes représentent une cible attractive, des études récentes ont mis en évidence l’existence des antigènes non canoniques. Ces antigènes tumoraux, bien que non mutés, sont aussi spécifiques aux cellules cancéreuses et semblent jouer un rôle important dans l’immunité anti-tumorale. La seconde partie de cette thèse a pour objectif le développement d’une méthodologie d’analyse permettant l’identification ainsi que la validation de ces antigènes particuliers. Les antigènes non canoniques sont d'origine présumée non codante et ne sont, par conséquent, que rarement inclus dans les bases de données des séquences de protéines de référence. De ce fait, ils ne sont généralement pas pris en compte lors des recherches de MS utilisant de telles bases de données. Afin de palier ce problème et de permettre leur identification par MS, le séquençage de l'exome entier, le séquençage de l'ARN sur une population de cellules et sur des cellules uniques, ainsi que le profilage des ribosomes ont été intégrés aux données d’immunopeptidomique. Ainsi, NewAnce, un programme informatique permettant de combiner les données de deux outils de recherche MS en tandem, a été développé afin de calculer le taux d’antigènes non canoniques identifiés comme faux positifs. L’utilisation de NewAnce sur des lignées cellulaires provenant de patients atteints de mélanomes ainsi que sur des biopsies de cancer du poumon a permis l’identification précise de centaines de peptides HLA non classiques, spécifiques aux cellules tumorales et communs à plusieurs patients. Le niveau de confirmation des peptides non canoniques a ensuite été testé à l’aide d’une approche de MS ciblée. Les peptides résultant de ces analyses ont été minutieusement validés pour un des échantillons de mélanome disponibles. De plus, le profilage des ribosomes a révélé que les nouveaux cadres de lecture ouverts, desquels résultent certains de ces peptides non classiques, sont activement traduits. L’évaluation de l’immunogenicité de ces peptides a été évaluée avec des cellules immunitaires autologues et a révélé un épitope immunogène non canonique, provenant d'un cadre de lecture ouvert alternatif du gène ABCB5, un marqueur des cellules souches du mélanome. De manière globale, les résultats obtenus au cours de cette thèse soulignent la possibilité d’inclure ce type d’analyse de proteogénomique dans un protocole d’identification de néoantigènes existant. Cela permettrait d’inclure et prioriser des antigènes tumoraux non classiques et de proposer aux patients en impasse thérapeutique des immunothérapies anti-tumorales personnalisées. -- A central factor to the development of cancer immunotherapy is the identification of clinically relevant human leukocyte antigen (HLA)-bound peptides that elicit potent anti-tumor T cell responses. Mass spectrometry (MS) is the only unbiased technique that captures the in vivo presented HLA repertoire. However, significant improvements in MS-based HLA peptide discovery methodologies are necessary to enable the smooth transition to the clinic. Recently, a consortium of multidisciplinary researchers presented current issues in clinical MS-based immunopeptidomics, highlighting method development and standardization challenges in HLA immunoaffinity purification. The first part of this thesis addresses improvements to the experimental method for HLA peptide extraction. The approach was optimized with several new developments, facilitating high-throughput, reproducible, scalable, and sensitive sequential immunoaffinity purification of HLA class I and class II peptides from cell lines and tissue samples. The method showed increased speed, and reduced sample handling when compared to previous methods. Unprecedented depth and high reproducibility were achieved for the obtained HLA peptides (Pearson correlations up to 0.98 and 0.97 for HLA class I and HLA class II, respectively). Additionally, the feasibility of performing robust comparative studies was demonstrated on an ovarian cancer cell line treated with interferon gamma. Both quantitative and qualitative changes were detected in the cancer HLA repertoire upon treatment. Specifically, a yet unreported and interesting phenomenon was the upregulated presentation of longer and chymotryptic-like HLA class I ligands, likely related to the modulation of the antigen processing and presentation machinery. Taken together, a robust and streamlined framework was built that facilitates peptide purification and its application in basic and translational research. Furthermore, recent studies have shed light that, along with the highly attractive mutated neoantigens, other non-mutated, yet tumor-specific, non-canonical antigens may also play an important role in anti-tumor immunity. Non-canonical antigens are of presumed non-coding origin and not commonly included in protein reference databases, and are therefore typically disregarded in database-dependent MS searches. The second part of this thesis develops an analytical workflow enabling the confident identification and validation of non- canonical tumor antigens. For this purpose, whole exome sequencing, bulk and single-cell RNA sequencing and ribosome profiling were integrated with MS-based immunopeptidomics for personalized non-canonical HLA peptide discovery. A computational module called NewAnce was designed, which combines the results of two tandem MS search tools and implements group-specific false discovery rate calculations to control the error specifically for the non-canonical peptide group. When applied to patient-derived melanoma cell lines and paired lung cancer and normal tissues, NewAnce resulted in the accurate identification of hundreds of shared and tumor-specific non-canonical HLA peptides. Next, the level of non-canonical peptide confirmation was tested in a targeted MS-based approach, and selected non-canonical peptides were extensively validated for one melanoma sample. Furthermore, the novel open reading frames that generate a selection of these non- canonical peptides were found to be actively translated by ribosome profiling. Importantly, these peptides were assessed with autologous immune cells and a non-canonical immunogenic epitope was discovered from an alternative open reading frame of melanoma stem cell marker gene ABCB5. This thesis concludes by highlighting the possibility of incorporating the proteogenomics pipeline into existing neoantigen discovery engines in order to prioritize tumor-specific non-canonical peptides for cancer immunotherapy. -- Maladie très hétérogène et multifactorielle, le cancer représente à ce jour la seconde cause de décès dans le monde. Bien que le système immunitaire soit capable de reconnaître puis d’éliminer les cellules cancéreuses, ces dernières peuvent à leur tour s’adapter et accumuler des mutations leur permettant d’échapper à cette reconnaissance. L’immunothérapie anti-tumorale démontre le rôle clé de l’immunité dans l’éradication des tumeurs. Cependant, ces thérapies prometteuses ne sont efficaces que chez une petite proportion des patients traités. Une étape majeure dans l’établissement d’une réponse immunitaire anti-tumorale est la reconnaissance d’antigènes associés aux tumeurs. Des études récentes ont montré que les antigènes tumoraux issus de régions non-codantes du génome (antigènes non-canoniques) peuvent jouer un rôle clé dans l’induction de réponses immunitaires. Ainsi, l’identification de ces antigènes tumoraux particuliers permettrait de guider le développement d’immunothérapies anti-cancéreuses personnalisées telles que la vaccination ou encore le transfert adoptif de lymphocytes T reconnaissant ces cibles. La spectrométrie de masse (MS) est une technique non biaisée permettant l’identification et l’analyse du répertoire des antigènes présentés in vivo. Cependant, cette technique nécessite d’être optimisée et standardisée afin d’être utilisée en clinique. Ainsi, la première partie de ces travaux de thèse a été dédiée à l’optimisation expérimentale de cette méthode à partir d’échantillons de tissus et de lignées cellulaires. En comparaison avec les protocoles standards, cette technique permet une couverture plus complète, rapide et reproductible du répertoire de peptides apprêtés aux HLA. La seconde partie de cette thèse a été consacrée au développement d’une méthode permettant l’identification d’antigènes tumoraux non-canoniques via le séquençage d’ARN cellulaire, ribosomique et l’utilisation de notre méthode d’immunopeptidomique optimisée. Afin de contrôler l’identification de faux positifs, nous avons élaboré un nouveau module computationnel. Ce module a permis l’identification de plusieurs centaines de peptides-HLA non-canoniques, partagés et spécifiques au mélanome et au cancer du poumon. Le séquençage des ARN ribosomiques a mis en évidence la traduction de nouveaux cadre ouverts de lecture desquels sont traduits de nouveaux peptides non-canoniques. Cette technique nous a permis de mettre en évidence un épitope immunogène issu du gène ABCB5, un marqueur de cellules souches cancéreuses préalablement identifié dans le mélanome. De manière globale, ces travaux de thèse, alliant immunopeptidomique et protéogénomique, ont permis la mise au point d’une méthode expérimentale permettant une meilleure identification d’antigènes tumoraux. Nous espérons que ces résultats amélioreront l’identification et la priorisation de cibles pertinentes pour l’immunothérapie anti-cancéreuse en clinique