53 research outputs found
The Importance of Robust Features in Mitigating Catastrophic Forgetting
Continual learning (CL) is an approach to address catastrophic forgetting,
which refers to forgetting previously learned knowledge by neural networks when
trained on new tasks or data distributions. The adversarial robustness has
decomposed features into robust and non-robust types and demonstrated that
models trained on robust features significantly enhance adversarial robustness.
However, no study has been conducted on the efficacy of robust features from
the lens of the CL model in mitigating catastrophic forgetting in CL. In this
paper, we introduce the CL robust dataset and train four baseline models on
both the standard and CL robust datasets. Our results demonstrate that the CL
models trained on the CL robust dataset experienced less catastrophic
forgetting of the previously learned tasks than when trained on the standard
dataset. Our observations highlight the significance of the features provided
to the underlying CL models, showing that CL robust features can alleviate
catastrophic forgetting
Exploring the role of sentiments in identification of active and influential bloggers
The social Web provides opportunities for the public to have social interactions and online discussions. A large number of online users using the social web sites create a high volume of data. This leads to the emergence of Big Data, which focuses on computational analysis of data to reveal patterns, and associations relating to human interactions. Such analyses have vast applications in various fields such as understanding human behaviors, studying culture influence, and promoting online marketing. The blogs are one of the social web channels that offer a way to discuss various topics. Finding the top bloggers has been a major research problem in the research domain of the social web and big data. Various models and metrics have been proposed to find important blog users in the blogosphere community. In this work, first find the sentiment of blog posts, then we find the active and influential bloggers. Then, we compute various measures to explore the correlation between the sentiment and active as well as bloggers who have impact on other bloggers in online communities. Data computed using the real world blog data reveal that the sentiment is an important factor and should be considered as a feature for finding top bloggers. Sentiment analysis helps to understand how it affects human behaviors
Exploring the role of sentiments in identification of active and influential bloggers
The social Web provides opportunities for the public to have social interactions and online discussions. A large number of online users using the social web sites create a high volume of data. This leads to the emergence of Big Data, which focuses on computational analysis of data to reveal patterns, and associations relating to human interactions. Such analyses have vast applications in various fields such as understanding human behaviors, studying culture influence, and promoting online marketing. The blogs are one of the social web channels that offer a way to discuss various topics. Finding the top bloggers has been a major research problem in the research domain of the social web and big data. Various models and metrics have been proposed to find important blog users in the blogosphere community. In this work, first find the sentiment of blog posts, then we find the active and influential bloggers. Then, we compute various measures to explore the correlation between the sentiment and active as well as bloggers who have impact on other bloggers in online communities. Data computed using the real world blog data reveal that the sentiment is an important factor and should be considered as a feature for finding top bloggers. Sentiment analysis helps to understand how it affects human behaviors
Numerical Reckoning Fixed Points in Spaces
In this paper, first we use an example to show the efficiency of iteration process introduced by Ullah and Arshad [4] for approximating fixed points of Suzuki generalized nonexpansive mappings. Then by using iteration process, we prove some strong and convergence theorems for Suzuki generalized nonexpansive mappings in the setting of Spaces. Our results are the extension, improvement and generalization of many known results in spaces
Susceptibility of Continual Learning Against Adversarial Attacks
Recent continual learning approaches have primarily focused on mitigating
catastrophic forgetting. Nevertheless, two critical areas have remained
relatively unexplored: 1) evaluating the robustness of proposed methods and 2)
ensuring the security of learned tasks. This paper investigates the
susceptibility of continually learned tasks, including current and previously
acquired tasks, to adversarial attacks. Specifically, we have observed that any
class belonging to any task can be easily targeted and misclassified as the
desired target class of any other task. Such susceptibility or vulnerability of
learned tasks to adversarial attacks raises profound concerns regarding data
integrity and privacy. To assess the robustness of continual learning
approaches, we consider continual learning approaches in all three scenarios,
i.e., task-incremental learning, domain-incremental learning, and
class-incremental learning. In this regard, we explore the robustness of three
regularization-based methods, three replay-based approaches, and one hybrid
technique that combines replay and exemplar approaches. We empirically
demonstrated that in any setting of continual learning, any class, whether
belonging to the current or previously learned tasks, is susceptible to
misclassification. Our observations identify potential limitations of continual
learning approaches against adversarial attacks and highlight that current
continual learning algorithms could not be suitable for deployment in
real-world settings.Comment: 18 pages, 13 figure
Deep Ensemble for Rotorcraft Attitude Prediction
Historically, the rotorcraft community has experienced a higher fatal
accident rate than other aviation segments, including commercial and general
aviation. Recent advancements in artificial intelligence (AI) and the
application of these technologies in different areas of our lives are both
intriguing and encouraging. When developed appropriately for the aviation
domain, AI techniques provide an opportunity to help design systems that can
address rotorcraft safety challenges. Our recent work demonstrated that AI
algorithms could use video data from onboard cameras and correctly identify
different flight parameters from cockpit gauges, e.g., indicated airspeed.
These AI-based techniques provide a potentially cost-effective solution,
especially for small helicopter operators, to record the flight state
information and perform post-flight analyses. We also showed that carefully
designed and trained AI systems could accurately predict rotorcraft attitude
(i.e., pitch and yaw) from outside scenes (images or video data). Ordinary
off-the-shelf video cameras were installed inside the rotorcraft cockpit to
record the outside scene, including the horizon. The AI algorithm could
correctly identify rotorcraft attitude at an accuracy in the range of 80\%. In
this work, we combined five different onboard camera viewpoints to improve
attitude prediction accuracy to 94\%. In this paper, five onboard camera views
included the pilot windshield, co-pilot windshield, pilot Electronic Flight
Instrument System (EFIS) display, co-pilot EFIS display, and the attitude
indicator gauge. Using video data from each camera view, we trained various
convolutional neural networks (CNNs), which achieved prediction accuracy in the
range of 79\% % to 90\% %. We subsequently ensembled the learned knowledge from
all CNNs and achieved an ensembled accuracy of 93.3\%
Comparative Analysis of State-of-the-Art Deep Learning Models for Detecting COVID-19 Lung Infection from Chest X-Ray Images
The ongoing COVID-19 pandemic has already taken millions of lives and damaged
economies across the globe. Most COVID-19 deaths and economic losses are
reported from densely crowded cities. It is comprehensible that the effective
control and prevention of epidemic/pandemic infectious diseases is vital.
According to WHO, testing and diagnosis is the best strategy to control
pandemics. Scientists worldwide are attempting to develop various innovative
and cost-efficient methods to speed up the testing process. This paper
comprehensively evaluates the applicability of the recent top ten
state-of-the-art Deep Convolutional Neural Networks (CNNs) for automatically
detecting COVID-19 infection using chest X-ray images. Moreover, it provides a
comparative analysis of these models in terms of accuracy. This study
identifies the effective methodologies to control and prevent infectious
respiratory diseases. Our trained models have demonstrated outstanding results
in classifying the COVID-19 infected chest x-rays. In particular, our trained
models MobileNet, EfficentNet, and InceptionV3 achieved a classification
average accuracy of 95\%, 95\%, and 94\% test set for COVID-19 class
classification, respectively. Thus, it can be beneficial for clinical
practitioners and radiologists to speed up the testing, detection, and
follow-up of COVID-19 cases
Topic Modeling based text classification regarding Islamophobia using Word Embedding and Transformers Techniques
Islamophobia is a rising area of concern in the current era where Muslims face discrimination and receive negative perspectives towards their religion, Islam. Islamophobia is a type of racism that is being practiced by individuals, groups, and organizations worldwide. Moreover, the ease of access to social media platforms and their augmented usage has also contributed to spreading hate speech, false information, and negative opinions about Islam. In this research study, we focused to detect Islamophobic textual content shared on various social media platforms. We explored the state-of-the-art techniques being followed in text data mining and Natural Language Processing (NLP). Topic modelling algorithm Latent Dirichlet Allocation is used to find top topics. Then, word embedding approaches such as Word2Vec and Global Vectors for word representation (GloVe) are used as feature extraction techniques. For text classification, we utilized modern text analysis techniques of transformers-based Deep Learning algorithms named Bidirectional Encoders Representation from Transformers (BERT) and Generative Pre-Trained Transformer (GPT). For results comparison, we conducted an extensive empirical analysis of Machine Learning algorithms and Deep Learning using conventional textual features such as the Term Frequency-Inverse Document Frequency, N-gram, and Bag of words (BoW). The empirical based results evaluated using standard performance evaluation measures show that the proposed approach effectively detects the textual content related to Islamophobia. In the corpus of the study under Machine Learning models Support Vector Machine (SVM) performed best with an F1 score of 91%. The Transformer based core NLP models and the Deep Learning model Convolutional Neural Network (CNN) when combined with GloVe performed best among all the techniques except SVM with BoW. GPT, SVM when combined with BoW and BERT yielded the best F1 score of 92%, 92% and 91.9% respectively, while CNN performed slightly poor with an F1 score of 91%
- …