A Novel Text Mining Approach for Mental Health Prediction Using Bi-LSTM and BERT Model

With the current advancement in the Internet, there has been a growing demand for building intelligent and smart systems that can efficiently address the detection of health-related problems on social media, such as the detection of depression and anxiety. These types of systems, which are mainly dependent on machine learning techniques, must be able to deal with obtaining the semantic and syntactic meaning of texts posted by users on social media. The data generated by users on social media contains unstructured and unpredictable content. Several systems based on machine learning and social media platforms have recently been introduced to identify health-related problems. However, the text representation and deep learning techniques employed provide only limited information and knowledge about the different texts posted by users. This is owing to a lack of long-term dependencies between each word in the entire text and a lack of proper exploitation of recent deep learning schemes. In this paper, we propose a novel framework to efficiently and effectively identify depression and anxiety-related posts while maintaining the contextual and semantic meaning of the words used in the whole corpus when applying bidirectional encoder representations from transformers (BERT). In addition, we propose a knowledge distillation technique, which is a recent technique for transferring knowledge from a large pretrained model (BERT) to a smaller model to boost performance and accuracy. We also devised our own data collection framework from Reddit and Twitter, which are the most common social media sites. Finally, we employed word2vec and BERT with Bi-LSTM to effectively analyze and detect depression and anxiety signs from social media posts. Our system surpasses other state-of-the-art methods and achieves an accuracy of 98% using the knowledge distillation technique

Mobile Broadband Performance Evaluation: Analysis of National Reports

Five decades have passed since the first bit was transmitted over the internet. Although the internet has improved our lives and led to the digital economy, currently only 51% of the world’s population have access to it. Currently, consumers mostly access the internet via mobile broadband, 2G, 3G, and 4G services. Regulatory bodies such as the Federal Communications Commission (FCC) of the US are responsible for ensuring that consumers receive an adequate service from Mobile Network Operators (MNOs). Usually, regulators evaluate the performance of each MNO in terms of service quality yearly and publish a report. To evaluate performance, metrics such as coverage, download/upload speed, and the number of subscribers can be used. However, the evaluation process and the metrics used by each regulatory body are inconsistent, and this makes it hard to determine which nations are providing adequate services to their citizens. Furthermore, it is not clear as to which performance evaluation is the right path. In this case study, we analyzed the reports released from eight nations (United States of America, United Kingdom, France, South Korea, Japan, Singapore, and Australia) as of the year 2020. We then point out the advantages and the drawbacks of the current evaluation process and metrics. Furthermore, a discussion on why the current methods are not sufficient to evaluate 5G services is presented. Our findings indicate that there is a great need for a unified metric and that this process becomes more complex with the rollout of 5G

Evaluation of Reinforcement and Deep Learning Algorithms in Controlling Unmanned Aerial Vehicles

Unmanned Aerial Vehicles (UAVs) are abundantly becoming a part of society, which is a trend that is expected to grow even further. The quadrotor is one of the drone technologies that is applicable in many sectors and in both military and civilian activities, with some applications requiring autonomous flight. However, stability, path planning, and control remain significant challenges in autonomous quadrotor flights. Traditional control algorithms, such as proportional-integral-derivative (PID), have deficiencies, especially in tuning. Recently, machine learning has received great attention in flying UAVs to desired positions autonomously. In this work, we configure the quadrotor to fly autonomously by using agents (the machine learning schemes being used to fly the quadrotor autonomously) to learn about the virtual physical environment. The quadrotor will fly from an initial to a desired position. When the agent brings the quadrotor closer to the desired position, it is rewarded; otherwise, it is punished. Two reinforcement learning models, Q-learning and SARSA, and a deep learning deep Q-network network are used as agents. The simulation is conducted by integrating the robot operating system (ROS) and Gazebo, which allowed for the implementation of the learning algorithms and the physical environment, respectively. The result has shown that the Deep Q-network network with Adadelta optimizer is the best setting to fly the quadrotor from the initial to desired position