A Hybrid Framework for Real-Time Data Drift and Anomaly Identification Using Hierarchical Temporal Memory and Statistical Tests

Data Drift refers to the phenomenon where the generating model behind the data changes over time. Due to data drift, any model built on the past training data becomes less relevant and inaccurate over time. Thus, detecting and controlling for data drift is critical in machine learning models. Hierarchical Temporal Memory (HTM) is a machine learning model developed by Jeff Hawkins, inspired by how the human brain processes information. It is a biologically inspired model of memory similar in structure to the neocortex and whose performance is claimed to be comparable to state of the art models in detecting anomalies in time series data. Another unique benefit of HTMs is their independence from training and testing cycles; all the learning takes place online with streaming data, and no separate training and testing cycle is required. In the sequential learning paradigm, the Sequential Probability Ratio Test (SPRT) offers unique benefits for online learning and inference. This paper proposes a novel hybrid framework combining HTM and SPRT for real-time data drift detection and anomaly identification. Unlike existing data drift methods, our approach eliminates frequent retraining and ensures low false positive rates. HTMs currently work with one dimensional or univariate data. In a second study, we also propose an application of HTM in a multidimensional supervised scenario for anomaly detection by combining the outputs of multiple HTM columns, one for each data dimension, through a neural network. Experimental evaluations demonstrate that the proposed method outperforms conventional drift detection techniques like the Kolmogorov-Smirnov (KS) test, Wasserstein distance, and Population Stability Index (PSI) in terms of accuracy, adaptability, and computational efficiency. Our experiments also provide insights into optimizing hyperparameters for real-time deployment in domains such as Telecom

Chronic inflammation in polycystic ovary syndrome: A case–control study using multiple markers

Background: Polycystic ovary syndrome (PCOS) is associated with insulin resistance and elevated risk of cardiovascular disease and diabetes. Chronic inflammation has been observed in PCOS in several studies but there is also opposing evidence and a dearth of research in Indians. Objective: To estimate chronic inflammation in PCOS and find its relationship with appropriate anthropometric and biochemical parameters. Materials and Methods: Chronic inflammation was assessed in 30 women with PCOS (Group A) and 30 healthy controls (Group B) with highly sensitive C-reactive protein (hsCRP), interleukin-6 (IL-6), tumour necrosis factor alpha (TNFα), and platelet microparticles (PMP). In group A, the relationship of chronic inflammation with insulin resistance, waist hip ratio (WHR) serum testosterone, and serum glutamate pyruvate transaminase (SGPT) were examined. Results: In group A, the hsCRP, TNFα, and PMP were significantly elevated compared to group B. However, IL-6 level was similar between the groups. In group A, PMP showed a significant positive correlation with waist-hip ratio and serum testosterone. IL-6 showed a significant positive correlation with insulin sensitivity and significant negative correlation with insulin resistance and serum glutamate pyruvate transaminase. Conclusion: PCOS is associated with chronic inflammation and PMP correlates positively with central adiposity and biochemical hyperandrogenism in women with PCOS. Key words: Polycystic ovary syndrome, Inflammation, C-reactive protein, Interleukin-6, Tumor necrosis factor, Microparticles

Adversarial Perturbations Against Real-Time Video Classification Systems

Recent research has demonstrated the brittleness of machine learning systems to adversarial perturbations. However, the studies have been mostly limited to perturbations on images and more generally, classification that does not deal with temporally varying inputs. In this paper we ask "Are adversarial perturbations possible in real-time video classification systems and if so, what properties must they satisfy?" Such systems find application in surveillance applications, smart vehicles, and smart elderly care and thus, misclassification could be particularly harmful (e.g., a mishap at an elderly care facility may be missed). We show that accounting for temporal structure is key to generating adversarial examples in such systems. We exploit recent advances in generative adversarial network (GAN) architectures to account for temporal correlations and generate adversarial samples that can cause misclassification rates of over 80% for targeted activities. More importantly, the samples also leave other activities largely unaffected making them extremely stealthy. Finally, we also surprisingly find that in many scenarios, the same perturbation can be applied to every frame in a video clip that makes the adversary's ability to achieve misclassification relatively easy

Learning Person Re-identification Models from Videos with Weak Supervision

Most person re-identification methods, being supervised techniques, suffer from the burden of massive annotation requirement. Unsupervised methods overcome this need for labeled data, but perform poorly compared to the supervised alternatives. In order to cope with this issue, we introduce the problem of learning person re-identification models from videos with weak supervision. The weak nature of the supervision arises from the requirement of video-level labels, i.e. person identities who appear in the video, in contrast to the more precise framelevel annotations. Towards this goal, we propose a multiple instance attention learning framework for person re-identification using such video-level labels. Specifically, we first cast the video person re-identification task into a multiple instance learning setting, in which person images in a video are collected into a bag. The relations between videos with similar labels can be utilized to identify persons, on top of that, we introduce a co-person attention mechanism which mines the similarity correlations between videos with person identities in common. The attention weights are obtained based on all person images instead of person tracklets in a video, making our learned model less affected by noisy annotations. Extensive experiments demonstrate the superiority of the proposed method over the related methods on two weakly labeled person re-identification datasets

3D Heisenberg universality in the Van der Waals antiferromagnet NiPS3_3

Van der Waals (vdW) magnetic materials are comprised of layers of atomically thin sheets, making them ideal platforms for studying magnetism at the two-dimensional (2D) limit. These materials are at the center of a host of novel types of experiments, however, there are notably few pathways to directly probe their magnetic structure. We report the magnetic order within a single crystal of NiPS$_3$ and show it can be accessed with resonant elastic X-ray diffraction along the edge of the vdW planes in a carefully grown crystal by detecting structurally forbidden resonant magnetic X-ray scattering. We find the magnetic order parameter has a critical exponent of $\beta\sim0.36$, indicating that the magnetism of these vdW crystals is more adequately characterized by the three-dimensional (3D) Heisenberg universality class. We verify these findings with first-principle density functional theory, Monte-Carlo simulations, and density matrix renormalization group calculations