Adaptive Honeypot Engagement through Reinforcement Learning of Semi-Markov Decision Processes

A honeynet is a promising active cyber defense mechanism. It reveals the fundamental Indicators of Compromise (IoCs) by luring attackers to conduct adversarial behaviors in a controlled and monitored environment. The active interaction at the honeynet brings a high reward but also introduces high implementation costs and risks of adversarial honeynet exploitation. In this work, we apply infinite-horizon Semi-Markov Decision Process (SMDP) to characterize a stochastic transition and sojourn time of attackers in the honeynet and quantify the reward-risk trade-off. In particular, we design adaptive long-term engagement policies shown to be risk-averse, cost-effective, and time-efficient. Numerical results have demonstrated that our adaptive engagement policies can quickly attract attackers to the target honeypot and engage them for a sufficiently long period to obtain worthy threat information. Meanwhile, the penetration probability is kept at a low level. The results show that the expected utility is robust against attackers of a large range of persistence and intelligence. Finally, we apply reinforcement learning to the SMDP to solve the curse of modeling. Under a prudent choice of the learning rate and exploration policy, we achieve a quick and robust convergence of the optimal policy and value.Comment: The presentation can be found at https://youtu.be/GPKT3uJtXqk. arXiv admin note: text overlap with arXiv:1907.0139

Crosstalk between Chemokine Receptor CXCR4 and Cannabinoid Receptor CB2 in Modulating Breast Cancer Growth and Invasion

Cannabinoids bind to cannabinoid receptors CB(1) and CB(2) and have been reported to possess anti-tumorigenic activity in various cancers. However, the mechanisms through which cannabinoids modulate tumor growth are not well known. In this study, we report that a synthetic non-psychoactive cannabinoid that specifically binds to cannabinoid receptor CB(2) may modulate breast tumor growth and metastasis by inhibiting signaling of the chemokine receptor CXCR4 and its ligand CXCL12. This signaling pathway has been shown to play an important role in regulating breast cancer progression and metastasis.We observed high expression of both CB(2) and CXCR4 receptors in breast cancer patient tissues by immunohistochemical analysis. We further found that CB(2)-specific agonist JWH-015 inhibits the CXCL12-induced chemotaxis and wound healing of MCF7 overexpressing CXCR4 (MCF7/CXCR4), highly metastatic clone of MDA-MB-231 (SCP2) and NT 2.5 cells (derived from MMTV-neu) by using chemotactic and wound healing assays. Elucidation of the molecular mechanisms using various biochemical techniques and confocal microscopy revealed that JWH-015 treatment inhibited CXCL12-induced P44/P42 ERK activation, cytoskeletal focal adhesion and stress fiber formation, which play a critical role in breast cancer invasion and metastasis. In addition, we have shown that JWH-015 significantly inhibits orthotopic tumor growth in syngenic mice in vivo using NT 2.5 cells. Furthermore, our studies have revealed that JWH-015 significantly inhibits phosphorylation of CXCR4 and its downstream signaling in vivo in orthotopic and spontaneous breast cancer MMTV-PyMT mouse model systems.This study provides novel insights into the crosstalk between CB(2) and CXCR4/CXCL12-signaling pathways in the modulation of breast tumor growth and metastasis. Furthermore, these studies indicate that CB(2) receptors could be used for developing innovative therapeutic strategies against breast cancer

Microtubular Stability Affects pVHL-Mediated Regulation of HIF-1alpha via the p38/MAPK Pathway in Hypoxic Cardiomyocytes

BACKGROUND: Our previous research found that structural changes of the microtubule network influence glycolysis in cardiomyocytes by regulating the hypoxia-inducible factor (HIF)-1α during the early stages of hypoxia. However, little is known about the underlying regulatory mechanism of the changes of HIF-1α caused by microtubule network alternation. The von Hippel-Lindau tumor suppressor protein (pVHL), as a ubiquitin ligase, is best understood as a negative regulator of HIF-1α. METHODOLOGY/PRINCIPAL FINDINGS: In primary rat cardiomyocytes and H9c2 cardiac cells, microtubule-stabilization was achieved by pretreating with paclitaxel or transfection of microtubule-associated protein 4 (MAP4) overexpression plasmids and microtubule-depolymerization was achieved by pretreating with colchicine or transfection of MAP4 siRNA before hypoxia treatment. Recombinant adenovirus vectors for overexpressing pVHL or silencing of pVHL expression were constructed and transfected in primary rat cardiomyocytes and H9c2 cells. With different microtubule-stabilizing and -depolymerizing treaments, we demonstrated that the protein levels of HIF-1α were down-regulated through overexpression of pVHL and were up-regulated through knockdown of pVHL in hypoxic cardiomyocytes. Importantly, microtubular structure breakdown activated p38/MAPK pathway, accompanied with the upregulation of pVHL. In coincidence, we found that SB203580, a p38/MAPK inhibitor decreased pVHL while MKK6 (Glu) overexpression increased pVHL in the microtubule network altered-hypoxic cardiomyocytes and H9c2 cells. CONCLUSIONS/SIGNIFICANCE: This study suggests that pVHL plays an important role in the regulation of HIF-1α caused by the changes of microtubular structure and the p38/MAPK pathway participates in the process of pVHL change following microtubule network alteration in hypoxic cardiomyocytes

Discovery of Molecular Mechanisms of Traditional Chinese Medicinal Formula Si-Wu-Tang Using Gene Expression Microarray and Connectivity Map

To pursue a systematic approach to discovery of mechanisms of action of traditional Chinese medicine (TCM), we used microarrays, bioinformatics and the “Connectivity Map” (CMAP) to examine TCM-induced changes in gene expression. We demonstrated that this approach can be used to elucidate new molecular targets using a model TCM herbal formula Si-Wu-Tang (SWT) which is widely used for women's health. The human breast cancer MCF-7 cells treated with 0.1 µM estradiol or 2.56 mg/ml of SWT showed dramatic gene expression changes, while no significant change was detected for ferulic acid, a known bioactive compound of SWT. Pathway analysis using differentially expressed genes related to the treatment effect identified that expression of genes in the nuclear factor erythroid 2-related factor 2 (Nrf2) cytoprotective pathway was most significantly affected by SWT, but not by estradiol or ferulic acid. The Nrf2-regulated genes HMOX1, GCLC, GCLM, SLC7A11 and NQO1 were upreguated by SWT in a dose-dependent manner, which was validated by real-time RT-PCR. Consistently, treatment with SWT and its four herbal ingredients resulted in an increased antioxidant response element (ARE)-luciferase reporter activity in MCF-7 and HEK293 cells. Furthermore, the gene expression profile of differentially expressed genes related to SWT treatment was used to compare with those of 1,309 compounds in the CMAP database. The CMAP profiles of estradiol-treated MCF-7 cells showed an excellent match with SWT treatment, consistent with SWT's widely claimed use for women's diseases and indicating a phytoestrogenic effect. The CMAP profiles of chemopreventive agents withaferin A and resveratrol also showed high similarity to the profiles of SWT. This study identified SWT as an Nrf2 activator and phytoestrogen, suggesting its use as a nontoxic chemopreventive agent, and demonstrated the feasibility of combining microarray gene expression profiling with CMAP mining to discover mechanisms of actions and to identify new health benefits of TCMs

Pan-cancer analysis of whole genomes

Cancer is driven by genetic change, and the advent of massively parallel sequencing has enabled systematic documentation of this variation at the whole-genome scale(1-3). Here we report the integrative analysis of 2,658 whole-cancer genomes and their matching normal tissues across 38 tumour types from the Pan-Cancer Analysis of Whole Genomes (PCAWG) Consortium of the International Cancer Genome Consortium (ICGC) and The Cancer Genome Atlas (TCGA). We describe the generation of the PCAWG resource, facilitated by international data sharing using compute clouds. On average, cancer genomes contained 4-5 driver mutations when combining coding and non-coding genomic elements; however, in around 5% of cases no drivers were identified, suggesting that cancer driver discovery is not yet complete. Chromothripsis, in which many clustered structural variants arise in a single catastrophic event, is frequently an early event in tumour evolution; in acral melanoma, for example, these events precede most somatic point mutations and affect several cancer-associated genes simultaneously. Cancers with abnormal telomere maintenance often originate from tissues with low replicative activity and show several mechanisms of preventing telomere attrition to critical levels. Common and rare germline variants affect patterns of somatic mutation, including point mutations, structural variants and somatic retrotransposition. A collection of papers from the PCAWG Consortium describes non-coding mutations that drive cancer beyond those in the TERT promoter(4); identifies new signatures of mutational processes that cause base substitutions, small insertions and deletions and structural variation(5,6); analyses timings and patterns of tumour evolution(7); describes the diverse transcriptional consequences of somatic mutation on splicing, expression levels, fusion genes and promoter activity(8,9); and evaluates a range of more-specialized features of cancer genomes(8,10-18).Peer reviewe

Mining the human phenome using allelic scores that index biological intermediates

J. Kaprio ja M-L. Lokki työryhmien jäseniä.It is common practice in genome-wide association studies (GWAS) to focus on the relationship between disease risk and genetic variants one marker at a time. When relevant genes are identified it is often possible to implicate biological intermediates and pathways likely to be involved in disease aetiology. However, single genetic variants typically explain small amounts of disease risk. Our idea is to construct allelic scores that explain greater proportions of the variance in biological intermediates, and subsequently use these scores to data mine GWAS. To investigate the approach's properties, we indexed three biological intermediates where the results of large GWAS meta-analyses were available: body mass index, C-reactive protein and low density lipoprotein levels. We generated allelic scores in the Avon Longitudinal Study of Parents and Children, and in publicly available data from the first Wellcome Trust Case Control Consortium. We compared the explanatory ability of allelic scores in terms of their capacity to proxy for the intermediate of interest, and the extent to which they associated with disease. We found that allelic scores derived from known variants and allelic scores derived from hundreds of thousands of genetic markers explained significant portions of the variance in biological intermediates of interest, and many of these scores showed expected correlations with disease. Genome-wide allelic scores however tended to lack specificity suggesting that they should be used with caution and perhaps only to proxy biological intermediates for which there are no known individual variants. Power calculations confirm the feasibility of extending our strategy to the analysis of tens of thousands of molecular phenotypes in large genome-wide meta-analyses. We conclude that our method represents a simple way in which potentially tens of thousands of molecular phenotypes could be screened for causal relationships with disease without having to expensively measure these variables in individual disease collections.Peer reviewe

Magnetic and electronic properties of CaMn2Bi2: A possible hybridization gap semiconductor

We report the magnetic and electronic properties of CaMn2Bi2, which has a structure based on a triangular bilayer of Mn, rather than the ThCr2Si2 structure commonly encountered for 122 compounds in intermetallic systems. CaMn2Bi2 has an antiferromagnetic ground state, with a T-N of 150 K, and for a 250 K temperature range above TN does not exhibit Curie-Weiss behavior, indicating the presence of strong magnetic correlations at high temperatures. Resistivity measurements show that CaMn2Bi2 exhibits semiconducting properties at low temperatures, with an energy gap of only 62 meV, indicating it to be a very narrow band gap semiconductor. The electronic structure of CaMn2Bi2, examined via ab-initio electronic structure calculations, indicates that Mn 3d orbital hybridization is essential for the formation of the band gap, suggesting that CaMn2Bi2 may be a hybridization-gap semiconductor