A Spatiotemporal Data Aggregation Technique for Performance Analysis of Large-scale Execution Traces

International audienceAnalysts commonly use execution traces collected at runtime to understand the behavior of an application running on distributed and parallel systems. These traces are inspected post mortem using various visualization techniques that, however, do not scale properly for a large number of events. This issue, mainly due to human perception limitations, is also the result of bounded screen resolutions preventing the proper drawing of many graphical objects. This paper proposes a new visualization technique overcoming such limitations by providing a concise overview of the trace behavior as the result of a spatiotemporal data aggregation process. The experimental results show that this approach can help the quick and accurate detection of anomalies in traces containing up to two hundred million events

IEEE Access Special Section Editorial: Big Data Technology and Applications in Intelligent Transportation

During the last few years, information technology and transportation industries, along with automotive manufacturers and academia, are focusing on leveraging intelligent transportation systems (ITS) to improve services related to driver experience, connected cars, Internet data plans for vehicles, traffic infrastructure, urban transportation systems, traffic collaborative management, road traffic accidents analysis, road traffic flow prediction, public transportation service plan, personal travel route plans, and the development of an effective ecosystem for vehicles, drivers, traffic controllers, city planners, and transportation applications. Moreover, the emerging technologies of the Internet of Things (IoT) and cloud computing have provided unprecedented opportunities for the development and realization of innovative intelligent transportation systems where sensors and mobile devices can gather information and cloud computing, allowing knowledge discovery, information sharing, and supported decision making. However, the development of such data-driven ITS requires the integration, processing, and analysis of plentiful information obtained from millions of vehicles, traffic infrastructures, smartphones, and other collaborative systems like weather stations and road safety and early warning systems. The huge amount of data generated by ITS devices is only of value if utilized in data analytics for decision-making such as accident prevention and detection, controlling road risks, reducing traffic carbon emissions, and other applications which bring big data analytics into the picture

A Fortran Kernel Generation Framework for Scientific Legacy Code

Quality assurance procedure is very important for software development. The complexity of modules and structure in software impedes the testing procedure and further development. For complex and poorly designed scientific software, module developers and software testers need to put a lot of extra efforts to monitor not related modules\u27 impacts and to test the whole system\u27s constraints. In addition, widely used benchmarks cannot help programmers with accurate and program specific system performance evaluation. In this situation, the generated kernels could provide considerable insight into better performance tuning. Therefore, in order to greatly improve the productivity of various scientific software engineering tasks such as performance tuning, debugging, and verification of simulation results, we developed an automatic compute kernel extraction prototype platform for complex legacy scientific code. In addition, considering that scientific research and experiment require long-term simulation procedure and the huge size of data transfer, we apply message passing based parallelization and I/O behavior optimization to highly improve the performance of the kernel extractor framework and then use profiling tools to give guidance for parallel distribution. Abnormal event detection is another important aspect for scientific research; dealing with huge observational datasets combined with simulation results it becomes not only essential but also extremely difficult. In this dissertation, for the sake of detecting high frequency event and low frequency events, we reconfigured this framework equipped with in-situ data transfer infrastructure. Through the method of combining signal processing data preprocess(decimation) with machine learning detection model to train the stream data, our framework can significantly decrease the amount of transferred data demand for concurrent data analysis (between distributed computing CPU/GPU nodes). Finally, the dissertation presents the implementation of the framework and a case study of the ACME Land Model (ALM) for demonstration. It turns out that the generated compute kernel with lower cost can be used in performance tuning experiments and quality assurance, which include debugging legacy code, verification of simulation results through single point and multiple points of variables tracking, collaborating with compiler vendors, and generating custom benchmark tests

Resilient and Trustworthy Dynamic Data-driven Application Systems (DDDAS) Services for Crisis Management Environments

Future crisis management systems needresilient and trustworthy infrastructures to quickly develop reliable applications and processes, andensure end-to-end security, trust, and privacy. Due to the multiplicity and diversity of involved actors, volumes of data, and heterogeneity of shared information;crisis management systems tend to be highly vulnerable and subjectto unforeseen incidents. As a result, the dependability of crisis management systems can be at risk. This paper presents a cloud-based resilient and trustworthy infrastructure (known as rDaaS) to quickly develop secure crisis management systems. The rDaaS integrates the Dynamic Data-Driven Application Systems (DDDAS) paradigm into a service-oriented architecture over cloud technology and provides a set of resilient DDDAS-As-A Service (rDaaS) components to build secure and trusted adaptable crisis processes. The rDaaS also ensures resilience and security by obfuscating the execution environment and applying Behavior Software Encryption and Moving Technique Defense. A simulation environment for a nuclear plant crisis management case study is illustrated to build resilient and trusted crisis response processes

An Effective Deep Learning Based Multi-Class Classification of DoS and DDoS Attack Detection

In the past few years, cybersecurity is becoming very important due to the rise in internet users. The internet attacks such as Denial of service (DoS) and Distributed Denial of Service (DDoS) attacks severely harm a website or server and make them unavailable to other users. Network Monitoring and control systems have found it challenging to identify the many classes of DoS and DDoS attacks since each operates uniquely. Hence a powerful technique is required for attack detection. Traditional machine learning techniques are inefficient in handling extensive network data and cannot extract high-level features for attack detection. Therefore, an effective deep learning-based intrusion detection system is developed in this paper for DoS and DDoS attack classification. This model includes various phases and starts with the Deep Convolutional Generative Adversarial Networks (DCGAN) based technique to address the class imbalance issue in the dataset. Then a deep learning algorithm based on ResNet-50 extracts the critical features for each class in the dataset. After that, an optimized AlexNet-based classifier is implemented for detecting the attacks separately, and the essential parameters of the classifier are optimized using the Atom search optimization algorithm. The proposed approach was evaluated on benchmark datasets, CCIDS2019 and UNSW-NB15, using key classification metrics and achieved 99.37% accuracy for the UNSW-NB15 dataset and 99.33% for the CICIDS2019 dataset. The investigational results demonstrate that the suggested approach performs superior to other competitive techniques in identifying DoS and DDoS attacks

Regional but not global temperature variability underestimated by climate models at supradecadal timescales

Knowledge of the characteristics of natural climate variability is vital when assessing the range of plausible future climate trajectories in the next decades to centuries. The reliable detection of climate fluctuations on multidecadal to centennial timescales depends on proxy reconstructions and model simulations, as the instrumental record extends back only a few decades in most parts of the world. Systematic comparisons between model-simulated and proxy-based inferences of natural variability, however, often seem contradictory. Locally, simulated temperature variability is consistently smaller on multidecadal and longer timescales than is indicated by proxy-based reconstructions, implying that climate models or proxy interpretations might have deficiencies. In contrast, at global scales, studies found agreement between simulated and proxy reconstructed temperature variations. Here we review the evidence regarding the scale of natural temperature variability during recent millennia. We identify systematic reconstruction deficiencies that may contribute to differing local and global model–proxy agreement but conclude that they are probably insufficient to resolve such discrepancies. Instead, we argue that regional climate variations persisted for longer timescales than climate models simulating past climate states are able to reproduce. This would imply an underestimation of the regional variability on multidecadal and longer timescales and would bias climate projections and attribution studies. Thus, efforts are needed to improve the simulation of natural variability in climate models accompanied by further refining proxy-based inferences of variability.This study was undertaken by members of CVAS and 2k Network, working groups of the Past Global Changes (PAGES) Global Research association. This is a contribution to the SPACE ERC, STACY and PALMOD projects. The SPACE ERC project has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement no. 716092). STACY has been funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation, project no. 395588486). This work has also been supported by the German Federal Ministry of Education and Research (BMBF), through the PalMod project (subprojects 01LP1926B (O.B.), 01LP1926D (M.C.) and 01LP1926C (B.E., P.S. and N.W.)) from the Research for Sustainability initiative (FONA). B.E. is supported by the Heinrich Böll Foundation. E.M.-C. was supported by the PARAMOUR project, funded by the Fonds de la Recherche Scientifique–FNRS and the FWO under the Excellence of Science (EOS) programme (grant no. O0100718F, EOS ID no. 30454083). A.H. was supported by a Legacy Grant from the Australian Research Council Centre of Excellence for Australian Biodiversity and Heritage. B.M. was supported by LINKA20102 and the Spanish Ministry of Science and Innovation project CEX2018‐000794‐S. The work originated from discussions at the CVAS working group of PAGES at a workshop at the Internationales Wissenschaftsforum Heidelberg, which was funded by a Hengstberger Prize. We thank N. Beech, C. Brierley, F. Gonzalez-Rouco and M. MacPartland for comments on earlier drafts of the manuscript. This manuscript uses data provided by the World Climate Research Programme’s Working Group on Coupled Modelling, which is responsible for CMIP and PMIP. We thank the research groups for producing and kindly making their model outputs, measurements and palaeoclimate reconstructions available to us. Editorial assistance, in the form of language editing and correction, was provided by XpertScientific Editing and Consulting Services. We acknowledge support by the Open Access Publication Funds of Alfred-Wegener-Institut Helmholtz Zentrum für Polar- und Meeresforschung.Peer ReviewedPostprint (author's final draft