Storage Solutions for Big Data Systems: A Qualitative Study and Comparison

Big data systems development is full of challenges in view of the variety of application areas and domains that this technology promises to serve. Typically, fundamental design decisions involved in big data systems design include choosing appropriate storage and computing infrastructures. In this age of heterogeneous systems that integrate different technologies for optimized solution to a specific real world problem, big data system are not an exception to any such rule. As far as the storage aspect of any big data system is concerned, the primary facet in this regard is a storage infrastructure and NoSQL seems to be the right technology that fulfills its requirements. However, every big data application has variable data characteristics and thus, the corresponding data fits into a different data model. This paper presents feature and use case analysis and comparison of the four main data models namely document oriented, key value, graph and wide column. Moreover, a feature analysis of 80 NoSQL solutions has been provided, elaborating on the criteria and points that a developer must consider while making a possible choice. Typically, big data storage needs to communicate with the execution engine and other processing and visualization technologies to create a comprehensive solution. This brings forth second facet of big data storage, big data file formats, into picture. The second half of the research paper compares the advantages, shortcomings and possible use cases of available big data file formats for Hadoop, which is the foundation for most big data computing technologies. Decentralized storage and blockchain are seen as the next generation of big data storage and its challenges and future prospects have also been discussed

Feasibility and performance analysis of middleware support for a situated virtual-physical civic engagement platform

Abstract. With the prevalent ubiquitous computing technologies, it is possible to explore novel solutions for supporting civic engagement as a set of urban practices. One interesting urban practice is the soapbox, traditionally conceived as wooden structure, from where to hold impromptu speeches. For this thesis, a novel soapbox prototype with ubiquitous computing mediated technologies is introduced, with our focus on the feasibility and performance analysis of its middleware support, investigating how our middleware is able to meet the goals of a situated virtual-physical civic engagement platform. Based on our empirical evaluations, it is demonstrated that our prototype is effective to support civic engagement and serve purpose of continuously soapbox streaming

Knowledge Discovery in the SCADA Databases Used for the Municipal Power Supply System

This scientific paper delves into the problems related to the develop-ment of intellectual data analysis system that could support decision making to manage municipal power supply services. The management problems of mu-nicipal power supply system have been specified taking into consideration modern tendencies shown by new technologies that allow for an increase in the energy efficiency. The analysis findings of the system problems related to the integrated computer-aided control of the power supply for the city have been given. The consideration was given to the hierarchy-level management decom-position model. The objective task targeted at an increase in the energy effi-ciency to minimize expenditures and energy losses during the generation and transportation of energy carriers to the Consumer, the optimization of power consumption at the prescribed level of the reliability of pipelines and networks and the satisfaction of Consumers has been defined. To optimize the support of the decision making a new approach to the monitoring of engineering systems and technological processes related to the energy consumption and transporta-tion using the technologies of geospatial analysis and Knowledge Discovery in databases (KDD) has been proposed. The data acquisition for analytical prob-lems is realized in the wireless heterogeneous medium, which includes soft-touch VPN segments of ZigBee technology realizing the 6LoWPAN standard over the IEEE 802.15.4 standard and also the segments of the networks of cellu-lar communications. JBoss Application Server is used as a server-based plat-form for the operation of the tools used for the retrieval of data collected from sensor nodes, PLC and energy consumption record devices. The KDD tools are developed using Java Enterprise Edition platform and Spring and ORM Hiber-nate technologies

A Real-Time, Distributed and Context-Aware System for Managing Solidarity Campaigns

We present a project implemented on the field which has two separate strands, one refers on collecting crowd sensing data through mobile apps where context is (near) automatically induced, another is related to a practical application of this method in a real time system to manage solidarity campaigns in collecting goods. Here, we cover both parts, we applied an experimental setup and obtained results and insights in a third sector institution, Caritas Diocesana of Coimbra[1], a non-profit organization part of Caritas[2]. As main contribution, we propose a distributed architecture for Mobile Crowd Sensing able not only to allow real time inventory through simultaneous campaigns but also it gives feedback to volunteers in order to instantly acquire information about which categories of goods are more needed[1] http://www.caritas.pt/site/nacional/ Portuguese Website (last visited in October 2015)/n[2] http://www.caritas.eu/ (last visited in October 2015

Service Oriented Big Data Management for Transport

International audienceThe increasing power of computer hardware and the sophistication of computer software have brought many new possibilities to information world. On one side the possibility to analyse massive data sets has brought new insight, knowledge and information. On the other, it has enabled to massively distribute computing and has opened to a new programming paradigm called Service Oriented Computing particularly well adapted to cloud computing. Applying these new technologies to the transport industry can bring new understanding to town transport infrastructures. The objective of our work is to manage and aggregate cloud services for managing big data and assist decision making for transport systems. Thus this paper presents our approach to propose a service oriented architecture for big data analytics for transport systems based on the cloud. Proposing big data management strategies for data produced by transport infra‐ structures, whilst maintaining cost effective systems deployed on the cloud, is a promising approach. We present the advancement for developing the Data acquisition service and Information extraction and cleaning service as well as the analysis for choosing a sharding strategy

An Analysis of Public Education Informatics

Information systems and informatics technologies are employed to increase profitability and efficiency of business models. The most common mistake made by managers, when incorporating informatics into their business model, is under-utilizing the technological capacity of their resources and investing in extraneous functions. This thesis will examine the usage of information systems and informatics principles in the United States public education system. Approaching the case from a consultant’s perspective, this paper will map out the business model theory, its actual implementation, and identify key failure points and areas of improvement in informatics usage. The structure of the thesis follows the first 2 steps of ADDIE Instructional Design model, embedded within the strategic management business analysis model. It begins with the business analysis, then systems analysis, followed by design of the informatics structure that would best suit the needs of the Public Education System. The results are then compared with the current solutions and a conclusion on necessary migration and improvements are made