Composable architecture for rack scale big data computing

The rapid growth of cloud computing, both in terms of the spectrum and volume of cloud workloads, necessitate re-visiting the traditional rack-mountable servers based datacenter design. Next generation datacenters need to offer enhanced support for: (i) fast changing system configuration requirements due to workload constraints, (ii) timely adoption of emerging hardware technologies, and (iii) maximal sharing of systems and subsystems in order to lower costs. Disaggregated datacenters, constructed as a collection of individual resources such as CPU, memory, disks etc., and composed into workload execution units on demand, are an interesting new trend that can address the above challenges. In this paper, we demonstrated the feasibility of composable systems through building a rack scale composable system prototype using PCIe switch. Through empirical approaches, we develop assessment of the opportunities and challenges for leveraging the composable architecture for rack scale cloud datacenters with a focus on big data and NoSQL workloads. In particular, we compare and contrast the programming models that can be used to access the composable resources, and developed the implications for the network and resource provisioning and management for rack scale architecture

Cost optimization for data placement strategies in an analytical cloud service

Analyzing a large amount of business-relevant data in near-realtime in order to assist decision making became a crucial requirement for many businesses in the last years. Therefore, all major database system vendors offer solutions that assist customers in this requirement with systems that are specially tuned for accelerating analytical workloads. Before the decision is made to buy such a huge and expensive solution, customers are interested in getting a detailed workload analysis in order to estimate potential benefits. Therefore, a more agile solution is desirable having lower barriers to entry that allows customers to assess analytical solutions for their workloads and lets data scientists experiment with available data on test systems before rolling out valuable analytical reports on a production system. In such a scenario where separate systems are deployed for handling transactional workloads of daily customers business and conducting business analytics on either a cloud service or a dedicated accelerator appliance, data management and placement strategies are of high importance. Multiple approaches exist for keeping the data set in-sync and guaranteeing data coherence with unique characteristics regarding important metrics that impact query performance, such as the latency when data will be propagated, achievable throughputs for larger data volumes, or the amount of required CPU to detect and deploy data changes. So the important heuristics are analyzed and evolved in order to develop a general model for data placement and maintenance strategies. Based on this theoretical model, a prototype is also implemented that predicts these metrics

Lazy State Determination for SQL databases

Transactional systems have seen various efforts to increase their throughput, mainly by making use of parallelism and efficient Concurrency Control techniques. Most approaches optimize the systems’ behaviour when under high contention. In this work, we strive towards reducing the system’s overall contention through Lazy State Determination (LSD). LSD is a new transactional API that leverages on futures to delay the accesses to the Database as much as possible, reducing the amount of time that transactions require to operate under isolation and, thus, reducing the contention window. LSD was shown to be a promising solution for Key-Value Stores. Now, our focus turns to Relational Database Management Systems, as we attempt to implement and evaluate LSD in this new setting. This implementation was done through a custom JDBC driver to minimize required modifications to any external platform. Results show that the reduction of the contention window effectively improves the success rate of transactional applications. However, our current implementation exhibits some performance issues that must be further investigated and addressed.Os sistemas transacionais têm sido alvo de esforços variados para aumentar a sua velocidade de processamento, principalmente através de paralelismo e de técnicas de controlo de concorrência mais eficazes. A maior parte das soluções propostas visam a otimização do comportamento destes sistemas em ambientes de elevada contenção. Neste trabalho, nós iremos reduzir a contenção no sistema recorrendo ao Lazy State Determination (LSD). O LSD é uma nova API transacional que promove a utilização de futuros para adiar o máximo os acessos à Base de Dados, reduzindo assim o tempo que cada transação requer para executar em isolamento e, por consequência, reduzindo também a janela de contenção. O LSD tem-se mostrado uma solução promissora para bases de dados Chave-Valor. O nosso foco foi agora redirecionado para Sistemas de Gestão de Bases de Dados Relacionais, com uma tentativa de implementação e avaliação do LSD neste novo contexto. Este objetivo foi concretizado através da implementação de um controlador JDBC para minimizar quaisquer alterações a plataformas externas. Os resultados mostram que a redução da janela de contenção efetivamente melhora a taxa de sucesso de aplicações transacionais. No entanto, a nossa implementação atual tem alguns problemas de desempenho que necessitam de ser investigados e endereçados

Winter 2014 Vol. 14 No. 1

https://surface.syr.edu/ischool_news/1017/thumbnail.jp

Architectures for integration of information systems under conditions of dynamic reconfiguration of virtual enterprises

Tese Doutoramento Programa Doutoral em Industrial and Systems EngineeringThe aim of this thesis is to explore Architectures of information systems Integration under conditions of dynamic reconfiguration of Virtual Enterprises. The main challenge that we identify and which formed the basis of the research is that information technologies alone cannot support efficiently and effectively the human knowledge and their natural way of interacting. Already from Sausurre (1916) it could be argued that part of knowledge resides in person, and the attempt to try to model it is sufficient for it to be misrepresented. And this is the motto of all this work. Enhance the capabilities of emerging technologies, but in the sense that allow humanto- human interaction, having the information system merely a means to make this possible. Thus we argue that a communicational architecture of information systems integration (where Pragmatics mechanisms are enabled) in virtual enterprises in dynamic reconfiguration scenarios, are better able than the existing transactional architectures. We propose a communicational architecture able to achieve an effective integration of information systems, as well as designing its logical and functional model. We also define the necessary semiotic framework in order to a communicational integration architecture could be efficient and effective. We implemented two prototypes to demonstrate the applicability of the proposed architecture. The demonstration of the research hypothesis was demonstrated with the realization of two experimentations where the ontologies have been unable to resolve disagreements or absences of opinion inherent in people who collaborated. This was overcome with the implementation of mechanisms that allow the co-creation between members of the group that participated in the trial.O objectivo desta tese é explorar Arquitecturas de Integração de Sistemas de Informação em condições de Reconfiguração Dinâmica de Empresas Virtuais. O principal desafio que identificamos e que serviu de base da pesquisa é que as tecnologias de informação por si só não conseguem suportar de forma eficiente e efectiva o conhecimento humano e a sua forma natural de interagir. Já Sausurre (1916) defendia que parte do conhecimento residirá sempre na pessoa, e a tentativa de o tentar modelar é suficiente para que seja deturpado. E esse é o mote de todo este trabalho. Enaltecer as capacidades das tecnologias emergentes mas no sentido de elas permitirem a interacção homem-to-homem, sendo o sistema de informação meramente um meio para que tal seja possível. Argumentamos por isso que uma arquitectura comunicacional de integração de sistemas de informação, onde Pragmatics mechanisms are enabled, em empresas virtuais em cenários de reconfiguração dinâmica, são mais capazes que as actuais arquitecturas transacionais. Propomos para isso uma arquitectura comunicacional capaz de conseguir uma integração efectiva de sistemas de informação, assim como desenhamos o seu modelo lógico e funcional. Definimos ainda o quadro semiótico necessário para que uma arquitectura comunicacional de integração seja eficiente e effectiva. Implementamos dois protótipos capazes de demonstrar a aplicabilidade da arquitectura proposta. A demonstração da hipótese de pesquisa ficou demonstrada com a realização de uma experimentação onde as ontologias se mostraram incapazes de resolver discordâncias ou ausências de opinião inerentes às pessoas que colaboram. Tal foi superado com a aplicação de mecanismos que permitiram a co-criação entre os membros do grupo que realizou a experimentação