9,756 research outputs found

    Investigations on path indexing for graph databases

    Get PDF
    Graph databases have become an increasingly popular choice for the management of the massive network data sets arising in many contemporary applications. We investigate the effectiveness of path indexing for accelerating query processing in graph database systems, using as an exemplar the widely used open-source Neo4j graph database. We present a novel path index design which supports efficient ordered access to paths in a graph dataset. Our index is fully persistent and designed for external memory storage and retrieval. We also describe a compression scheme that exploits the limited differences between consecutive keys in the index, as well as a workload-driven approach to indexing. We demonstrate empirically the speed-ups achieved by our implementation, showing that the path index yields query run-times from 2x up to 8000x faster than Neo4j. Empirical evaluation also shows that our scheme leads to smaller indexes than using general-purpose LZ4 compression. The complete stand-alone implementation of our index, as well as supporting tooling such as a bulk-loader, are provided as open source for further research and development

    Cost Minimizing Energy Management Control Scheme for Microgrids Considering Dynamic Electricity Prices

    Get PDF
    As countries develop and technology improves, the world is using more energy than ever before. This fact along with several other political, social, and economic factors has resulted in simultaneous energy and climate crises. A partial solution to both problems is bringing clean energy sources of electricity closer to the customers who use that energy. A microgrid is a smaller version of the national electric grid where smaller electricity generators are networked with local consumers and controlled independently of the main grid. Because control of electricity sources and loads are transferred to local controllers, the flexibility with which they can be controlled increases. The research presented in this thesis optimizes microgrid control strategies that minimize operational costs and can result in microgrids becoming more affordable and more widespread. The research aims to be as versatile as possible by simulating microgrids connected to utilities with a variety of different rate schedules and pricing structures. The outcome of the research shows that using optimized control strategies lowers the operational costs of microgrids in each of the cases tested. The magnitude of savings depends largely on the type and amount of electricity sources that comprise the microgrid, the location of the microgrid, and the policies of local utilities

    The Japanese Economy and Economic Policy in Light of the East Asian Financial Crisis

    Get PDF
    The depth and breadth of the East Asian financial crisis has added a sense of acute urgency for some concrete and credible measures by policy-makers to revitalise the Japanese economy. While steps to be taken for the long-run competitiveness and economic revitalisation of the Japanese economy are clear (with the only doubt being about whether and how effectively they will be implemented), those needed to boost aggregate demand in the shortrun are far less obvious. Given the near-zero nominal interest rates in Japan, most observers argue that an expansionary monetary policy would be ineffective. However, as with Krugman (1998a,b), we argue that once a distinction is made between real and nominal interest rates, it is logically possible for monetary policy to be effective in raising demand if it is able to create inflationary expectations. This could probably be effected through explicit announcements by the Bank of Japan of the intention to target a certain inflation rate in the future.Japanese economy, economic policy, East Asia, financial crisis

    A System Modelling Approach to Assessment of Hybrid Water Supply Solutions in eThekwini Municipality

    Get PDF
    Water security in South Africa is a major concern, particularly in the context of urbanisation, the concomitant increases in water demand, and the potential for climate change to aggravate water shortages. Provision of basic services remains a significant challenge. Improving economic and social equity, vitally supported by adequate water supply and water quality, while ensuring environmental sustainability (maintaining water resources requires healthy ecosystems) is the dual challenge facing South Africa. There is growing recognition of the need for alternative approaches to water management, such as Sustainable Urban Water Management (SUWM). Decentralisation and integration to allow consideration of the total water cycle are fundamental themes of the SUWM paradigm. There is theoretical and experiential evidence that the current infrastructure archetype (of conveying a particular water stream from origin to destination by the most efficient means) could benefit from inclusion of such principles. SUWM is purported to have three core benefits: (1) A more natural water cycle, (2) Improved water security through diversification of sources, and (3) Resource efficiency. A complete transition to alternative water provision models is neither economical nor practically feasible in already developed areas, necessitating innovations in new areas and as retrofits to existing systems; systems where the water services configuration is evolving in this way are termed hybrid systems. Alternative water provision models bring dynamic changes to existing systems which may not be intuitive: the complexity of urban water systems and the resulting uncertainty means an intervention may achieve one SUWM objective yet undermine another. Thorough evaluations of alternative water provision models are therefore essential, while recognising that less learned experience on the performance of innovative solutions means uncertainty remains part of the evaluation. This research therefore aims to contribute to the theoretical body of knowledge on the net system effects of integrated management of the water cycle where alternative and decentralised solutions are introduced to existing systems. The overarching research objective was therefore application of an assessment framework, which was underpinned by the development of a systems dynamics model in GoldSim software. The systems dynamics model has been tailored for application to the selected case study area – eThekwini Municipality in South Africa. Akin to most South African cities, this region is home to a diverse range of consumers (fully serviced urban suburbs, informal settlements, peri-urban settlements, and rural areas), is experiencing urbanisation and growth in demand, and is supplied by catchments whose water resources are fully developed and are at risk of becoming significantly stressed. This is set against a backdrop of challenges in service delivery, environmental concerns as a result of water practices, potential impacts of climate change in the future, and ultimately sustainability of service provision. The developed systems dynamics model is a macro-scale integrated flow model, capable of assessing implementation of water servicing scenarios (specifically any combination of Water Conservation and Water Demand Management, rainwater harvesting, stormwater harvesting, groundwater use, greywater reuse, wastewater recycling, and desalination) at a regional level. Monte Carlo analyses were carried out to test system sensitivity to uncertainty in particular parameters. Of the possible interventions, five scenario paths were assessed: (1) Baseline, or “business as usual”, (2) WCWDM, (3) rainwater harvesting and real loss reduction, (4) greywater reuse and WCWDM, and (5) wastewater recycling and real loss reduction. Considered against the three core benefits of SUWM, each of the intervention scenarios yielded positive results. The developed model proved valuable in the scoping of SUWM interventions, and understanding the system-wide effects SUWM interventions may have on the water cycle. Such systems modelling approaches may therefore be considered to provide the framework and parameters within which further detailed and project-specific hydraulic and contaminant transport analysis could take place

    The Family of MapReduce and Large Scale Data Processing Systems

    Full text link
    In the last two decades, the continuous increase of computational power has produced an overwhelming flow of data which has called for a paradigm shift in the computing architecture and large scale data processing mechanisms. MapReduce is a simple and powerful programming model that enables easy development of scalable parallel applications to process vast amounts of data on large clusters of commodity machines. It isolates the application from the details of running a distributed program such as issues on data distribution, scheduling and fault tolerance. However, the original implementation of the MapReduce framework had some limitations that have been tackled by many research efforts in several followup works after its introduction. This article provides a comprehensive survey for a family of approaches and mechanisms of large scale data processing mechanisms that have been implemented based on the original idea of the MapReduce framework and are currently gaining a lot of momentum in both research and industrial communities. We also cover a set of introduced systems that have been implemented to provide declarative programming interfaces on top of the MapReduce framework. In addition, we review several large scale data processing systems that resemble some of the ideas of the MapReduce framework for different purposes and application scenarios. Finally, we discuss some of the future research directions for implementing the next generation of MapReduce-like solutions.Comment: arXiv admin note: text overlap with arXiv:1105.4252 by other author

    Managing drought: Learning from Australia

    Full text link
    California is facing yet another year of unprecedented, record-breaking drought. At this time of need, US agencies have turned to Australia to identify the strategies that urban water utilities and water agencies adopted to survive its worst drought in recorded history, the Millennium Drought, which lasted from 1997 until it officially ended in 2012

    Multi-species and multi-interest management: An ecosystem approach to market squid (Loligo opalescens) harvest in California

    Get PDF
    Market squid (Loligo opalescens) plays a vital role in the California ecosystem and serves as a major link in the food chain as both a predator and prey species. For over a century, market squid has also been harvested off the California coast from Monterey to San Pedro. Expanding global markets, coupled with a decline in squid product from other parts of the world, in recent years has fueled rapid expansion of the virtually unregulated California fishery. Lack of regulatory management, in combination with dramatic increases in fishing effort and landings, has raised numerous concerns from the scientific, fishing, and regulatory communities. In an effort to address these concerns, the National Oceanic and Atmospheric Administration’s (NOAA) Channel Islands National Marine Sanctuary (CINMS) hosted a panel discussion at the October 1997 California Cooperative Oceanic and Fisheries Investigations (CalCOFI) Conference; it focused on ecosystem management implications for the burgeoning market squid fishery. Both panel and audience members addressed issues such as: the direct and indirect effects of commercial harvesting upon squid biomass; the effects of harvest and the role of squid in the broader marine community; the effects of environmental variation on squid population dynamics; the sustainability of the fishery from the point of view of both scientists and the fishers themselves; and the conservation management options for what is currently an open access and unregulated fishery. Herein are the key points of the ecosystem management panel discussion in the form of a preface, an executive summary, and transcript. (PDF contains 33 pages.
    • 

    corecore