The Family of MapReduce and Large Scale Data Processing Systems

In the last two decades, the continuous increase of computational power has produced an overwhelming flow of data which has called for a paradigm shift in the computing architecture and large scale data processing mechanisms. MapReduce is a simple and powerful programming model that enables easy development of scalable parallel applications to process vast amounts of data on large clusters of commodity machines. It isolates the application from the details of running a distributed program such as issues on data distribution, scheduling and fault tolerance. However, the original implementation of the MapReduce framework had some limitations that have been tackled by many research efforts in several followup works after its introduction. This article provides a comprehensive survey for a family of approaches and mechanisms of large scale data processing mechanisms that have been implemented based on the original idea of the MapReduce framework and are currently gaining a lot of momentum in both research and industrial communities. We also cover a set of introduced systems that have been implemented to provide declarative programming interfaces on top of the MapReduce framework. In addition, we review several large scale data processing systems that resemble some of the ideas of the MapReduce framework for different purposes and application scenarios. Finally, we discuss some of the future research directions for implementing the next generation of MapReduce-like solutions.Comment: arXiv admin note: text overlap with arXiv:1105.4252 by other author

Comparison of PostgreSQL & Oracle Database

Goal thesis is to compare the practical side of Database Management Systems of famous databases: PostgreSQL and ORACLE in the consideration of commercial opinions and technical features. As the goal that they have conjunctly engaged an essential part in the field of Database Management Systems, so, the complete comparison of the collection standards of these two databases is under a lot of attention of mixed users. Along with the profitable market analyze and anatomize the detailed technical functionalities of the two databases, readers could get a rich view of the usability of the databases while standing on a great vantage opinion and have a prophetic view of their future. The similar theme has not been in the Electronic library Theseus already which means it is a great chance to make up the vacant field. The Database Management Systems ideas and issues care the thesis content over the whole description construction that is regard as analysis tips for readers. The experiential study is more based on study and match of regular data that gather from Internet establishments and guide references the outcome of specific tests that done on dissimilar platforms. These rewards are to classify variations among ORACLE and PostgreSQL. Communications with administrators also plays a key role as a dynamic source of stimulus. Conversely limits are still being as the inaccessible to those private statistics and the databases core skill confidentialities. Limitation also emerged for the analysis equipment were more persuasive enough to make deductions which are pleased the scientific standards. Additional observes and checks are advised if the thesis outcome is wanted to be used in academic

Open archival information systems for database preservation

Tese de mestrado integrado. Engenharia Informática e Computação. Universidade do Porto. Faculdade de Engenharia. 201

Omejevanje dostopa pri obvladovanju API-jev

With ever growing usage of World Wide Web, number of requests to web APIs is increasing rapidly. DoS attacks and service abuses are becoming easier to execute, and more common every day. Quality of service is becoming more important as competition is rising. To build robust and reliable services, software engineers have to take this into account when designing web APIs, to deliver end users with a pleasant and reliable experience. In this thesis we delve into rate limiting in web API management to deal with those problems on scale. We propose an approach to rate limiting when request weighting is key, and cannot be estimated/calculated upfront. We show how integration of such approach into a real working system can help in achieving high stability and performance improvements, while unlocking some advanced API monetisation opportunities.Strma rast uporabe svetovnega spleta je silovito povečala število spletnih zahtevkov, ki jih morajo procesirati zaledni sistemi. Napadi za zavrnitev storitev in zlorabe le-teh so vse bolj pogosti in enostavni za izvedbo. Kvaliteta in zanesljivost sistemov sta ključnega pomena za ohranjanje konkurenčnosti. Naloga razvijalcev programske opreme je, da z upoštevanjem teh zahtev načrtujejo robustne sisteme, ki bodo uporabnikom omogočili prijetno in zane-sljivo uporabniško izkušnjo. V tej diplomski nalogi raziščemo pristop omejevanja dostopa pri obvladovanju API-jev za reševanje omenjenih problemov. Predlagamo pristop pri katerem je obteževanje spletnih zahtevkov ključnega pomena in ne more biti ocenjeno/izračunano pred procesiranjem zahtevka. Pokažemo kako lahko integracija takšnega pristopa v delujoč sistem občutno izboljša stabilnost in učinkovitost storitev ter odpre možnosti za nove načine trženja API-jev

TLAD 2010 Proceedings:8th international workshop on teaching, learning and assesment of databases (TLAD)

This is the eighth in the series of highly successful international workshops on the Teaching, Learning and Assessment of Databases (TLAD 2010), which once again is held as a workshop of BNCOD 2010 - the 27th International Information Systems Conference. TLAD 2010 is held on the 28th June at the beautiful Dudhope Castle at the Abertay University, just before BNCOD, and hopes to be just as successful as its predecessors.The teaching of databases is central to all Computing Science, Software Engineering, Information Systems and Information Technology courses, and this year, the workshop aims to continue the tradition of bringing together both database teachers and researchers, in order to share good learning, teaching and assessment practice and experience, and further the growing community amongst database academics. As well as attracting academics from the UK community, the workshop has also been successful in attracting academics from the wider international community, through serving on the programme committee, and attending and presenting papers.This year, the workshop includes an invited talk given by Richard Cooper (of the University of Glasgow) who will present a discussion and some results from the Database Disciplinary Commons which was held in the UK over the academic year. Due to the healthy number of high quality submissions this year, the workshop will also present seven peer reviewed papers, and six refereed poster papers. Of the seven presented papers, three will be presented as full papers and four as short papers. These papers and posters cover a number of themes, including: approaches to teaching databases, e.g. group centered and problem based learning; use of novel case studies, e.g. forensics and XML data; techniques and approaches for improving teaching and student learning processes; assessment techniques, e.g. peer review; methods for improving students abilities to develop database queries and develop E-R diagrams; and e-learning platforms for supporting teaching and learning

TLAD 2010 Proceedings:8th international workshop on teaching, learning and assesment of databases (TLAD)

This is the eighth in the series of highly successful international workshops on the Teaching, Learning and Assessment of Databases (TLAD 2010), which once again is held as a workshop of BNCOD 2010 - the 27th International Information Systems Conference. TLAD 2010 is held on the 28th June at the beautiful Dudhope Castle at the Abertay University, just before BNCOD, and hopes to be just as successful as its predecessors.The teaching of databases is central to all Computing Science, Software Engineering, Information Systems and Information Technology courses, and this year, the workshop aims to continue the tradition of bringing together both database teachers and researchers, in order to share good learning, teaching and assessment practice and experience, and further the growing community amongst database academics. As well as attracting academics from the UK community, the workshop has also been successful in attracting academics from the wider international community, through serving on the programme committee, and attending and presenting papers.This year, the workshop includes an invited talk given by Richard Cooper (of the University of Glasgow) who will present a discussion and some results from the Database Disciplinary Commons which was held in the UK over the academic year. Due to the healthy number of high quality submissions this year, the workshop will also present seven peer reviewed papers, and six refereed poster papers. Of the seven presented papers, three will be presented as full papers and four as short papers. These papers and posters cover a number of themes, including: approaches to teaching databases, e.g. group centered and problem based learning; use of novel case studies, e.g. forensics and XML data; techniques and approaches for improving teaching and student learning processes; assessment techniques, e.g. peer review; methods for improving students abilities to develop database queries and develop E-R diagrams; and e-learning platforms for supporting teaching and learning

Letter from the Special Issue Editor

Editorial work for DEBULL on a special issue on data management on Storage Class Memory (SCM) technologies

StudMap 3.0 : an interoperable web-based platform for geospatial data offers in academic life

Dissertation submitted in partial fulfilment of the requirements for the Degree of Master of Science in Geospatial TechnologiesGeographic Information Systems has now entered the realm of web and yields for feasible solutions to balance the technology offers with the users’ needs to share, access and explore the massive amounts of geodata available. Challenges occur when moving forward from old 2D platforms towards innovative and integrated webGIS systems that align functionality with the necessity to grant a complete understanding of the surrounding reality. 3D space responds to this but, however, stands only at the beginning of its era and cannot yet reach the development of 2D web integration. Research is now aiming at possible webGIS solutions to adapt to the special structure imposed by 3D data. In this context, this thesis focuses on designing an architecture for 2D and 3D geospatial data integration on a student-oriented web platform. This concept was further delivered and validated through a real case scenario – Studmap 3.0, a webGIS platform to serve the students of the University of Muenster in their academical life. The portal currently grants availability of geospatial data and web services of regional interest in a smart GIS environment that allows access and comparison of official services with own data. The implementation of Studmap 3.0 aided in the continuous improvement of the proposed architecture model and developed under a design science research cycle that reached its end once the final approval of its users was attained via a usability evaluation. Final strengths and drawbacks of the proposed architecture were ultimately identified together with an expert usability evaluation and a lab-based usability test of the resulting portal interface suitability for academic use. The results fall under the acceptable range with an 83.75 score for the System Usability Scale standardized questions when addressed to experts and a score of 83.87 when addressed to students. For the open-ended questions, the interface received an overall positive critique. A summary of future participants’ opinion on the benefits, drawbacks and proposed improvements was also delivered. Peers interested in similar concepts can use both this model and its final remarks as a reference for their work