Experimental software engineering in educational context

Empirical studies are important in software engineering to evaluate new tools, techniques, methods and technologies in a structured way before they are introduced in the industrial (real) software process. Within this PhD thesis we will develop a framework of a consistent process for involving students as subjects of empirical studies of software engineering. In concrete, our experiences with software development teams composed of students will analyze how RUP (Rational Unified Process) processes can be compliant with the CMMI (Capability Maturity Model Integration), namely in the context of MLs (maturity levels) 2 and 3. Additionally, we will also analyze the influence of project management tools to improve the process maturity of the teams. Our final goal of carrying out empirical studies with students is to understand its validity when compared with the corresponding studies in real industrial settings

MLOS: An Infrastructure for Automated Software Performance Engineering

Developing modern systems software is a complex task that combines business logic programming and Software Performance Engineering (SPE). The later is an experimental and labor-intensive activity focused on optimizing the system for a given hardware, software, and workload (hw/sw/wl) context. Today's SPE is performed during build/release phases by specialized teams, and cursed by: 1) lack of standardized and automated tools, 2) significant repeated work as hw/sw/wl context changes, 3) fragility induced by a "one-size-fit-all" tuning (where improvements on one workload or component may impact others). The net result: despite costly investments, system software is often outside its optimal operating point - anecdotally leaving 30% to 40% of performance on the table. The recent developments in Data Science (DS) hints at an opportunity: combining DS tooling and methodologies with a new developer experience to transform the practice of SPE. In this paper we present: MLOS, an ML-powered infrastructure and methodology to democratize and automate Software Performance Engineering. MLOS enables continuous, instance-level, robust, and trackable systems optimization. MLOS is being developed and employed within Microsoft to optimize SQL Server performance. Early results indicated that component-level optimizations can lead to 20%-90% improvements when custom-tuning for a specific hw/sw/wl, hinting at a significant opportunity. However, several research challenges remain that will require community involvement. To this end, we are in the process of open-sourcing the MLOS core infrastructure, and we are engaging with academic institutions to create an educational program around Software 2.0 and MLOS ideas.Comment: 4 pages, DEEM 202

Remote laboratories in teaching and learning – issues impinging on widespread adoption in science and engineering education

This paper discusses the major issues that impinge on the widespread adoption of remote controlled laboratories in science and engineering education. This discussion largely emerges from the work of the PEARL project and is illustrated with examples and evaluation data from the project. Firstly the rationale for wanting to offer students remote experiments is outlined. The paper deliberately avoids discussion of technical implementation issues of remote experiments but instead focuses on issues that impinge on the specification and design of such facilities. This includes pedagogic, usability and accessibility issues. It compares remote experiments to software simulations. It also considers remote experiments in the wider context for educational institutions and outlines issues that will affect their decisions as to whether to adopt this approach. In conclusion it argues that there are significant challenges to be met if remote laboratories are to achieve a widespread presence in education but expresses the hope that this delineation of the issues is a contribution towards meeting these challenges

On Integrating Student Empirical Software Engineering Studies with Research and Teaching Goals

Background: Many empirical software engineering studies use students as subjects and are conducted as part of university courses. Aim: We aim at reporting our experiences with using guidelines for integrating empirical studies with our research and teaching goals. Method: We document our experience from conducting three studies with graduate students in two software architecture courses. Results: Our results show some problems that we faced when following the guidelines and deviations we made from the original guidelines. Conclusions: Based on our results we propose recommendations for empirical software engineering studies that are integrated in university courses.

Gamification in higher education and stem : a systematic review of literature

In recent years, gamification, the use of game elements in non-game contexts, has drawn the attention of educators due to the possibility of making learning more motivating and engaging; this led to an increase of research in the field. Despite the availability of literature reviews about gamification and its effects, no work to this date has focused exclusively on Higher Education (HE). Next, worldwide there is an increasing demand for skilled Science, Technology, Engineering and Mathematics (STEM) professionals that meet the challenges related to scientific and technological innovations of the 21st Century. This lead to the need of strengthening STEM Higher Education. This brings us to the purpose of this work: presenting a systematic literature review of empirical studies about gamification STEM related Higher Education. This review study started from a systematic mapping design of 'Web of Science' articles, with following inclusion criteria: empirical gamification studies set up in HE, published between 2000 and 2016; focusing on undergraduate or graduate students; in the STEM knowledge field, and set up in authentic settings. An initial search resulted in 562 potentially relevant articles. After applying all selection criteria, only 18 studies could be retained. 12 additional articles were included by analyzing references from earlier literature reviews, resulting in 30 studies to be included. Analysis results show how a combination of game elements (e.g. leaderboards, badges, points and other combinations) positively affects students' performance, attendance, goal orientation and attitude towards mostly computer science related subjects. The analysis results also point at a lack of studies in certain STEM areas, a lack of studies that identify the particular game element associated with the positive differential impact on student performance; a lack of validated psychometric measurements, and lack of focus on student variables that could/should be taken into account as mediating/moderating variables clarifying the impact of gamification in the HE focus on STEM learning and teaching

Developing Educational Software: a professional tool perspective

The selection, and use of educational software and its impact in schools are still controversial issues. In this paper we present an alternative conceptualisation of educational software based on considering the software as an instrument for teachers’ professional performance. We review previous work in the areas of the design, development and evaluation of educational software and of the process of educational innovation. The review of these four areas converges to demonstrate the need for knowing and considering the context of use of educational software and for understanding users' perspectives about its roles and possibilities and hence supports a consideration a perspective on educational software which sees it as a professional tool for teachers performance of their teaching role

Empirical modelling principles to support learning in a cultural context

Much research on pedagogy stresses the need for a broad perspective on learning. Such a perspective might take account (for instance) of the experience that informs knowledge and understanding [Tur91], the situation in which the learning activity takes place [Lav88], and the influence of multiple intelligences [Gar83]. Educational technology appears to hold great promise in this connection. Computer-related technologies such as new media, the internet, virtual reality and brain-mediated communication afford access to a range of learning resources that grows ever wider in its scope and supports ever more sophisticated interactions. Whether educational technology is fulfilling its potential in broadening the horizons for learning activity is more controversial. Though some see the successful development of radically new educational resources as merely a matter of time, investment and engineering, there are also many critics of the trends in computer-based learning who see little evidence of the greater degree of human engagement to which new technologies aspire [Tal95]. This paper reviews the potential application to educational technology of principles and tools for computer-based modelling that have been developed under the auspices of the Empirical Modelling (EM) project at Warwick [EMweb]. This theme was first addressed at length in a previous paper [Bey97], and is here revisited in the light of new practical developments in EM both in respect of tools and of model-building that has been targetted at education at various levels. Our central thesis is that the problems of educational technology stem from the limitations of current conceptual frameworks and tool support for the essential cognitive model building activity, and that tackling these problems requires a radical shift in philosophical perspective on the nature and role of empirical knowledge that has significant practical implications. The paper is in two main sections. The first discusses the limitations of the classical computer science perspective where educational technology to support situated learning is concerned, and relates the learning activities that are most closely associated with a cultural context to the empiricist perspective on learning introduced in [Bey97]. The second outlines the principles of EM and describes and illustrates features of its practical application that are particularly well-suited to learning in a cultural setting