95,085 research outputs found
You Cannot Fix What You Cannot Find! An Investigation of Fault Localization Bias in Benchmarking Automated Program Repair Systems
Properly benchmarking Automated Program Repair (APR) systems should
contribute to the development and adoption of the research outputs by
practitioners. To that end, the research community must ensure that it reaches
significant milestones by reliably comparing state-of-the-art tools for a
better understanding of their strengths and weaknesses. In this work, we
identify and investigate a practical bias caused by the fault localization (FL)
step in a repair pipeline. We propose to highlight the different fault
localization configurations used in the literature, and their impact on APR
systems when applied to the Defects4J benchmark. Then, we explore the
performance variations that can be achieved by `tweaking' the FL step.
Eventually, we expect to create a new momentum for (1) full disclosure of APR
experimental procedures with respect to FL, (2) realistic expectations of
repairing bugs in Defects4J, as well as (3) reliable performance comparison
among the state-of-the-art APR systems, and against the baseline performance
results of our thoroughly assessed kPAR repair tool. Our main findings include:
(a) only a subset of Defects4J bugs can be currently localized by commonly-used
FL techniques; (b) current practice of comparing state-of-the-art APR systems
(i.e., counting the number of fixed bugs) is potentially misleading due to the
bias of FL configurations; and (c) APR authors do not properly qualify their
performance achievement with respect to the different tuning parameters
implemented in APR systems.Comment: Accepted by ICST 201
Paving the Roadway for Safety of Automated Vehicles: An Empirical Study on Testing Challenges
The technology in the area of automated vehicles is gaining speed and
promises many advantages. However, with the recent introduction of
conditionally automated driving, we have also seen accidents. Test protocols
for both, conditionally automated (e.g., on highways) and automated vehicles do
not exist yet and leave researchers and practitioners with different
challenges. For instance, current test procedures do not suffice for fully
automated vehicles, which are supposed to be completely in charge for the
driving task and have no driver as a back up. This paper presents current
challenges of testing the functionality and safety of automated vehicles
derived from conducting focus groups and interviews with 26 participants from
five countries having a background related to testing automotive safety-related
topics.We provide an overview of the state-of-practice of testing active safety
features as well as challenges that needs to be addressed in the future to
ensure safety for automated vehicles. The major challenges identified through
the interviews and focus groups, enriched by literature on this topic are
related to 1) virtual testing and simulation, 2) safety, reliability, and
quality, 3) sensors and sensor models, 4) required scenario complexity and
amount of test cases, and 5) handover of responsibility between the driver and
the vehicle.Comment: 8 page
Performance Evaluation of Malaysian University Website
In recent years, many people have devoted their efforts to the issue of Web site performance. Web performance testing can be divided into many categories. It is usually performed in different aspects such as user interface, functionality, interface compatibility, load/stress, and security. This research investigates Malaysian university performance of the website under the World Wide Web environment. In the World Wide Web environment, we measure real data and obtain response time via the evaluation procedure. This research conducts some tests to measure the performance of a web site via a website test. To get results on the performance of a Web site, we measure some data from the calculate page size, composition, and download time, markup validation ,number of broken link, and number of link connected to the site. Based on the observation result indicates that web sites performance of the Malaysian University website is relatively low compared to world class university website
International conference on software engineering and knowledge engineering: Session chair
The Thirtieth International Conference on Software Engineering and Knowledge Engineering (SEKE 2018) will be held at the Hotel Pullman, San Francisco Bay, USA, from July 1 to July 3, 2018. SEKE2018 will also be dedicated in memory of Professor Lofti Zadeh, a great scholar, pioneer and leader in fuzzy sets theory and soft computing.
The conference aims at bringing together experts in software engineering and knowledge engineering to discuss on relevant results in either software engineering or knowledge engineering or both. Special emphasis will be put on the transference of methods between both domains. The theme this year is soft computing in software engineering & knowledge engineering. Submission of papers and demos are both welcome
- …