Di Penta, Massimiliano

Di Penta Massimiliano

University of Szeged

PLENARY TALKSEmpirical Assessment of Software Engineering Research: Pitfallsand SolutionsMassimiliano Di PentaDepartment of Engineering, University of Sannio, ItalyThe availability of a wide variety of software repositories, ranging from Questions andAnswer forums to mailing lists, forges and issue trackers opens the road for building rec-ommender systems aimed at supporting developers in their activities. Upon evaluating suchrecommenders, in most cases researchers focus on the underlying approach capability of pro-viding accurate and complete results. This is insufficient because a tool could achieve an almostperfect precision and recall, however, its provided features do not really help software devel-opers in their everyday’s tasks.This keynote will report my personal experience (and those of my collaborators) in evaluat-ing recommenders, showing that an offline evaluation of the approach precision and recall isonly a very preliminary starting point. Importantly, different kinds of (qualitative and quanti-tative) evaluations, having different size and level of control, and above all involving humans,are required to achieve results able to convince practitioners of the actual usefulness and ap-plicability of a tool. Moreover, I will discuss and emphasize the important role played bycontextual information in the evaluation of recommender systems.3

Empirical assessment of software engineering research : pitfalls

and solutions

http://acta.bibl.u-szeged.hu/61750/1/cscs_2018_016.pdf

Empirical assessment of software engineering research : pitfalls and solutions

Abstract

Similar works

Full text

Available Versions

University of Szeged