The Quality of Bug Reports in Eclipse

Introduction

The information in bug reports influences the speed at which bugs are fixed. However, bug reports differ in their quality of information. We conducted a survey among ECLIPSE developers to determine the information in reports that they widely used and the problems frequently encountered. Our results show that steps to reproduce and stack traces are most sought after by developers, while inaccurate steps to reproduce and incomplete information pose the largest hurdles. Surprisingly, developers are indifferent to bug duplicates. Such insight is useful to design new bug tracking tools that guide reporters at providing more helpful information. We also present a prototype of a quality-meter tool that measures the quality of bug reports by scanning its content.

Download the Full Paper

The full paper is available for download, if you want to learn more about bug report quality.

Citation

If you would like to cite the research in your own work, please use the following citation:

@inproceedings{bettenburg:etx2007,
 author = "Nicolas Bettenburg and Sascha Just and Adrian Schroeter and Cathrin Weiss and Rahul Premraj and Thomas Zimmermann",
 title = "Quality of bug reports in Eclipse",
 booktitle = "ETX '07: Proceedings of the 2007 OOPSLA Workshop on Eclipse Technology eXchange",
 year = "2007",
 pages = "21--25",
 location = "Montreal, Quebec, Canada",
 publisher = "ACM"
}

Legal Disclaimer

This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author’s copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.