SlideShare a Scribd company logo

Quality of Bug Reports in Open Source

Thomas Zimmermann, profile picture
Thomas Zimmermann

The document discusses research into what makes a good bug report based on a survey of over 150 developers. It finds that the most helpful items for fixing bugs are steps to reproduce, stack traces, and observed behavior. The biggest problems causing delays are incomplete information, wrong steps to reproduce, and wrong expected behavior. The research also measured bug report quality and found stack traces and readability correlated with shorter fix times.

Technology
1 of 46
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source
Quality of Bug Reports in Open Source

More Related Content

PDF
Implementing Quality on a Java Project
Vincent Massol
 
PPTX
Reporting bugs: Errors Made and Lessons Learned
Peter Sabev
 
PDF
Testing Plug-in Architectures
Arie van Deursen
 
PPTX
Agile testing for mere mortals
Dave Haeffner
 
PDF
Agile Testing Overview
Elisabeth Hendrickson
 
PDF
ICSE 2012: Test Confessions - A study of testing practices for plug-in systems
Michaela Greiler
 
KEY
Testing w-mocks
Macon Pegram
 
PDF
Selenium Users Anonymous
Dave Haeffner
 
Implementing Quality on a Java Project
Vincent Massol
 
Reporting bugs: Errors Made and Lessons Learned
Peter Sabev
 
Testing Plug-in Architectures
Arie van Deursen
 
Agile testing for mere mortals
Dave Haeffner
 
Agile Testing Overview
Elisabeth Hendrickson
 
ICSE 2012: Test Confessions - A study of testing practices for plug-in systems
Michaela Greiler
 
Testing w-mocks
Macon Pegram
 
Selenium Users Anonymous
Dave Haeffner
 

What's hot (20)

PDF
Effective Software Testing for Modern Software Development
Alan Richardson
 
PDF
5-Ways-to-Revolutionize-Your-Software-Testing
Mary Clemons
 
PPTX
Improving developer tester collaboration with microsoft visual studio 2010
Mohamed Samy
 
PDF
Exploratory Testing in Practice
Elisabeth Hendrickson
 
PDF
The Testing Planet - July 2010
softwaretestingclub
 
PPTX
The Best Pairwise Testing Tool / Best Orthogonal Array Tool Just Got Better
Justin Hunter
 
PDF
Devfest 2019-slides
Alan Richardson
 
PPTX
10 Useful Testing Tools for Open Source Projects @ TuxCon 2015
Peter Sabev
 
PDF
Avc rem 201211_en
Anatoliy Tkachev
 
PDF
Test Driven Development
Dhaval Dalal
 
PPTX
Test-Driven Development In Action
Jon Kruger
 
PPTX
Testability for developers – Fighting a mess by making it testable
Alexander Tarlinder
 
PDF
Common Challenges & Best Practices for TDD on iOS
Derek Lee
 
PDF
Rapid Software Testing
vladimir zaremba
 
PDF
Lessons learned in agile romania
OpenAgile Romania
 
PPTX
Test Driven Development (C#)
Alan Dean
 
PDF
Mutation Testing DevoxxUK 2021
Paco van Beckhoven
 
PDF
100% Code Coverage in Real World Software
Andreas Czakaj
 
PDF
10 Ways To Improve Your Code
ConSanFrancisco123
 
PDF
Test Drive Development
satya sudheer
 
Effective Software Testing for Modern Software Development
Alan Richardson
 
5-Ways-to-Revolutionize-Your-Software-Testing
Mary Clemons
 
Improving developer tester collaboration with microsoft visual studio 2010
Mohamed Samy
 
Exploratory Testing in Practice
Elisabeth Hendrickson
 
The Testing Planet - July 2010
softwaretestingclub
 
The Best Pairwise Testing Tool / Best Orthogonal Array Tool Just Got Better
Justin Hunter
 
Devfest 2019-slides
Alan Richardson
 
10 Useful Testing Tools for Open Source Projects @ TuxCon 2015
Peter Sabev
 
Avc rem 201211_en
Anatoliy Tkachev
 
Test Driven Development
Dhaval Dalal
 
Test-Driven Development In Action
Jon Kruger
 
Testability for developers – Fighting a mess by making it testable
Alexander Tarlinder
 
Common Challenges & Best Practices for TDD on iOS
Derek Lee
 
Rapid Software Testing
vladimir zaremba
 
Lessons learned in agile romania
OpenAgile Romania
 
Test Driven Development (C#)
Alan Dean
 
Mutation Testing DevoxxUK 2021
Paco van Beckhoven
 
100% Code Coverage in Real World Software
Andreas Czakaj
 
10 Ways To Improve Your Code
ConSanFrancisco123
 
Test Drive Development
satya sudheer
 
Ad

Similar to Quality of Bug Reports in Open Source (20)

PDF
10 Ways To Improve Your Code( Neal Ford)
guestebde
 
PPTX
DevOps - Boldly Go for Distro
Paul Boos
 
PDF
Howto Test A Patch And Make A Difference!
Joel Farris
 
PDF
Testing Hourglass at Jira Frontend - by Alexey Shpakov, Sr. Developer @ Atlas...
Applitools
 
ZIP
Improving Bug Tracking Systems
Rahul Premraj
 
PDF
The limits of unit testing by Craig Stuntz
QA or the Highway
 
PDF
The Limits of Unit Testing by Craig Stuntz
QA or the Highway
 
PPTX
Entaggle: an Agile Software Development Case Study
Elisabeth Hendrickson
 
ODP
The Art Of Debugging
svilen.ivanov
 
PDF
Improving your Agile Process
David Copeland
 
ODP
Dev ops
Eslam El Husseiny
 
PDF
Neo4j Stored Procedure Training Part 1
Max De Marzi
 
PPTX
Chapter 3 Reducing Risks Using CI
Jherson Martelo Medina
 
PPT
Testing In Java
Adrian Treacy
 
PDF
React performance
Derek Willian Stavis
 
ODP
I Smell A RAT- Rapid Application Testing
Peter Presnell
 
PPTX
Releasing fast code - The DevOps approach
Michael Kopp
 
PDF
Continuous Testing
jaredrrichardson
 
PPTX
assertYourself - Breaking the Theories and Assumptions of Unit Testing in Flex
michael.labriola
 
PDF
Dev and Ops Collaboration and Awareness at Etsy and Flickr
John Allspaw
 
10 Ways To Improve Your Code( Neal Ford)
guestebde
 
DevOps - Boldly Go for Distro
Paul Boos
 
Howto Test A Patch And Make A Difference!
Joel Farris
 
Testing Hourglass at Jira Frontend - by Alexey Shpakov, Sr. Developer @ Atlas...
Applitools
 
Improving Bug Tracking Systems
Rahul Premraj
 
The limits of unit testing by Craig Stuntz
QA or the Highway
 
The Limits of Unit Testing by Craig Stuntz
QA or the Highway
 
Entaggle: an Agile Software Development Case Study
Elisabeth Hendrickson
 
The Art Of Debugging
svilen.ivanov
 
Improving your Agile Process
David Copeland
 
Dev ops
Eslam El Husseiny
 
Neo4j Stored Procedure Training Part 1
Max De Marzi
 
Chapter 3 Reducing Risks Using CI
Jherson Martelo Medina
 
Testing In Java
Adrian Treacy
 
React performance
Derek Willian Stavis
 
I Smell A RAT- Rapid Application Testing
Peter Presnell
 
Releasing fast code - The DevOps approach
Michael Kopp
 
Continuous Testing
jaredrrichardson
 
assertYourself - Breaking the Theories and Assumptions of Unit Testing in Flex
michael.labriola
 
Dev and Ops Collaboration and Awareness at Etsy and Flickr
John Allspaw
 
Ad

More from Thomas Zimmermann (20)

PDF
Software Analytics = Sharing Information
Thomas Zimmermann
 
PDF
MSR 2013 Preview
Thomas Zimmermann
 
PDF
Predicting Method Crashes with Bytecode Operations
Thomas Zimmermann
 
PDF
Analytics for smarter software development
Thomas Zimmermann
 
PDF
Characterizing and Predicting Which Bugs Get Reopened
Thomas Zimmermann
 
PPT
Klingon Countdown Timer
Thomas Zimmermann
 
PDF
Data driven games user research
Thomas Zimmermann
 
PDF
Not my bug! Reasons for software bug report reassignments
Thomas Zimmermann
 
PDF
Empirical Software Engineering at Microsoft Research
Thomas Zimmermann
 
PDF
Security trend analysis with CVE topic models
Thomas Zimmermann
 
PDF
Analytics for software development
Thomas Zimmermann
 
PDF
Characterizing and predicting which bugs get fixed
Thomas Zimmermann
 
PDF
Changes and Bugs: Mining and Predicting Development Activities
Thomas Zimmermann
 
PDF
Cross-project defect prediction
Thomas Zimmermann
 
PDF
Changes and Bugs: Mining and Predicting Development Activities
Thomas Zimmermann
 
PDF
Predicting Defects using Network Analysis on Dependency Graphs
Thomas Zimmermann
 
PDF
Meet Tom and his Fish
Thomas Zimmermann
 
PDF
Predicting Subsystem Defects using Dependency Graph Complexities
Thomas Zimmermann
 
PDF
Got Myth? Myths in Software Engineering
Thomas Zimmermann
 
PDF
Mining Workspace Updates in CVS
Thomas Zimmermann
 
Software Analytics = Sharing Information
Thomas Zimmermann
 
MSR 2013 Preview
Thomas Zimmermann
 
Predicting Method Crashes with Bytecode Operations
Thomas Zimmermann
 
Analytics for smarter software development
Thomas Zimmermann
 
Characterizing and Predicting Which Bugs Get Reopened
Thomas Zimmermann
 
Klingon Countdown Timer
Thomas Zimmermann
 
Data driven games user research
Thomas Zimmermann
 
Not my bug! Reasons for software bug report reassignments
Thomas Zimmermann
 
Empirical Software Engineering at Microsoft Research
Thomas Zimmermann
 
Security trend analysis with CVE topic models
Thomas Zimmermann
 
Analytics for software development
Thomas Zimmermann
 
Characterizing and predicting which bugs get fixed
Thomas Zimmermann
 
Changes and Bugs: Mining and Predicting Development Activities
Thomas Zimmermann
 
Cross-project defect prediction
Thomas Zimmermann
 
Changes and Bugs: Mining and Predicting Development Activities
Thomas Zimmermann
 
Predicting Defects using Network Analysis on Dependency Graphs
Thomas Zimmermann
 
Meet Tom and his Fish
Thomas Zimmermann
 
Predicting Subsystem Defects using Dependency Graph Complexities
Thomas Zimmermann
 
Got Myth? Myths in Software Engineering
Thomas Zimmermann
 
Mining Workspace Updates in CVS
Thomas Zimmermann
 

Recently uploaded (20)

PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
ZubinRadhakrishnan
 
PPTX
Big Data Technologies - Introduction.pptx
kuthubussaman1
 
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
DatVoNgoc
 
PDF
NewMind AI Monthly Chronicles - July 2025
NewMind AI
 
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
IAESIJAI
 
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
SOFTTECHHUB
 
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
3G4G
 
PDF
KodekX | Application Modernization Development
KodekX
 
PDF
Approach and Philosophy of On baking technology
30anthuong17
 
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
blackmambaettijean
 
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Safe Software
 
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
ReZa AdineH
 
PPTX
Understanding_Digital_Forensics_Presentation.pptx
ImranKhan423233
 
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
SOFTTECHHUB
 
PDF
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
IAESIJAI
 
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
ReZa AdineH
 
PDF
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
SHREYAS PHANSE
 
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Peter Tan
 
PDF
Empathic Computing: Creating Shared Understanding
Mark Billinghurst
 
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Jian-Hong Pan
 
“AI and Expert System Decision Support & Business Intelligence Systems”
ZubinRadhakrishnan
 
Big Data Technologies - Introduction.pptx
kuthubussaman1
 
20250228 LYD VKU AI Blended-Learning.pptx
DatVoNgoc
 
NewMind AI Monthly Chronicles - July 2025
NewMind AI
 
Per capita expenditure prediction using model stacking based on satellite ima...
IAESIJAI
 
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
SOFTTECHHUB
 
The Rise and Fall of 3GPP – Time for a Sabbatical?
3G4G
 
KodekX | Application Modernization Development
KodekX
 
Approach and Philosophy of On baking technology
30anthuong17
 
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
blackmambaettijean
 
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Safe Software
 
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
ReZa AdineH
 
Understanding_Digital_Forensics_Presentation.pptx
ImranKhan423233
 
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
SOFTTECHHUB
 
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
IAESIJAI
 
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
ReZa AdineH
 
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
SHREYAS PHANSE
 
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Peter Tan
 
Empathic Computing: Creating Shared Understanding
Mark Billinghurst
 
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Jian-Hong Pan