thatstatsguy / awesome-mutation-testing

Mutation testing resources: how to make better code by introducing bugs

Awesome Mutation testing

Mutation testing is the practice of making better code by introducing bugs. As of now this repository is used to keep track of the current mutation testing tools developed and related resources. Its contents and purpose may however evolve depending on the community.

Discord Invite

Contents

• Existing libraries
• Abandoned libraries
• Visualization Tool
• Papers
• Blogs/Posts/Videos
• Conferences
• Friendly resources
• Tutorials

Existing libraries

• Alloy
  • MuAlloy
    • MuAlloy papers
• C/C++
  • llvm-mutate
  • Frama-C plugin
  • mull-project/mull
  • mutate_cpp
  • MuCPP
    • Assessment of Class Mutation Operators for C++ with the MuCPP Mutation System
  • accmut
    • Faster mutation analysis via equivalence modulo states
  • MUSIC
    • MUSIC: Mutation Analysis Tool with High Configurability and Extensibility
  • Dextool Mutate
  • SRCIROR - A mutation tool for source and IR
    • SRCIROR: A Toolset for Mutation Testing of C Source Code and LLVM Intermediate Representation
  • MART
• C#
  • stryker-mutator/stryker-net
  • ComparetheMarket/fettle
  • Testura.Mutation
  • Faultify
• Clojure
  • mutant
• Crystal
  • crytic
• Elixir
  • JordiPolo/mutation
• Erlang
  • parsifal-47/muterl
• Go
  • zimmski/go-mutesting
  • Ooze
• Haskell
  • mucheck
  • rudymatela/fitspec
• Java/JVM
  • hcoles/pitest * PIT : A Practical Mutation Testing Tool for Java (Demo) * An Experimental Evaluation of PIT’s Mutation Operators
    • Introduction to Mutation Testing
    • Faster Mutation Testing (in Java)
      • Voxxed Athens 2017 :: Mutation Testing to the rescue of your Tests • Nicolas Fränkel
  • aliparsai/LittleDarwin
    • LittleDarwin: a Feature-Rich and Extensible Mutation Testing Framework for Large and Complex Java Systems
  • metamutator
  • Major
    • Publications related to the Major mutation framework
• JavaScript
  • stryker-mutator/stryker
• PHP
  • infection/infection
• Python
  • sixty-north/cosmic-ray
  • boxed/mutmut
• Ruby
  • mbj/mutant
    • Kill all the mutants - a deep dive into mutation testing and how the Mutant gem works
  • backus/mutest
• Rust
  • llogiq/mutagen
• Scala
  • sugakandrey/scalamu
  • stryker4s
• Smalltalk
  • pavel-krivanek/mutalk
• Swift
  • SeanROlszewski/muter
• Other
  • agroce/universalmutator
  • boggart

Visualization Tool

• sqrlab/VisMAn

Papers

• Mutation Testing Repository
• An Analysis and Survey of the Development of Mutation Testing
• Mutation Testing Advances: An Analysis and Survey
• Are Mutants a Valid Substitute for Real Faults in Software Testing?
• Predicting Mutation Scores using Source Code and Test Suite Metrics
• CrestWeb
• Mutation Testing Repository at LU
• An Industrial Application of Mutation Testing: Lessons, Challenges, and Research Direction
• Predictive Mutation Testing
• Semantic Mutation Testing
• Assessing Test Quality
• Mutation Testing
• Mutation Testing: Guideline and Mutation Operator Classification
• Faster Mutation Testing Inspired by Test Prioritization and Reduction
• Estimation and Enhancement of Real-Time Software Reliability through Mutation Analysis
• Problems of Mutation Testing and Higher Order Mutation Testing
• Effectiveness of Mutation Testing Techniques: Reducing Mutation Cost
• Reducing the Cost of Android Mutation Testing
• A Systematic Literature Review of Techniques and Metrics to Reduce the Cost of Mutation Testing
• Effective Methods to Tackle the Equivalent Mutant Problem when Testing Software with Mutation
• Goal-Oriented Mutation Testing with Focal Methods
• OUTRIDER: Optimizing the mUtation Testing pRocess In Distributed EnviRonments
• Mutation testing: practical aspects and cost analysis
• Mitigating the Effects of Flaky Tests on Mutation Testing
• Speeding-Up Mutation Testing via Data Compression and State Infection
• State of Mutation Testing at Google
• Operator-Based and Random Mutant Selection: Better Together
• Towards effective mutation testing for ATL
• PropEr Testing
• Mutation Testing in the wild: findings from GitHub
• Mutation Testing by Goran Petrovic

Blogs/Posts/Videos

• Mutant Musings
• RailsConf 2017: How to Write Better Code Using Mutation Testing • John Backus
• FOSDEM 2017: Mutation Testing: Leaving the Stone Age • Alex Denisov
• GOTO 2015: Mutation Testing in Python • Austin Bingham
• GOTO 2019 • Making Mutants Work for You • Henry Coles
• Jfokus 2016: From jUnit to Mutation-Testing • Sven Ruppert
• PHPDeveloperDay 2018: Mutation Testing • Theo Fidry
• Test Automation Research for Industry 2019: Mutation Testing, Opportunities and Pitfalls • Ali Parsai
• Markus Schirp On Mutation Operators

Conferences

• International Workshop on Mutation Analysis
  • MUTATION 2018, The 13th International Workshop on Mutation Analysis

Friendly resources

• atodorov/mutation-testing-in-patterns
  • Practical examples of software and testing patterns related to mutation testing Mutation Testing in Patterns

Tutorials

• Introduction to Mutation Testing with PIT (Java)