scoban / mutation-analysis

Experimental Evaluation and Comparison of Java Mutation Tools

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Mutation Testing and Analysis with different Java Mutation Tools

Introduction

Mutation testing is a fault based technique which helps to evaluate the performance of test suites. The effectiveness of test suites are measured by how many faults are detected.

Related Works

  • A Comparative analysis of Mutation Testing tools for Java
  • A Comparison of Mutation Analysis Tools for Java
  • How Effective Mutation Testing Tools Are? An Empirical Analysis of Java Mutation Testing Tools with Manual Analysis and Real Faults

Tools

The tools which are used to perform experiments are Judy, Major and PIT. These tools are freely available and used frequently. In this study, we will focus on these tools.

Major ( Mutation Analysis in a Java cOmpileR)

Major is also a tool that is mostly used in studies. Major tool is integrated into the Java Compiler, therefore, it can be used in any Java-based environments. The process of generating mutant is that it manipulates the abstract syntax tree of component which is going to be tested. It is also known as conditional mutation analysis tools.

alt text

MAJOR has a DSL support for specifying and adapting mutation operators. This makes Major extensible for mutation operators.

Judy

Judy is an implementation of the FAMTA Light approach developed in Java with AspectJ extensions.

Experiment Result

alt text alt text alt text

About

Experimental Evaluation and Comparison of Java Mutation Tools


Languages

Language:Shell 48.3%Language:Java 31.1%Language:Batchfile 19.5%Language:Makefile 1.1%