This repository contains the source code of the experiments that we performed for our automated framework to improve the descriptions of new manual test cases. This work was published at the 44th International Conference on Software Engineering (ICSE) - Industry track (2022). In you can find the paper here.
Currently, the framework automatically analyzes test cases written in natural language and provides three improvement recommendations:
-
Recommendations to improve the terminology of a new test case description based on existing test case descriptions through language modeling
-
Recommendations of potentially missing test steps for a new test case through frequent itemset and association rule mining
-
Recommendations of similar test cases that already exist in the test suite through a similarity detection technique that we proposed in a prior work
The following directories contains the source code of all the approaches that were part of our experiments.
-
language-models: contains the notebooks with the source code of our experiments with statistical and neural language models.
-
association-rules: contains the notebooks with the source code of our experiments with frequent itemset and association rule mining.
The notebooks with the source code of our experiments with different test case similarity techniques can be found in the repository of our previous work
The following dependencies are required to run the notebooks on your local machine:
-
Python 3.7
-
pip install numpy -
pip install pandas -
pip install matplotlib -
pip install plotly -
pip install scikit-learn -
pip install nltk -
pip install -U pip setuptools wheelpip install -U spacypython -m spacy download en_core_web_sm -
pip install transformers -
pip install torch