TensorFlow-Program-Bugs

We're still working on automatically testing scripts for these bugs instead of manually testing, so test cases and scripts will be added later.

All reproducible bugs can be found in two files StackOverflow and Github. Every subject in these two files is named as root_cause-id, such as "APIC-1". File root_cause-id contains a buggy-version and a fix-version of the subject.

Environment

Most of the sujects run on TensorFlow 1.8.0. The rest of them can only run on other specific versions of TensorFlow.

We encoruage you to use conda or virtualenv to control your different versions of TensorFlow. Please make sure you get the following versions of TensorFlow:

1.8.0
1.1.0
1.0.0
0.12.0rc1
0.7.0
0.5.0

And we use python3 in most of the cases, except for Github/APIM-4 using python2.7.x.

StackOverflow

The assertion in each subject describes the version of TensorFlow on which the subject was reproduced.

Inputs of most subjects are integrated into the programs. The rest of them have been downloaded. We have fixed the random seeds of tensorflow, numpy, and random to get more stable results.

Except for SI-1 and Others-4 , all subjects contain only one entry python file which can be run using the command python entry.py. Testing methods of SI-1 and Others-4 are described in READMEs in these two files respectively.

Github

We provide a test_script.py or test-buggy.sh, test-fix.sh and data.sh as a test entry of most of sujects. The assertion in each test_script.py describes the version of TensorFlow and python on which the subject was reproduced.

We provide READMEs for the rest of them requiring speacial build configuration.