Paper reference: R. Tufan, L. Pascarella, M. Tufanoy, D. Poshyvanykz, and G. Bavota, “Towards automating code review activities,” in 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE). IEEE, 2021, pp. 163–174.
- Tensorflow-gpu 1.15.4 This project should work with GPU. If you don't have a GPU environment, training and inference will be very slow.
- gensim 4.1.2
The dataset is in the Dataset directory, which contains the source dataset and the processed dataset.Our training code needs to convert the real code into a token form and combine the input and output, separating each code with a -1 flag.
The processing process is shown in the figure:
If you want to use a custom dataset, please refer to the following procedure:
Now you have src-xxx.txt
and tgt-xxx.txt
.You need to merge these file contents into all.txt
.
For example:
src-train.txt
tgt-train.txt
src-val.txt
tgt-val.txt
src-test.txt
tgt-test.txt
Linux:
cat src-train.txt tgt-train.txt src-val.txt tgt-val.txt src-test.txt tgt-test.txt > all.txt
Windows:
type src-train.txt tgt-train.txt src-val.txt tgt-val.txt src-test.txt tgt-test.txt > all.txt
For the generated all.txt
, execute create_vocab.py
to generate the vocabulary.
For src-xxx.txt
and tgt-xxx.txt
, you can execute create_dataset.py
to generate a file in Token format.
Before model training, some parameters need to be set, such as vocabulary size, length of generated sentences, etc.
In train.py
:
--from_vocab_size
and--to_vocab_size
:You can choose to set it in a file or specify it in a command line argument--beam_size
:Set the number of sentences to generate output for an input
In model.py
:
max_story_length
:The longest length of the sum of the input and output sentencesmax_length
:The maximum length of the sentence enteredmax_single_length
:The maximum length of the sentence output
Use python train.py
to start training, please see train.py
for optional parameters.
See developer-based model
setup 1.a and 1.b.
The only difference is that there are three files for the training set, validation set and test set, respectively src1-xxx.txt
, src2-xxx.txt
and tgt-xxx.txt
.
For src1-xxx.txt
,src2-xxx.txt
and tgt-xxx.txt
, you can execute create_dataset.py
to generate two files in Token format.One file is similar to developer-based model input and the other is the input of the second encoder.
See developer-based model
setup 2.
See developer-based model
setup 3.