zhihou7 / detr

This is the repository based on DETR. This repository includes the implementation of batchformer based on DETR. The corresponding code starts from here

detr/models/transformer.py

Line 33 in 449d425

if args is not None and args.bf:

.

Please ignore the "checkpoint" that I actually do not use it. Core part of the code is

detr/models/transformer.py

Line 121 in 449d425

if i in self.insert_idx and self.bf is not None and self.bf_idx == 3 and self.training:

However, this repository might include some codes for my other projects. For the redundant code, you can just ignore it.

For this batchformerv2 experiment, I insert the batchformerv2 module in the first layer (i.e. insert_index=0 and bf_idx=3). Meanwhile, I run the experiments on 16G V100 and set the batch size as 8 with 4 gpus.