Single head or multihead task incremental
COD1995 opened this issue · comments
Hi, there
Is this experiment on task incremental single head or multi head?
Thanks
Hi, in the accompanying article, most experiments in the task-incremental learning scenario use a multi-headed output layer. Exception are experiments in Supplemantary Note 7, in which there are experiments in the task-incremental learning scenario that use a single-headed output layer.
In the code, when you select the task-incremental learning scenario (using --scenario=task
), by default a multi-headed output layer will be used, but in this scenario you can instead use a single-headed output layer by additionally using the option --singlehead
.
Note that experiments in the domain- or class-incremental learning scenario always use a single-headed output layer.
Hope this helps!