Single head or multihead task incremental

[Jue Guo]

Hi, there

Is this experiment on task incremental single head or multi head?

Thanks

[Gido van de Ven]

Hi, in the accompanying article, most experiments in the task-incremental learning scenario use a multi-headed output layer. Exception are experiments in Supplemantary Note 7, in which there are experiments in the task-incremental learning scenario that use a single-headed output layer.
In the code, when you select the task-incremental learning scenario (using --scenario=task), by default a multi-headed output layer will be used, but in this scenario you can instead use a single-headed output layer by additionally using the option --singlehead.
Note that experiments in the domain- or class-incremental learning scenario always use a single-headed output layer.
Hope this helps!