Number of Transformer layers

[IwasakiYuuki]

Thank you for implementation of ALBERT by pytorch.
I have a question about the model construction.

ALBERT-Pytorch/pretrain.py

Line 198 in 7cac177

 h = self.transformer(input_ids, segment_ids, input_mask) 

Why is the number of transformer layers one ?
Is this correct ?

[Tae Hwan Jung]

Please see

ALBERT-Pytorch/models.py

Line 175 in 7cac177

 for _ in range(self.n_layers): 

I hope this code hell you, Thanks

[IwasakiYuuki]

sorry, i missed it...
Thank you for answering to my question.