Principal Component Analysis might be helpful in order to reduce the dimensionality of the document vectors and speed up the training process.

[VikaNa]