We use a transformer model trained on Siamzone lyrics to generate new lyrics. The demo can be found on https://tupleblog.github.io/generate-thai-lyrics/
We use the lyrics from siamzone website as our training set.
The training preparation is similar to this blog post.
Basically, our task is to predict the next word given all the previous words.
You can see more script in train folder to see how we train LSTM or Transformer model.
We plan to improve our model using larger model. Please stay tuned!
This work is done by tupleteam