Make the bot smarter
ekolis opened this issue · comments
Ok, I guess that sounds kind of vague, but seeing how the GPT2 subreddit simulator bots interact with each other and with humans gives me an idea on how to improve this bot.
Basically it would involve taking into account the context of what's been said recently in a channel, and somehow working that into the algorithm.
Hmm, GPT2 is rather computationally intensive when it comes to training; it wouldn't be able to work off a small but growing data set.
However, what I could do is base the Markov algorithm on more than one previous word; I think Gboard on Android uses two words, so "now is" and "that is" would generate different results, as opposed to just looking at the "is". This should lead to at least somewhat more coherent messages!