Is "Transformer Architecture Marchine Learning Model" supported on RubixML ???
chegmarco1989 opened this issue · comments
Hello (again).
ChatGPT is built on Transformer Architecture Machine Learning Model .
So, does RubixML support this Transformer Architecture algorithm to do something like an intelligence Question & Answer project like ChatGPT in PHP using RubixML ???
If so, how to access its tutorial ???
Thanks to answer.
Hi @chegmarco1989, currently we just have feed-forward networks without attention implemented in Rubix ML.
Ok. Thanks for your feedback
You're welcome! If you're looking for a place to get started with Transformer networks, I highly recommend Andrey Karpathy's NanoGPT project as a place to get started. It uses PyTorch under the hood.
Thanks