edwko / KAN-Gated-State-Spaces-LM

Kolmogorov Arnold Network Gated State Spaces Language Model

Kolmogorov Arnold Network Gated State Spaces Language Model

This repository contains the implementation of the KAN-GSS-LM in pytorch.
The KAN-GSS-LM combines these two components Kolmogorov-Arnold Network and Gated State Spaces.
Take a look at the train.py file, which includes a training and generation example.