belkakari / implicit-kan

Kolmogorov-Arnold networks (KAN) as implicit functions (like NeRF but simpler)

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

implicit-kan

Trying to use EfficientKAN, FastKAN and ChebyKAN as an implicit function to fit a 2D image below The basic idea comes from the Fourier Features paper (similar to SIREN). An MLP or KAN takes coordinates grid as an input and learns to output an image, basically learning to complress image inside the weights. FF and SIREN papers have shown that the basic MLP is not capable to do it properly but with a certain trick (positional encoding that is used in NeRF) it suddenly can

This repo mostly aims at expanding Appendix B from the original paper

train image

For now it looks like KANs also needs fourier features and MLP still beats KANs. More experiments are needed to verify that claim

Loss plots

train plots

EfficientKAN grid 5 vs EfficientKAN grid 7 vs MLP

kan vs mlp

About

Kolmogorov-Arnold networks (KAN) as implicit functions (like NeRF but simpler)

License:MIT License


Languages

Language:Jupyter Notebook 98.9%Language:Python 1.1%