parulnith / lassonet

Feature selection in neural networks

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Feature Selection in Neural Networks

It contains links to the paper as well as documentation/slides.

Tips

LassoNet sometimes require fine tuning. For optimal performance, consider

  • making sure that the initial dense model (with ) has trained well, before starting the LassoNet regularization path. This may involve hyper-parameter tuning, choosing the right optimizer, and so on. If the dense model is underperforming, it is likely that the sparser models will as well.
  • making sure the stepsize over the path is not too large. By default, the stepsize runs over the logscale between two values and .

About

Feature selection in neural networks

License:MIT License


Languages

Language:Jupyter Notebook 56.1%Language:Python 43.2%Language:Makefile 0.8%