Adding CL subnetworking strategies (WSN and RMN)
niniack opened this issue · comments
Discussed in #1641
Originally posted by niniack May 8, 2024
Hi,
We typically have a roadmap issue pinned but I didn't see that, so I'm just starting the conversation here.
I was hoping to contribute two subnetworking strategies (Winning Subnetworks and Relevance Mapping Networks). I think I have implementations that are architecture agnostic, unlike the ones published by the original authors.
If someone from the core team can just give me a thumbs up that here is interest in this, then I'd like to open up a PR soon! While I have a close to merge-able implementation, I imagine I will still have to do some cleaning up, more testing, and a bit of back and forth in design decisions!
WSN: https://arxiv.org/abs/2303.14962
RMN: https://arxiv.org/abs/2102.11343
Hi @niniack. I think this would a great addition. I'm a bit busy in this period so I may need a bit of time to review your PR when ready but I guarantee that we are interested.