Can lassonet works in transformer or S4(Structured State Spaces)?
xueliu8617112 opened this issue · comments
i hope to use lassonet in S4, is it okay to do that?
Are you talking about Structured State Space for Sequence Modeling? I don't know very well the details nor how you want to apply LassoNet.
Do you have a concrete example in mind?
yeah, it is S4 for Structured State Space for Sequence Modeling. I just want to do some time series prediction work in the industry. I see u use the NN or CNN or AE as the backbone, so I wonder whether s4 can be utilized as the backbone.
CNN as backbone is very experimental. The goal of LassoNet is to select variables in a meaningful space (eg features).
@xueliu8617112 I am also interested in this topic. May I ask if you have made any substantial progress regarding this issue recently?