Mnet or Snet penalties

Question

Mnet or Snet penalties

khotilov opened this issue 7 years ago · comments

Vadim Khotilovich commented 7 years ago

Were there any plans to add Mnet or Snet penalties? I might give it a try, if you don't mind.

Jared Huling commented 7 years ago

Thanks!

Jared Huling · Answer 1 · Tue Mar 14 2017 19:17:25 GMT+0800 (China Standard Time)

Could you send some references on those penalties?

Vadim Khotilovich · Answer 2 · Tue Mar 14 2017 22:47:39 GMT+0800 (China Standard Time)

Here are a couple of references
Mnet = MCP + Ridge: http://myweb.uiowa.edu/pbreheny/publications/mnet.pdf
Snet = SCAD + Ridge: http://www.stat.purdue.edu/~junxie/papers2/scad_l2_reprint.pdf
Some available implementations: https://cran.r-project.org/package=ncvreg and https://cran.r-project.org/package=mpath

Jared Huling · Answer 3 · Thu Mar 16 2017 08:37:24 GMT+0800 (China Standard Time)

I have plans for a few more penalties, so let me know if you have any other requests

Vadim Khotilovich · Answer 4 · Thu Mar 16 2017 11:51:57 GMT+0800 (China Standard Time)

Awesome! Thank you!

Just a couple of comments:

Since now you've got a "complete set", why not to limit the interface to something like penalty = c("enet", "ols", "mnet", "snet", "grp.enet") and let a user to steer with alpha?
cv functions also need to be updated.

Jared Huling · Answer 5 · Thu Mar 16 2017 11:57:56 GMT+0800 (China Standard Time)

@khotilov regarding cv functions: xval.oem was already fixed, but with the latest update i've fixed cv.oem.

regarding the first point: allowing the separate penalties "mcp" vs "mcp.net" allows a bit more flexibility for now until I allow the user to specify multiple values of alpha at a time. Allowing multiple values of alpha at a time will require some significant code changes and re-organization so I don't expect it to happen very soon. However, once I do that it should allow me to simplify the penalty options significantly without any loss of flexibility