Evovest / EvoTrees.jl

Boosted trees in Julia

Home Page:https://evovest.github.io/EvoTrees.jl/dev/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Feature Request MultiQuantile

1991jhf opened this issue · comments

It would be nice to have multi-quantile regression for approximating histogram in one go.
similar to
https://catboost.ai/en/docs/concepts/loss-functions-regression#MultiQuantile

Thanks for the pointer.

The part I found tricky in supporting quantiles is that as the loss isn't differentiable per se, I ended up tracking full vector in observations/targets in order to compute the leaf prediction values. Having a reliable gradient based proxy would be preferable. Notably for maintenance as I for now don't have much use case with such loss objectives.
If you can point to a gradient based approach for estimating the loss/gain and associated leaf predictions, it should be fairly strightforward to add support for this loss.