jMetal / jMetal

jMetal: a framework for multi-objective optimization with metaheuristics

Home Page:https://jmetal.readthedocs.io/en/latest/index.html

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Hi Jose.

mishras9 opened this issue · comments

Hi Jose.
It's nice to have new from you :)

Are the quaility indicators implemented on jMetal the best known metrics and the most common ones?

Yes

It seems that CommandLineIndicatorRunner does not use R2 (it's actually commented out). Why is that? Is R2 buggy?

The R2 is not completely implemented (only works for bi-objective problems), so I decided to not use it.

Each quality indicator requires a Front and a Reference Pareto Front. What is a reference pareto front? Is it the true pareto front? Assuming that I am not evaluating any of the typical problems (e.g., ZDT-1) and therefore I do not have the true pareto front, what would be my reference pareto front?

Most of indicators require the Pareto front to be computed, but this front is rarely obtained with dealing with real-world problems. The most commoly used strategy is to build a reference Pareto front, which is composed of the result of merging all the solutions obtained by all the algorithms in all their runs.

Why is PISAHypervolume the default Hypervolume metric? Does it work better than for example, WFGHypervolume?

PISAHypervolume is based on the original implementation of Eckart Zitzler, and I would say that yes, it is the default HV indicator. WFGHypervolume is a different implementation which is faster when solving bi-objective problems (in part because it doesn't normalize the objetives values, as PISAHypervolume does).

The Epsilon class implements the unary epsilon additive indicator, does that mean I have to use Epsilon metric with an approximation set and a reference set?

Yes.

Or does not matter, and I can still use Epsilon class with two approximation sets, i.e., as a binary epsilon rather than unary?

Hmmm, I'm not sure. I shold take a look to the implementation.

Originally posted by @ajnebro in #171 (comment)