Compute Friedman and Nemenyi Statistical Tests for Multilabel Classification
This source code has the following R scripts
- libraries.r
- utils.r
- ranking.R
- Friedman-Nemenyi-v1.R
- Friedman-Nemenyi-v2.R
- radar_plots.R
- example_fn.R
- example_radar.R
The ranking.R generates the rankings for each of the multilabel measures according to their best value as follow:
| Measure | Best Value |
|---|---|
| accuracy | 1.0 |
| average-precision | 1.0 |
| clp | 0.0 |
| coverage | 0.0 |
| f1 | 1.0 |
| hamming-loss | 0.0 |
| macro-auc | 1.0 |
| macro-f1 | 1.0 |
| macro-precision | 1.0 |
| macro-recall | 1.0 |
| margin-loss | 0.0 |
| micro-auc | 1.0 |
| micro-f1 | 1.0 |
| micro-precision | 1.0 |
| micro-recall | 1.0 |
| mlp | 0.0 |
| one-error | 0.0 |
| precision | 1.0 |
| ranking-loss | 0.0 |
| recall | 1.0 |
| subset-accuracy | 1.0 |
| wlp | 0.0 |
The Friedman-Nemenyi_v1.R uses the tsutils package, while Friedman-Nemenyi_v2.R uses the scmamp package.
This source code does not provide the installation of any of the packages used, therefore, you must install the libraries used. Check libraries.R.
The scmamp package can give some installation headaches. For newer versions of R it is not available, so it is necessary to force the installation manually. Consult here and [here] (http://cran.nexr.com/web/packages/scmamp/index.html) all necessary dependencies and I suggest you to install via tar.gz.
For this code to work correctly, the files must be provided in CSV format. This code was developed to work with the 22 multi-label assessment measures. You can provide just one CSV file, or all 22 files (one for each measure). The CSV file format of the assessment measure should be as follows:
| Dataset | Method_1 | Method_2 | .... | Method_n |
|---|---|---|---|---|
| dataset_1 | ||||
| dataset_1 | ||||
| ......... | ||||
| dataset_n |
Along with this code are provided examples of csv files in the DATA folder
You can generate radar plots for your data. An example is provided in example_radar.R
You can see an example of how to use this code by referring to the example_fn.R.
This study is financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - Brasil (CAPES) - Finance Code 001
| Post-Graduate Program in Computer Science | Computer Department | Biomal | CAPES | Embarcados | Read Prensa | Linkedin Company | Linkedin Profile | Instagram | Facebook | Twitter | Twitch | Youtube |
Please contact me: elainececiliagatto@gmail.com