mozilla / bugbug

Platform for Machine Learning projects on Software Engineering

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Show the number of not classified instances for multi-label models

suhaibmujahid opened this issue · comments

Currently, the report has the tables look like the following:

╒════════════╤═════════════════╤═════════════════╕
│            │   0 (Predicted) │   1 (Predicted) │
╞════════════╪═════════════════╪═════════════════╡
│ 0 (Actual) │           19082 │               8 │
├────────────┼─────────────────┼─────────────────┤
│ 1 (Actual) │              51 │             723 │
╘════════════╧═════════════════╧═════════════════╛

While they should look like the following:

╒════════════╤═════════════════╤═════════════════╤══════════════════╕
│            │   0 (Predicted) │   1 (Predicted) │   Not classified │
╞════════════╪═════════════════╪═════════════════╪══════════════════╡
│ 0 (Actual) │           19082 │               8 │               12 │
├────────────┼─────────────────┼─────────────────┼──────────────────┤
│ 1 (Actual) │              51 │             723 │               28 │
╘════════════╧═════════════════╧═════════════════╧══════════════════╛

Does not classified in the multi-label case mean the model didn't classify it as either one of among all the classes or just the two classes looked at in the report? ie. If the model didn't classify it as a security bug or not (and may be classified as performance), does that qualify it to be not classified?