wildltr / ptranking

Learning to Rank in PyTorch

Home Page:https://wildltr.github.io/ptranking/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

lightgbm.basic.LightGBMError: Label 1330 is not less than the number of label mappings (31)

gallupliu opened this issue · comments

When I executed the program with the following command, python -data MQ2008_List -dir_data /Users/gallup/study/tensorflow-LTR/data/MQ2008/Fold1 -dir_output /home/dl-box/WorkBench/CodeBench/Project_output/Out_L2R/Listwise/ -model LightGBMLambdaMART -dir_json /Users/gallup/study/ptranking/testing/ltr_tree/json/

I encountered an error:
lightgbm.basic.LightGBMError: Label 1330 is not less than the number of label mappings (31)

Start LightGBMLambdaMART on MQ2008_List >>>
Fold- 1
/Users/gallup/opt/anaconda3/envs/tf2py3/lib/python3.8/site-packages/lightgbm/engine.py:151: UserWarning: Found num_trees in params. Will use it instead of argument
warnings.warn("Found {} in params. Will use it instead of argument".format(alias))
[LightGBM] [Fatal] Label 1330 is not less than the number of label mappings (31)
Traceback (most recent call last):
File "/Users/gallup/study/ptranking/pt_ranking.py", line 85, in
evaluator.run(model_id=l2r_args.model, dir_json=l2r_args.dir_json, debug=False, config_with_json=True)
File "/Users/gallup/study/ptranking/ptranking/ltr_adhoc/eval/ltr.py", line 604, in run
self.grid_run(debug=debug, model_id=model_id, dir_json=dir_json)
File "/Users/gallup/study/ptranking/ptranking/ltr_tree/eval/ltr_tree.py", line 380, in grid_run
self.kfold_cv_eval(data_dict=data_dict, eval_dict=eval_dict, model_para_dict=model_para_dict)
File "/Users/gallup/study/ptranking/ptranking/ltr_tree/eval/ltr_tree.py", line 257, in kfold_cv_eval
y_test, group_test, y_pred = tree_ranker.run(fold_k=fold_k, file_train=file_train, file_vali=file_vali,
File "/Users/gallup/study/ptranking/ptranking/ltr_tree/lambdamart/lightgbm_lambdaMART.py", line 109, in run
lgbm_ranker = lgbm.train(params=self.lightgbm_para_dict, verbose_eval=10,
File "/Users/gallup/opt/anaconda3/envs/tf2py3/lib/python3.8/site-packages/lightgbm/engine.py", line 231, in train
booster = Booster(params=params, train_set=train_set)
File "/Users/gallup/opt/anaconda3/envs/tf2py3/lib/python3.8/site-packages/lightgbm/basic.py", line 1988, in init
_safe_call(_LIB.LGBM_BoosterCreate(
File "/Users/gallup/opt/anaconda3/envs/tf2py3/lib/python3.8/site-packages/lightgbm/basic.py", line 55, in _safe_call
raise LightGBMError(decode_string(_LIB.LGBM_GetLastError()))
lightgbm.basic.LightGBMError: Label 1330 is not less than the number of label mappings (31)

Process finished with exit code 1

@gallupliu Sorry for the inconvenience. The possible reason is that the dataset MQ2008-List is a listwise dataset rather than the common multi-graded labels, say {0,1,2,3}. Since LightGBMLambdaMART builds on LightGBM, it is probably because LightGBM does not support this kind of dataset. Please double-check it, thanks!

I use the mq2008 in testing_ltr_tree.py,label as (0 1 2) ,The same mistake happens,

raw data format as fellow:
0 qid:18219 1:0.052893 2:1.000000 3:0.750000 4:1.000000 5:0.066225 6:0.000000 7:0.000000 8:0.000000 9:0.000000 10:0.000000 11:0.047634 12:1.000000 13:0.740506 14:1.000000 15:0.058539 16:0.003995 17:0.500000 18:0.400000 19:0.400000 20:0.004121 21:1.000000 22:1.000000 23:0.974510 24:1.000000 25:0.929240 26:1.000000 27:1.000000 28:0.829951 29:1.000000 30:1.000000 31:0.768123 32:1.000000 33:1.000000 34:1.000000 35:1.000000 36:1.000000 37:1.000000 38:1.000000 39:0.998377 40:1.000000 41:0.333333 42:0.434783 43:0.000000 44:0.396910 45:0.447368 46:0.966667 #docid = GX004-93-7097963 inc = 0.0428115405134536 prob = 0.860366
0 qid:18219 1:0.004959 2:0.000000 3:0.250000 4:0.500000 5:0.006623 6:0.000000 7:0.000000 8:0.000000 9:0.000000 10:0.000000 11:0.004971 12:0.000000 13:0.259494 14:0.521932 15:0.006639 16:0.000896 17:0.714286 18:0.700000 19:0.000000 20:0.001093 21:0.229604 22:0.237068 23:0.200021 24:0.063318 25:0.000000 26:0.000000 27:0.000000 28:0.000000 29:0.310838 30:0.033799 31:0.001398 32:0.025976 33:0.576917 34:0.036302 35:0.001129 36:0.022642 37:0.141223 38:0.212802 39:0.168053 40:0.069556 41:0.333333 42:0.000000 43:0.000000 44:0.019255 45:0.421053 46:0.000000 #docid = GX010-40-4497720 inc = 0.00110683825421716 prob = 0.089706
0 qid:18219 1:0.066116 2:0.750000 3:0.250000 4:1.000000 5:0.074503 6:0.000000 7:0.000000 8:0.000000 9:0.000000 10:0.000000 11:0.061487 12:0.716563 13:0.259494 14:1.000000 15:0.068044 16:0.004945 17:0.285714 18:0.300000 19:0.600000 20:0.005016 21:0.990081 22:0.973625 23:1.000000 24:0.973218 25:1.000000 26:0.878010 27:0.016022 28:1.000000 29:0.485677 30:0.147968 31:0.004197 32:0.113559 33:0.954513 34:0.946955 35:0.998874 36:0.966838 37:0.986045 38:0.963141 39:1.000000 40:0.962716 41:0.666667 42:0.826087 43:0.000000 44:0.045177 45:0.473684 46:1.000000 #docid = GX016-32-14546147 inc = 1 prob = 0.811482
1 qid:18219 1:0.026446 2:0.750000 3:0.750000 4:0.500000 5:0.036424 6:0.000000 7:0.000000 8:0.000000 9:0.000000 10:0.000000 11:0.024116 12:0.716563 13:0.702528 14:0.521932 15:0.031683 16:0.007919 17:1.000000 18:0.500000 19:0.200000 20:0.008170 21:0.780898 22:0.659859 23:0.722056 24:0.666725 25:0.428280 26:0.000000 27:0.000000 28:0.000000 29:0.876585 30:0.939544 31:0.664658 32:0.953860 33:0.548049 34:0.000000 35:0.000000 36:0.000000 37:0.843365 38:0.727569 39:0.786101 40:0.725966 41:0.000000 42:0.608696 43:0.000000 44:1.000000 45:1.000000 46:0.266667 #docid = GX020-25-8391882 inc = 1 prob = 0.115043
0 qid:18219 1:0.029752 2:0.000000 3:1.000000 4:1.000000 5:0.038079 6:0.000000 7:0.000000 8:0.000000 9:0.000000 10:0.000000 11:0.022643 12:0.000000 13:1.000000 14:1.000000 15:0.029721 16:0.007543 17:0.357143 18:1.000000 19:0.400000 20:0.007740 21:0.825886 22:0.735769 23:0.794308 24:0.735548 25:0.000000 26:0.000000 27:0.000000 28:0.000000 29:0.737766 30:0.830504 31:1.000000 32:0.852510 33:1.000000 34:1.000000 35:1.000000 36:1.000000 37:0.858094 38:0.761605 39:0.818017 40:0.759069 41:0.333333 42:0.956522 43:0.000000 44:0.013295 45:0.052632 46:0.100000 #docid = GX025-94-0531672 inc = 1 prob = 0.141903
0 qid:18219 1:0.066116 2:0.000000 3:0.250000 4:0.500000 5:0.067881 6:0.000000 7:0.000000 8:0.000000 9:0.000000 10:0.000000 11:0.060889 12:0.000000 13:0.259494 14:0.521932 15:0.062613 16:0.017844 17:0.428571 18:0.900000 19:0.200000 20:0.018024 21:0.836522 22:0.686477 23:0.924117 24:0.677412 25:0.000000 26:0.000000 27:0.000000 28:0.000000 29:0.263423 30:0.000000 31:0.000000 32:0.000000 33:0.548049 34:0.000000 35:0.000000 36:0.000000 37:0.791753 38:0.655572 39:0.864037 40:0.648098 41:0.000000 42:0.913043 43:0.000000 44:0.008132 45:0.078947 46:0.533333 #docid = GX026-03-13004845 inc = 0.00923990383395518 prob = 0.162346
0 qid:18219 1:0.000000 2:0.000000 3:0.250000 4:0.000000 5:0.000000 6:0.000000 7:0.000000 8:0.000000 9:0.000000 10:0.000000 11:0.000000 12:0.000000 13:0.259494 14:0.000000 15:0.000000 16:0.000000 17:0.000000 18:0.100000 19:1.000000 20:0.000000 21:0.000000 22:0.470407 23:0.000000 24:0.367837 25:0.000000 26:0.000000 27:0.000000 28:0.000000 29:0.675712 30:0.296249 31:0.005599 32:0.227130 33:0.000000 34:0.000000 35:0.000000 36:0.000000 37:0.000000 38:0.329330 39:0.000000 40:0.150330 41:1.000000 42:0.826087 43:0.000000 44:0.000000 45:0.000000 46:0.000000 #docid = GX048-02-13747475 inc = 1 prob = 0.0823475
0 qid:18219 1:1.000000 2:0.000000 3:0.000000 4:0.000000 5:1.000000 6:0.000000 7:0.000000 8:0.000000 9:0.000000 10:0.000000 11:1.000000 12:0.000000 13:0.000000 14:0.000000 15:1.000000 16:1.000000 17:0.071429 18:0.000000 19:1.000000 20:1.000000 21:0.180271 22:0.000000 23:0.315641 24:0.000000 25:0.000000 26:0.000000 27:0.000000 28:0.000000 29:0.000000 30:0.000000 31:0.000000 32:0.000000 33:0.000000 34:0.000000 35:0.000000 36:0.000000 37:0.047918 38:0.000000 39:0.219177 40:0.000000 41:0.666667 42:1.000000 43:0.000000 44:0.021492 45:0.184211 46:0.000000 #docid = GX268-53-13016636 inc = 0.00187837593235052 prob = 0.0937803
0 qid:18230 1:0.003865 2:0.142857 3:0.333333 4:0.500000 5:0.004972 6:0.000000 7:0.000000 8:0.000000 9:0.000000 10:0.000000 11:0.004151 12:0.142857 13:0.333333 14:0.500000 15:0.005884 16:0.004273 17:0.021277 18:0.062500 19:0.095238 20:0.004000 21:0.365337 22:0.200902 23:0.256010 24:0.146942 25:1.000000 26:0.362813 27:0.008279 28:0.236012 29:0.888747 30:0.382130 31:0.364357 32:0.293102 33:0.793621 34:0.551724 35:0.026166 36:0.747958 37:0.386842 38:0.247781 39:0.281369 40:0.181361 41:0.000000 42:0.121212 43:0.000000 44:0.887007 45:1.000000 46:0.052758 #docid = GX000-11-6487904 inc = 1 prob = 0.112814
0 qid:18230 1:0.008835 2:0.142857 3:0.333333 4:0.500000 5:0.009945 6:0.000000 7:0.000000 8:0.000000 9:0.000000 10:0.000000 11:0.008824 12:0.142857 13:0.333333 14:0.500000 15:0.010560 16:0.003900 17:0.085106 18:0.375000 19:0.000000 20:0.003777 21:0.762904 22:0.678893 23:0.488861 24:0.868785 25:0.544656 26:0.186268 27:0.006017 28:0.104341 29:0.449270 30:0.153340 31:0.361991 32:0.117733 33:0.877229 34:0.719508 35:0.030542 36:1.000000 37:0.765505 38:0.686469 39:0.502148 40:0.869165 41:0.142857 42:0.000000 43:0.000000 44:0.003539 45:0.001982 46:0.013189 #docid = GX000-22-1713857 inc = 1 prob = 0.141189
1 qid:18230 1:0.120928 2:0.142857 3:0.333333 4:0.000000 5:0.121547 6:0.000000 7:0.000000 8:0.000000 9:0.000000 10:0.000000 11:0.119815 12:0.142857 13:0.333333 14:0.000000 15:0.120825 16:0.153749 17:0.255319 18:0.562500 19:0.142857 20:0.154007 21:0.755540 22:0.566106 23:0.698192 24:0.641718 25:0.245978 26:0.000000 27:0.000000 28:0.000000 29:0.346474 30:0.101614 31:0.360574 32:0.078050 33:0.000000 34:0.000000 35:0.000000 36:0.000000 37:0.760857 38:0.582674 39:0.698732 40:0.651045 41:0.285714 42:0.151515 43:0.000000 44:0.029236 45:0.001982 46:0.008393 #docid = GX000-52-8600090 inc = 1 prob = 0.0897452
1 qid:18230 1:0.156819 2:0.142857 3:0.333333 4:0.000000 5:0.157459 6:0.000000 7:0.000000 8:0.000000 9:0.000000 10:0.000000 11:0.152993 12:0.142857 13:0.333333 14:0.000000 15:0.153542 16:0.128335 17:0.063830 18:0.187500 19:0.190476 20:0.128240 21:0.821227 22:0.566994 23:0.745119 24:0.670173 25:0.642118 26:0.222894 27:0.006770 28:0.131665 29:0.638798 30:0.241821 31:0.363410 32:0.185574 33:0.000000 34:0.000000 35:0.000000 36:0.000000 37:0.823160 38:0.583374 39:0.745532 40:0.679151 41:0.285714 42:0.222222 43:0.000000 44:0.000237 45:0.000991 46:0.000000 #docid = GX001-00-5105044 inc = 1 prob = 0.0897452
1 qid:18230 1:0.218112 2:0.285714 3:0.333333 4:0.000000 5:0.219337 6:0.000000 7:0.000000 8:0.000000 9:0.000000 10:0.000000 11:0.216254 12:0.285714 13:0.333333 14:0.000000 15:0.217611 16:0.217767 17:0.297872 18:0.500000 19:0.142857 20:0.218064 21:0.783012 22:0.554006 23:0.712058 24:0.638314 25:0.391877 26:0.036784 27:0.305970 28:0.051190 29:0.375081 30:0.116636 31:0.361047 32:0.089577 33:0.000000 34:0.000000 35:0.000000 36:0.000000 37:0.786565 38:0.570912 39:0.712515 40:0.647727 41:0.285714 42:0.212121 43:0.000000 44:0.014392 45:0.006938 46:0.001199 #docid = GX004-53-15843752 inc = 0.0319188697601707 prob = 0.0946039
0 qid:18230 1:0.028713 2:0.428571 3:0.333333 4:0.500000 5:0.030939 6:0.000000 7:0.000000 8:0.000000 9:0.000000 10:0.000000 11:0.029645 12:0.428571 13:0.333333 14:0.500000 15:0.032583 16:0.024668 17:0.510638 18:0.312500 19:0.142857 20:0.025096 21:0.584996 22:0.395650 23:0.504419 24:0.468435 25:0.358369 26:0.061202 27:0.487980 28:0.038508 29:0.498579 30:0.176608 31:0.362464 32:0.135578 33:0.757522 34:0.485143 35:0.023980 36:0.647934 37:0.590183 38:0.416612 39:0.508599 40:0.481063 41:0.285714 42:0.171717 43:0.000000 44:1.000000 45:0.362735 46:0.015588 #docid = GX005-39-6812626 inc = 0.0161139271070161 prob = 0.0897452
1 qid:18230 1:0.024296 2:0.142857 3:0.333333 4:1.000000 5:0.025967 6:0.000000 7:0.000000 8:0.000000 9:0.000000 10:0.000000 11:0.024288 12:0.142857 13:0.333333 14:1.000000 15:0.026583 16:0.018930 17:0.085106 18:0.062500 19:0.285714 20:0.018835 21:0.797655 22:0.631080 23:0.632601 24:0.745377 25:0.544656 26:0.186268 27:0.006017 28:0.104341 29:0.888747 30:0.382130 31:0.364357 32:0.293102 33:0.970852 34:0.962490 35:0.997817 36:0.928606 37:0.803126 38:0.648904 39:0.639382 40:0.755609 41:0.571429 42:0.424242 43:0.000000 44:0.030443 45:0.000991 46:0.003597 #docid = GX005-40-1622912 inc = 0.0428075921199618 prob = 0.304426
1 qid:18230 1:0.066262 2:0.285714 3:0.333333 4:0.000000 5:0.067403 6:0.000000 7:0.000000 8:0.000000 9:0.000000 10:0.000000 11:0.067003 12:0.285714 13:0.333333 14:0.000000 15:0.068736 16:0.051200 17:0.319149 18:0.312500 19:0.190476 20:0.051435 21:0.752123 22:0.519954 23:0.647139 24:0.552374 25:0.371587 26:0.101320 27:0.305220 28:0.044638 29:0.498579 30:0.176608 31:0.362464 32:0.135578 33:0.000000 34:0.000000 35:0.000000 36:0.000000 37:0.754681 38:0.537057 39:0.647174 40:0.562360 41:0.285714 42:0.161616 43:0.000000 44:0.001393 45:0.012884 46:0.000000 #docid = GX010-03-13004888 inc = 1 prob = 0.148318
1 qid:18230 1:0.022639 2:0.000000 3:0.333333 4:0.000000 5:0.022652 6:0.000000 7:0.000000 8:0.000000 9:0.000000 10:0.000000 11:0.022936 12:0.000000 13:0.333333 14:0.000000 15:0.023507 16:0.023476 17:0.042553 18:0.937500 19:0.142857 20:0.023605 21:0.707999 22:0.485572 23:0.562349 24:0.521462 25:0.000000 26:0.000000 27:0.000000 28:0.000000 29:0.237699 30:0.036503 31:0.357748 32:0.028057 33:0.000000 34:0.000000 35:0.000000 36:0.000000 37:0.710042 38:0.501463 39:0.562049 40:0.530413 41:0.142857 42:0.171717 43:0.000000 44:0.003967 45:0.000991 46:0.003597 #docid = GX010-45-12369258 inc = 0.00979721240474588 prob = 0.0897452
1 qid:18230 1:0.240751 2:0.000000 3:0.000000 4:0.000000 5:0.240331 6:0.000000 7:0.000000 8:0.000000 9:0.000000 10:0.000000 11:0.239442 12:0.000000 13:0.000000 14:0.000000 15:0.239040 16:0.148358 17:0.063830 18:0.187500 19:0.238095 20:0.148292 21:0.815655 22:0.537579 23:0.719250 24:0.603266 25:0.000000 26:0.000000 27:0.000000 28:0.000000 29:0.000000 30:0.000000 31:0.000000 32:0.000000 33:0.000000 34:0.000000 35:0.000000 36:0.000000 37:0.816600 38:0.553609 39:0.718231 40:0.612070 41:0.285714 42:0.363636 43:0.000000 44:0.004394 45:0.001982 46:0.002398 #docid = GX010-85-14507192 inc = 1 prob = 0.507507
1 qid:18230 1:0.048040 2:0.285714 3:0.333333 4:0.500000 5:0.049724 6:0.000000 7:0.000000 8:0.000000 9:0.000000 10:0.000000 11:0.043149 12:0.285714 13:0.333333 14:0.500000 15:0.045429 16:0.038257 17:0.319149 18:0.625000 19:0.190476 20:0.038613 21:0.908228 22:0.829829 23:0.826364 24:0.853673 25:0.371587 26:0.147793 27:0.305220 28:0.044638 29:0.321921 30:0.061231 31:0.360103 32:0.067738 33:0.724564 34:0.426418 35:0.021794 36:0.559706 37:0.913519 38:0.839045 39:0.829912 40:0.859667 41:0.428571 42:0.272727 43:0.000000 44:0.000073 45:0.012884 46:0.008393 #docid = GX014-89-4473554 inc = 0.0294030334989924 prob = 0.154121
0 qid:18230 1:0.003313 2:0.285714 3:0.333333 4:0.000000 5:0.004420 6:0.000000 7:0.000000 8:0.000000 9:0.000000 10:0.000000 11:0.003580 12:0.285714 13:0.333333 14:0.000000 15:0.005311 16:0.006633 17:0.148936 18:0.312500 19:0.190476 20:0.006659 21:0.341369 22:0.123176 23:0.235225 24:0.111092 25:0.634331 26:0.159106 27:0.311227 28:0.117024 29:0.498579 30:0.176608 31:0.362464 32:0.135578 33:0.000000 34:0.000000 35:0.000000 36:0.000000 37:0.369162 38:0.169246 39:0.262354 40:0.146931 41:0.142857 42:0.161616 43:0.000000 44:0.176046 45:0.054509 46:0.011990 #docid = GX014-94-6492630 inc = 0.00883817317681539 prob = 0.0634494
2 qid:18230 1:0.066262 2:0.142857 3:0.333333 4:0.000000 5:0.066851 6:0.000000 7:0.000000 8:0.000000 9:0.000000 10:0.000000 11:0.067003 12:0.142857 13:0.333333 14:0.000000 15:0.068163 16:0.051200 17:0.106383 18:0.312500 19:0.190476 20:0.051186 21:0.752123 22:0.519954 23:0.647139 24:0.552374 25:0.472882 26:0.157865 27:0.005263 28:0.083147 29:0.498579 30:0.176608 31:0.362464 32:0.135578 33:0.000000 34:0.000000 35:0.000000 36:0.000000 37:0.754945 38:0.537199 39:0.647018 40:0.562377 41:0.285714 42:0.141414 43:0.000000 44:0.000687 45:0.000991 46:0.000000 #docid = GX019-16-5501512 inc = 0.0542515970612273 prob = 0.247864

post processed format as feelow:

61 1:0.003865000093355775 2:0.14285700023174286 3:0.33333298563957214 4:0.5 5:0.004972000140696764 11:0.004151000175625086 12:0.14285700023174286 13:0.33333298563957214 14:0.5 15:0.005884000100195408 16:0.004273000173270702 17:0.02127699926495552 18:0.0625 19:0.09523800015449524 20:0.004000000189989805 21:0.3653370141983032 22:0.20090200006961823 23:0.2560099959373474 24:0.14694200456142426 25:1.0 26:0.36281299591064453 27:0.008279000408947468 28:0.23601199686527252 29:0.888746976852417 30:0.3821299970149994 31:0.36435699462890625 32:0.2931019961833954 33:0.7936210036277771 34:0.5517240166664124 35:0.026165999472141266 36:0.7479580044746399 37:0.3868420124053955 38:0.24778099358081818 39:0.28136900067329407 40:0.18136100471019745 42:0.12121199816465378 44:0.8870069980621338 45:1.0 46:0.052758000791072845
61 1:0.008834999985992908 2:0.14285700023174286 3:0.33333298563957214 4:0.5 5:0.00994499959051609 11:0.008824000135064125 12:0.14285700023174286 13:0.33333298563957214 14:0.5 15:0.01056000031530857 16:0.0038999998942017555 17:0.0851060003042221 18:0.375 20:0.0037769998889416456 21:0.7629039883613586 22:0.6788930296897888 23:0.48886099457740784 24:0.86878502368927 25:0.544655978679657 26:0.18626800179481506 27:0.006016999948769808 28:0.10434100031852722 29:0.44927000999450684 30:0.15333999693393707 31:0.3619909882545471 32:0.11773300170898438 33:0.8772289752960205 34:0.7195079922676086 35:0.030541999265551567 36:1.0 37:0.7655050158500671 38:0.6864690184593201 39:0.5021479725837708 40:0.8691650032997131 41:0.14285700023174286 44:0.0035389999393373728 45:0.001981999957934022 46:0.013189000077545643
60 1:0.12092799693346024 2:0.14285700023174286 3:0.33333298563957214 5:0.12154699862003326 11:0.11981499940156937 12:0.14285700023174286 13:0.33333298563957214 15:0.12082500010728836 16:0.1537490040063858 17:0.2553189992904663 18:0.5625 19:0.14285700023174286 20:0.15400700271129608 21:0.7555400133132935 22:0.5661060214042664 23:0.6981920003890991 24:0.6417179703712463 25:0.2459779977798462 29:0.3464739918708801 30:0.10161399841308594 31:0.36057400703430176 32:0.07805000245571136 37:0.7608569860458374 38:0.5826740264892578 39:0.6987320184707642 40:0.651045024394989 41:0.2857140004634857 42:0.15151500701904297 44:0.029236000031232834 45:0.001981999957934022 46:0.00839299988001585
60 1:0.15681900084018707 2:0.14285700023174286 3:0.33333298563957214 5:0.15745900571346283 11:0.15299299359321594 12:0.14285700023174286 13:0.33333298563957214 15:0.15354199707508087 16:0.12833499908447266 17:0.06383000314235687 18:0.1875 19:0.19047600030899048 20:0.12824000418186188 21:0.8212270140647888 22:0.5669940114021301 23:0.7451189756393433 24:0.6701729893684387 25:0.642117977142334 26:0.22289399802684784 27:0.006769999861717224 28:0.13166500627994537 29:0.6387979984283447 30:0.24182100594043732 31:0.36340999603271484 32:0.1855739951133728 37:0.8231599926948547 38:0.5833740234375 39:0.7455319762229919 40:0.6791509985923767 41:0.2857140004634857 42:0.2222220003604889 44:0.00023700000019744039 45:0.000990999978967011
60 1:0.2181120067834854 2:0.2857140004634857 3:0.33333298563957214 5:0.21933700144290924 11:0.21625399589538574 12:0.2857140004634857 13:0.33333298563957214 15:0.21761099994182587 16:0.21776700019836426 17:0.29787200689315796 18:0.5 19:0.14285700023174286 20:0.21806399524211884 21:0.7830119729042053 22:0.5540059804916382 23:0.7120580077171326 24:0.6383140087127686 25:0.3918769955635071 26:0.03678400069475174 27:0.3059700131416321 28:0.05119000002741814 29:0.37508100271224976 30:0.1166360005736351 31:0.36104699969291687 32:0.08957699686288834 37:0.7865650057792664 38:0.5709120035171509 39:0.7125149965286255 40:0.6477270126342773 41:0.2857140004634857 42:0.21212099492549896 44:0.014391999691724777 45:0.006938000209629536 46:0.0011990000493824482
61 1:0.02871299907565117 2:0.4285709857940674 3:0.33333298563957214 4:0.5 5:0.030938999727368355 11:0.029644999653100967 12:0.4285709857940674 13:0.33333298563957214 14:0.5 15:0.032582998275756836 16:0.024668000638484955 17:0.5106379985809326 18:0.3125 19:0.14285700023174286 20:0.025095999240875244 21:0.5849959850311279 22:0.3956499993801117 23:0.5044190287590027 24:0.46843498945236206 25:0.35836899280548096 26:0.061202000826597214 27:0.4879800081253052 28:0.03850800171494484 29:0.4985789954662323 30:0.17660799622535706 31:0.3624640107154846 32:0.1355780065059662 33:0.7575219869613647 34:0.4851430058479309 35:0.023979999125003815 36:0.6479340195655823 37:0.5901830196380615 38:0.41661199927330017 39:0.5085989832878113 40:0.48106300830841064 41:0.2857140004634857 42:0.17171700298786163 44:1.0 45:0.36273500323295593 46:0.015588000416755676
60 1:0.024296000599861145 2:0.14285700023174286 3:0.33333298563957214 4:1.0 5:0.025967000052332878 11:0.024288000538945198 12:0.14285700023174286 13:0.33333298563957214 14:1.0 15:0.026582999154925346 16:0.018929999321699142 17:0.0851060003042221 18:0.0625 19:0.2857140004634857 20:0.018835000693798065 21:0.7976549863815308 22:0.6310799717903137 23:0.6326010227203369 24:0.7453770041465759 25:0.544655978679657 26:0.18626800179481506 27:0.006016999948769808 28:0.10434100031852722 29:0.888746976852417 30:0.3821299970149994 31:0.36435699462890625 32:0.2931019961833954 33:0.9708520174026489 34:0.9624900221824646 35:0.9978169798851013 36:0.9286059737205505 37:0.8031259775161743 38:0.648904025554657 39:0.639382004737854 40:0.7556089758872986 41:0.5714290142059326 42:0.4242419898509979 44:0.03044299967586994 45:0.000990999978967011 46:0.003596999915316701
60 1:0.06626199930906296 2:0.2857140004634857 3:0.33333298563957214 5:0.06740300357341766 11:0.06700299680233002 12:0.2857140004634857 13:0.33333298563957214 15:0.0687360018491745 16:0.05119999870657921 17:0.319148987531662 18:0.3125 19:0.19047600030899048 20:0.05143500119447708 21:0.7521229982376099 22:0.5199540257453918 23:0.6471390128135681 24:0.552374005317688 25:0.37158700823783875 26:0.10131999850273132 27:0.30522000789642334 28:0.044638000428676605 29:0.4985789954662323 30:0.17660799622535706 31:0.3624640107154846 32:0.1355780065059662 37:0.7546809911727905 38:0.5370569825172424 39:0.6471740007400513 40:0.5623599886894226 41:0.2857140004634857 42:0.1616159975528717 44:0.0013930000131949782 45:0.012884000316262245
60 1:0.022639000788331032 3:0.33333298563957214 5:0.022652000188827515 11:0.022935999557375908 13:0.33333298563957214 15:0.023507000878453255 16:0.023476000875234604 17:0.04255300015211105 18:0.9375 19:0.14285700023174286 20:0.023605000227689743 21:0.7079989910125732 22:0.4855720102787018 23:0.5623490214347839 24:0.5214620232582092 29:0.2376990020275116 30:0.03650299832224846 31:0.35774800181388855 32:0.028056999668478966 37:0.7100419998168945 38:0.501462996006012 39:0.5620489716529846 40:0.5304129719734192 41:0.14285700023174286 42:0.17171700298786163 44:0.003967000171542168 45:0.000990999978967011 46:0.003596999915316701
60 1:0.2407509982585907 5:0.2403309941291809 11:0.23944200575351715 15:0.23904000222682953 16:0.14835800230503082 17:0.06383000314235687 18:0.1875 19:0.2380950003862381 20:0.14829200506210327 21:0.815654993057251 22:0.5375789999961853 23:0.7192500233650208 24:0.6032660007476807 37:0.8166000247001648 38:0.5536090135574341 39:0.7182310223579407 40:0.6120700240135193 41:0.2857140004634857 42:0.36363598704338074 44:0.004393999930471182 45:0.001981999957934022 46:0.0023980000987648964
60 1:0.0480399988591671 2:0.2857140004634857 3:0.33333298563957214 4:0.5 5:0.04972400143742561 11:0.04314899817109108 12:0.2857140004634857 13:0.33333298563957214 14:0.5 15:0.04542899876832962 16:0.03825699910521507 17:0.319148987531662 18:0.625 19:0.19047600030899048 20:0.03861299902200699 21:0.9082279801368713 22:0.8298289775848389 23:0.8263639807701111 24:0.853672981262207 25:0.37158700823783875 26:0.1477929949760437 27:0.30522000789642334 28:0.044638000428676605 29:0.3219209909439087 30:0.06123099848628044 31:0.3601030111312866 32:0.06773799657821655 33:0.7245640158653259 34:0.4264180064201355 35:0.021794000640511513 36:0.5597059726715088 37:0.913519024848938 38:0.839044988155365 39:0.829912006855011 40:0.8596670031547546 41:0.4285709857940674 42:0.27272701263427734 44:7.300000288523734e-05 45:0.012884000316262245 46:0.00839299988001585
61 1:0.0033130000811070204 2:0.2857140004634857 3:0.33333298563957214 5:0.0044200001284480095 11:0.0035800000187009573 12:0.2857140004634857 13:0.33333298563957214 15:0.005311000160872936 16:0.006632999982684851 17:0.14893600344657898 18:0.3125 19:0.19047600030899048 20:0.006659000180661678 21:0.34136900305747986 22:0.12317600101232529 23:0.23522500693798065 24:0.11109200119972229 25:0.6343309879302979 26:0.15910600125789642 27:0.3112269937992096 28:0.1170239970088005 29:0.4985789954662323 30:0.17660799622535706 31:0.3624640107154846 32:0.1355780065059662 37:0.369161993265152 38:0.16924600303173065 39:0.2623539865016937 40:0.146930992603302 41:0.14285700023174286 42:0.1616159975528717 44:0.1760459989309311 45:0.0545089989900589 46:0.011989999562501907
59 1:0.06626199930906296 2:0.14285700023174286 3:0.33333298563957214 5:0.06685099750757217 11:0.06700299680233002 12:0.14285700023174286 13:0.33333298563957214 15:0.06816300004720688 16:0.05119999870657921 17:0.10638300329446793 18:0.3125 19:0.19047600030899048 20:0.05118599906563759 21:0.7521229982376099 22:0.5199540257453918 23:0.6471390128135681 24:0.552374005317688 25:0.4728820025920868 26:0.1578650027513504 27:0.0052629997953772545 28:0.08314699679613113 29:0.4985789954662323 30:0.17660799622535706 31:0.3624640107154846 32:0.1355780065059662 37:0.7549449801445007 38:0.5371990203857422 39:0.6470180153846741 40:0.5623769760131836 41:0.2857140004634857 42:0.14141400158405304 44:0.000686999992467463 45:0.000990999978967011
60 1:0.00938700046390295 2:0.2857140004634857 3:0.33333298563957214 4:0.5 5:0.011049999855458736 11:0.008971000090241432 12:0.2847920060157776 13:0.33333298563957214 14:0.5 15:0.011107999831438065 16:0.004819000139832497 17:0.12766000628471375 18:0.1875 19:0.2380950003862381 20:0.004796000197529793 21:0.8956729769706726 22:0.8172860145568848 23:0.5821639895439148 24:0.9162269830703735 25:0.8329460024833679 26:1.0 27:1.0 28:1.0 29:0.6387979984283447 30:0.24182100594043732 31:0.36340999603271484 32:0.1855739951133728 33:0.6943550109863281 34:0.3738889992237091 35:0.0196090005338192 36:0.4807850122451782 37:0.9106850028038025 38:0.8397359848022461 39:0.6119379997253418 40:0.9291800260543823 41:0.4285709857940674 42:0.2929289937019348 44:0.000522000016644597 45:0.000990999978967011 46:0.0023980000987648964
61 1:0.0016570000443607569 3:0.6666669845581055 5:0.0022100000642240047 11:0.0018660000059753656 13:0.6666669845581055 15:0.0030189999379217625 16:0.0005469999741762877 17:0.0851060003042221 18:0.375 19:0.4285709857940674 20:0.0006459999713115394 21:0.3555769920349121 22:0.27167001366615295 23:0.21873900294303894 24:0.23008400201797485 29:0.7069140076637268 30:0.293969988822937 31:0.5570390224456787 32:0.1855739951133728 37:0.3788929879665375 38:0.2711479961872101 39:0.24884100258350372 40:0.22752299904823303 41:0.7142860293388367 42:0.34343400597572327 44:0.004621000029146671 45:0.001981999957934022 46:0.004796000197529793
61 1:0.013252000324428082 2:0.4285709857940674 3:0.33333298563957214 4:0.5 5:0.015469999983906746 11:0.01350099965929985 12:0.4285709857940674 13:0.33333298563957214 14:0.5 15:0.01641100086271763 16:0.009688000194728374 17:0.19148899614810944 18:0.3125 19:0.38095200061798096 20:0.009864999912679195 21:0.47994500398635864 22:0.23963500559329987 23:0.3707900047302246 24:0.39882299304008484 25:0.7157930135726929 26:0.19259299337863922 27:0.49921301007270813 28:0.13166500627994537 29:0.4985789954662323 30:0.17660799622535706 31:0.3624640107154846 32:0.1355780065059662 33:0.6171600222587585 34:0.24309900403022766 35:0.013062999583780766 36:0.28425800800323486 37:0.490898996591568 38:0.2725220024585724 39:0.3849790096282959 40:0.4171780049800873 41:0.7142860293388367 42:0.5151519775390625 44:0.02389499917626381 45:0.013875000178813934 46:0.027577999979257584
61 1:0.011044000275433064 3:0.33333298563957214 4:0.5 5:0.011602000333368778 11:0.011578000150620937 13:0.33333298563957214 14:0.5 15:0.012761999852955341 16:0.002558999927714467 18:0.5 19:0.2380950003862381 20:0.0025100000202655792 21:0.40776100754737854 22:0.1535719931125641 23:0.3402419984340668 24:0.23945699632167816 29:0.37508100271224976 30:0.08249100297689438 31:0.36104699969291687 32:0.08957699686288834 33:0.6943550109863281 34:0.2687489986419678 35:0.0196090005338192 36:0.4807850122451782 37:0.41478100419044495 38:0.1763550043106079 39:0.3466010093688965 40:0.2515929937362671 41:0.2857140004634857 42:0.2828280031681061 46:0.02278199978172779
61 1:0.011044000275433064 4:0.5 5:0.011049999855458736 11:0.011578000150620937 14:0.5 15:0.01218899991363287 16:0.005962000228464603 17:0.02127699926495552 18:0.125 19:0.6666669845581055 20:0.006012999918311834 21:0.3984070122241974 22:0.17723199725151062 23:0.32512301206588745 24:0.186708003282547 33:0.5048959851264954 37:0.40492498874664307 38:0.20371699333190918 39:0.32764899730682373 40:0.20142599940299988 41:1.0 42:0.8181819915771484 44:0.0004879999905824661 45:0.000990999978967011
61 1:0.010490999557077885 2:0.2857140004634857 3:0.33333298563957214 4:0.5 5:0.012155000120401382 11:0.010900000110268593 12:0.2857140004634857 13:0.33333298563957214 14:0.5 15:0.01321600005030632 16:0.0035520000383257866 17:0.1702129989862442 18:0.125 19:0.19047600030899048 20:0.0035280000884085894 21:0.6614559888839722 22:0.5525469779968262 23:0.4586229920387268 24:0.605180025100708 25:0.5828189849853516 26:0.21140000224113464 27:0.3104749917984009 28:0.10434100031852722 29:0.743323028087616 30:0.2935979962348938 31:0.36388298869132996 32:0.22525900602340698 33:0.7245640158653259 34:0.4264180064201355 35:0.021794000640511513 36:0.5597059726715088 37:0.6615869998931885 38:0.5604730248451233 39:0.4715149998664856 40:0.6107919812202454 41:0.2857140004634857 42:0.4242419898509979 44:0.00037399999564513564 45:0.001981999957934022 46:0.03477200120687485
60 1:0.06184399873018265 5:0.06132600083947182 11:0.0554950013756752 15:0.05541900172829628 16:0.03266799822449684 17:0.21276600658893585 18:0.4375 19:0.33333298563957214 20:0.03289800137281418 21:0.9844710230827332 22:0.9367669820785522 23:0.9123839735984802 24:0.9397000074386597 37:0.9859989881515503 38:0.9381229877471924 39:0.9110599756240845 40:0.9403660297393799 41:0.4285709857940674 42:0.353534996509552 44:0.002019000006839633 45:0.0029730000533163548 46:0.00839299988001585
61 1:0.001104000024497509 3:0.33333298563957214 5:0.0011050000321120024 11:0.0011889999732375145 13:0.33333298563957214 15:0.0017529999604448676 16:0.000944000028539449 17:0.0851060003042221 18:0.25 19:0.19047600030899048 20:0.0008699999889358878 21:0.5941020250320435 22:0.555180013179779 23:0.29421699047088623 24:0.6277679800987244 29:0.5600450038909912 30:0.20509199798107147 31:0.36293700337409973 32:0.15741699934005737 37:0.6195189952850342 38:0.5518940091133118 39:0.3231939971446991 40:0.6168739795684814 41:0.2857140004634857 42:0.20202000439167023 44:0.002391000045463443 45:0.000990999978967011 46:0.0011990000493824482

@gallupliu Hi, for other datasets, it should work, can you show me how you run the code, and the setting? thanks!