Selection of experiment_in unsafe
nfelnlp opened this issue · comments
experiment_in = [f for f in os.listdir(experiment_path) if "preprocess" in f and f.endswith('.jsonl')][0]
can accidentally select another empty explainer file (from previous, sometimes unsuccessful debug runs).
This needs to be fixed! Probably by introducing config files (like in gxai) where the experiment inputs (processed data) is hard-coded, i.e. includes the specific files with timestamps.
see commit