THUDM / GLM

GLM (General Language Model)

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

使用glm-large-chinese微调分类任务

mechigonft opened this issue · comments

报错:Traceback (most recent call last):
File "/ossfs/workspace/vector/model/GLM-main/finetune_glm.py", line 470, in
main(args)
File "/ossfs/workspace/vector/model/GLM-main/tasks/superglue/finetune.py", line 119, in main
finetune(args, train_valid_datasets_provider, model_kwargs,
File "/ossfs/workspace/vector/model/GLM-main/finetune_glm.py", line 297, in finetune
train_dataset, valid_dataset = train_valid_datasets_provider(args, tokenizer)
File "/ossfs/workspace/vector/model/GLM-main/tasks/superglue/finetune.py", line 56, in train_valid_datasets_provider
train_dataset = SuperGlueDataset(args, task_name, data_dir, args.seq_length, "train", tokenizer,
File "/ossfs/workspace/vector/model/GLM-main/tasks/superglue/dataset.py", line 134, in init
self.processor = PROCESSORStask_name
KeyError: 'multichoice'

dataset.py的字典PROCESSORS并没有multichoice这个key,请问如何解决
PROCESSORS = {
"mnli": MnliProcessor,
"mnli-mm": MnliMismatchedProcessor,
"agnews": AgnewsProcessor,
"yahoo": YahooAnswersProcessor,
"yelp-polarity": YelpPolarityProcessor,
"yelp-full": YelpFullProcessor,
"xstance-de": lambda: XStanceProcessor("de"),
"xstance-fr": lambda: XStanceProcessor("fr"),
"xstance": XStanceProcessor,
"wic": WicProcessor,
"rte": RteProcessor,
"cb": CbProcessor,
"wsc": WscProcessor,
"wsc1": WscProcessor,
"boolq": BoolQProcessor,
"copa": CopaProcessor,
"multirc": MultiRcProcessor,
"record": RecordProcessor,
"ax-g": AxGProcessor,
"ax-b": AxBProcessor,
"sst2": Sst2Processor,
"cola": ColaProcessor,
"mrpc": MrpcProcessor,
"qqp": QqpProcessor,
"qnli": QnliProcessor,
# "squad": SquadProcessor,
"race": RaceProcessor,
"squad": SquadProcessor,
"afqmc": AFQMCProcessor,
"tnews": TNewsProcessor,
'cluewsc': CLUEWSCProcessor,
# 'cmrc': CMRCProcessor
} # type: Dict[str,Callable[[1],DataProcessor]]