About fine-tuning issues.

Question

About fine-tuning issues.

ltydd opened this issue a year ago · comments

I intend to fine-tune my own dataset based on the AISHELL3 model, but my dataset only includes 6 speakers, while AISHELL3 has 218. I encountered an error message of size mismatch when loading the model. Is there anyone who can help solve this problem?

Xinyi Zhao · Answer 1 · Tue Jun 06 2023 14:18:41 GMT+0800 (China Standard Time)

I solved this by removing the speaker_embedding.weight when loading the model.
del ckpt['model']['speaker_emb.weight'] in utils/model.py, line 20

ltydd · Answer 2 · Mon Jun 12 2023 09:15:55 GMT+0800 (China Standard Time)

我通过在加载模型时删除 speaker_embedding.weight 来解决此问题。在 utils/model.py 中，第 20 行del ckpt['model']['speaker_emb.weight']

I have already deleted "speaker_emb.weight", but the error still occurs: “RuntimeError: The size of tensor a (218) must match the size of tensor b (6) at non-singleton dimension 0”.

Xinyi Zhao · Answer 3 · Thu Jun 15 2023 17:00:33 GMT+0800 (China Standard Time)

我通过在加载模型时删除 speaker_embedding.weight 来解决此问题。在 utils/model.py 中，第 20 行del ckpt['model']['speaker_emb.weight']

I have already deleted "speaker_emb.weight", but the error still occurs: “RuntimeError: The size of tensor a (218) must match the size of tensor b (6) at non-singleton dimension 0”.

I forgot whether I met this error. Have you tried model.load_state_dict(ckpt["model"], strict=False) ?

Zhu Li (李柱） · Answer 4 · Fri Dec 08 2023 21:56:16 GMT+0800 (China Standard Time)

我通过在加载模型时删除 speaker_embedding.weight 来解决此问题。在 utils/model.py 中，第 20 行del ckpt['model']['speaker_emb.weight']

I have already deleted "speaker_emb.weight", but the error still occurs: “RuntimeError: The size of tensor a (218) must match the size of tensor b (6) at non-singleton dimension 0”.

I forgot whether I met this error. Have you tried model.load_state_dict(ckpt["model"], strict=False) ?

Hi. I also encountered this issue. Have you already solved it?