ERROR:absl:Failed to load task 'tfds_natural_instructions_template_0to10_zero_shot' as part of mixture 'palmflan_niv2_zs_opt'

Question

ERROR:absl:Failed to load task 'tfds_natural_instructions_template_0to10_zero_shot' as part of mixture 'palmflan_niv2_zs_opt'

AadSah opened this issue a year ago · comments

Hi @shayne-longpre, thanks for answering the queries actively. I am using @SirNeural's script from https://huggingface.co/datasets/SirNeural/flan_v2 to create the dataset, but I am repeatedly facing this error:

ERROR:absl:Failed to load task 'tfds_natural_instructions_template_0to10_zero_shot' as part of mixture 'palmflan_niv2_zs_opt'

I have also checked out the issue which you have raised in the tensorflow repo here: tensorflow/datasets#4804

I am wondering if you were able to find a fix to this?

Thanks!

Arindam Mitra · Answer 1 · Sat Mar 25 2023 03:28:11 GMT+0800 (China Standard Time)

I tried the script given in this repo. Niv2 works for me. Use python 3.8 while creating your env. I had to create a fresh env. However I'm facing issue with Apache Beam and dll.

shayne-longpre · Answer 2 · Thu Mar 30 2023 01:48:57 GMT+0800 (China Standard Time)

It looks like tomvdw pushed a related fix in tensorflow/datasets#4804. Did you try TFDS Nightly and see any improvement?

Aadarsh Sahoo · Answer 3 · Thu Mar 30 2023 04:23:30 GMT+0800 (China Standard Time)

Nope, I am still facing the issue. Also, I am having this issue as well: #37 (comment)

Any help on the latter part?

shayne-longpre · Answer 4 · Tue Apr 11 2023 11:00:47 GMT+0800 (China Standard Time)

@AadSah did you get around this issue using the new run_example.py?