[Bug] Function definition missing in data.py

[Aman]

The make_data.py file in scripts invokes create_data_files(args.data_directory) where default directory as setup is data.

The function invokes

ArithmeticTokenizer.create_token_file(data_dir)
ArithmeticDataset.create_dataset_files(data_dir)

both of which are not defined in the corresponding class. This breaks the code when running for multiple experiments.

[Brian Cheung]

Have you been able to resolve this issue? I'm running into the same blocking point.

[Toon Tran]

I'm having the same issue as well

[Aman]

Have you been able to resolve this issue? I'm running into the same blocking point.

@briancheung I worked around to it. Changed the default math operator on the params and wrote a function to create data files. Hopefully that helps.

@sontungtran Not sure if this helps you as well. But my objective was to generate multiple operator datasets. If you're looking to do the same. You can try it out.