Import_llama_weights.py code bug
RDouglasSharp opened this issue · comments
line 137:
import_tokenizer(args.input_tokenizer_path, args.output_data_dir)
should be:
import_tokenizer(args.input_tokenizer_path, args.output_data_dir, args.max_block_size)