ValueError: Tokenizer class CodeGenTokenizer does not exist or is not currently imported.

[robotPin]

https://huggingface.co/Salesforce/codegen-2B-mono
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("Salesforce/codegen-2B-mono")
model = AutoModelForCausalLM.from_pretrained("Salesforce/codegen-2B-mono")

text = "def hello_world():"
input_ids = tokenizer(text, return_tensors="pt").input_ids

generated_ids = model.generate(input_ids, max_length=128)
print(tokenizer.decode(generated_ids[0], skip_special_tokens=True))

ValueError: Tokenizer class CodeGenTokenizer does not exist or is not currently imported.

[Hiroaki Hayashi]

@robotPin Could you let me know the transformers version? Our model is not included in a release yet, so you'd have to install from the repo, i.e.

pip install git+https://github.com/huggingface/transfomers.git

[robotPin]

Version: 4.20.1

Upgrade to the Version: 4.21.0.dev0 problem solving

thank you @rooa

[Daniel Ahern]

pip install git+https://github.com/huggingface/transfomers.git

that repo doesn't exist.

[robotPin]

pip install git+https://github.com/huggingface/transfomers.git

that repo doesn't exist.

pip install git+https://github.com/huggingface/transformers.git
transfomers less than r
transformers