kaqijiang / Auto-GPT-ZH

Auto-GPT中文版本及爱好者组织 同步更新原项目 AI领域创业 自媒体组织 用AI工作学习创作变现

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

pyo3_runtime.PanicException: assertion failed: encoder.len() == decoder.len()

zhang4014439175 opened this issue · comments

thread '' panicked at 'assertion failed: encoder.len() == decoder.len()', src/lib.rs:458:9
note: run with RUST_BACKTRACE=1 environment variable to display a backtrace
Traceback (most recent call last):
File "/Users/mac/PycharmProjects/Auto-GPT-ZH/autogpt/main.py", line 5, in
autogpt.cli.main()
File "/Users/mac/PycharmProjects/Auto-GPT-ZH/venv/lib/python3.10/site-packages/click/core.py", line 1130, in call
return self.main(*args, **kwargs)
File "/Users/mac/PycharmProjects/Auto-GPT-ZH/venv/lib/python3.10/site-packages/click/core.py", line 1055, in main
rv = self.invoke(ctx)
File "/Users/mac/PycharmProjects/Auto-GPT-ZH/venv/lib/python3.10/site-packages/click/core.py", line 1635, in invoke
rv = super().invoke(ctx)
File "/Users/mac/PycharmProjects/Auto-GPT-ZH/venv/lib/python3.10/site-packages/click/core.py", line 1404, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/Users/mac/PycharmProjects/Auto-GPT-ZH/venv/lib/python3.10/site-packages/click/core.py", line 760, in invoke
return __callback(*args, **kwargs)
File "/Users/mac/PycharmProjects/Auto-GPT-ZH/venv/lib/python3.10/site-packages/click/decorators.py", line 26, in new_func
return f(get_current_context(), *args, **kwargs)
File "/Users/mac/PycharmProjects/Auto-GPT-ZH/autogpt/cli.py", line 146, in main
agent.start_interaction_loop()
File "/Users/mac/PycharmProjects/Auto-GPT-ZH/autogpt/agent/agent.py", line 75, in start_interaction_loop
assistant_reply = chat_with_ai(
File "/Users/mac/PycharmProjects/Auto-GPT-ZH/autogpt/chat.py", line 95, in chat_with_ai
) = generate_context(prompt, relevant_memory, full_message_history, model)
File "/Users/mac/PycharmProjects/Auto-GPT-ZH/autogpt/chat.py", line 43, in generate_context
current_tokens_used = token_counter.count_message_tokens(current_context, model)
File "/Users/mac/PycharmProjects/Auto-GPT-ZH/autogpt/token_counter.py", line 25, in count_message_tokens
encoding = tiktoken.encoding_for_model(model)
File "/Users/mac/PycharmProjects/Auto-GPT-ZH/venv/lib/python3.10/site-packages/tiktoken/model.py", line 75, in encoding_for_model
return get_encoding(encoding_name)
File "/Users/mac/PycharmProjects/Auto-GPT-ZH/venv/lib/python3.10/site-packages/tiktoken/registry.py", line 63, in get_encoding
enc = Encoding(**constructor())
File "/Users/mac/PycharmProjects/Auto-GPT-ZH/venv/lib/python3.10/site-packages/tiktoken/core.py", line 50, in init
self._core_bpe = _tiktoken.CoreBPE(mergeable_ranks, special_tokens, pat_str)
pyo3_runtime.PanicException: assertion failed: encoder.len() == decoder.len()

任何输入都会报此错误,错误发生在 self._core_bpe = _tiktoken.CoreBPE(mergeable_ranks, special_tokens, pat_str) 此行代码