Giters

nicknochnack / Llama2RAG

A working example of RAG using LLama 2 70b and Llama Index

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

load_in_8bit=True` requires Accelerate:

andsty opened this issue · comments

commented

ImportError: Using load_in_8bit=True requires Accelerate: pip install accelerate and the latest version of bitsandbytes pip install -i https://test.pypi.org/simple/ bitsandbytes or pip install bitsandbytes`
Any help is apprecoated

commented

I have everything installed

commented

I have everything installed
I meet this error too,even though i install every thing include accelerate and bitsandbytes

commented

Downgrading transformers (from this SO answer https://stackoverflow.com/a/76976563/1038282) helped solve the issue:

pip install transformers==4.30