MaartenGr / KeyBERT

Minimal keyword extraction with BERT

Home Page:https://MaartenGr.github.io/KeyBERT/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

RepositoryNotFoundError: 401 Client Error

yudhiesh opened this issue · comments

Issue

The default value of model="all-MiniLM-L6-v2" throws an error due to the model not being found on HuggingFace:

RepositoryNotFoundError: 401 Client Error. (Request ID: Root=1-64599ec7-55ee4d860d9461c170c5b5d6)

Repository Not Found for url: https://huggingface.co/multi-qa-MiniLM-L6-cos-v1/resolve/main/config.json.
Please make sure you specified the correct `repo_id` and `repo_type`.
If you are trying to access a private or gated repo, make sure you are authenticated.
Invalid username or password.

Link to the model on HuggingFace which throws a 404 Error.

Workaround

I switched over to another model that was still available on HuggingFace like so:

from transformers.pipelines import pipeline
from keybert import KeyBERT

hf_model = pipeline("feature-extraction", model="DataikuNLP/paraphrase-albert-small-v2")
kw_model = KeyBERT(model=hf_model)

Reference

Others are facing the same issue as per this thread UKPLab/sentence-transformers#1915

Thanks for sharing this! You can also find more information at their Twitter handle. You could also see if you have any of the models cached and load them locally but I am quite sure HuggingFace is working hard on a fix seeing the large dependencies of OSS on sentence-transformers.