SeanLee97 / AnglE

Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard

Home Page:https://arxiv.org/abs/2309.12871

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

MTEB STS performance and using as feature extraction model

dhruv-anand-aintech opened this issue · comments

Hi, very interesting approach, and impressive results.
Have you run the MTEB STS benchmark on your trained models?
Would be interesting to see their performance v/s existing models with similar model size.

Thanks

commented

Hi @dhruv-anand-aintech, thanks for following our work and thanks for your suggestion. We will test the STS performance on MTEB later.

commented

Hi @dhruv-anand-aintech , we have uploaded our common model (UAE-Large-V1). It achieves SOTA on MTEB with an average score of 64.64.
You can follow the UAE usage to use our latest models:)

congrats!