sentence-embeddings

There are 26 repositories under sentence-embeddings topic.

txtai
neuml / txtai
💡 All-in-one open-source AI framework for semantic search, LLM orchestration and language model workflows
python search machine-learning nlp semantic-search vector-search txtai llm vector-database language-model transformers sentence-embeddings large-language-models information-retrieval search-engine embeddings retrieval-augmented-generation rag ai artificial-intelligence
Language:Python 11571
FlagOpen / FlagEmbedding
Retrieval and Retrieval-augmented LLMs
embeddings information-retrieval llm sentence-embeddings text-semantic-similarity retrieval-augmented-generation
Language:Python 10527
BERTopic
MaartenGr / BERTopic
Leveraging BERT and c-TF-IDF to create easily interpretable topics.
bert transformers topic-modeling sentence-embeddings nlp machine-learning topic ldavis topic-modelling topic-models
Language:Python 7050
text2vec
shibing624 / text2vec
text2vec, text to vector. 文本向量表征工具，把文本转化为向量矩阵，实现了Word2Vec、RankBM25、Sentence-BERT、CoSENT等文本表征、文本相似度计算模型，开箱即用。
similarity nlp text-similarity text2vec word2vec embeddings sentence-embeddings
Language:Python 4848
princeton-nlp / SimCSE
[EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821
nlp sentence-embeddings
Language:Python 3534
Separius / awesome-sentence-embedding
A curated list of pretrained sentence and word embedding models
awesome awesome-list bert contextualized-representation cross-lingual embedding-models language-model natural-language nlp pretrained-embedding pretrained-language-model pretrained-models sentence-embeddings sentence-representations subword-models unsupervised-learning word-embeddings wordembedding
Language:Python 2276
SeanLee97 / xmnlp
xmnlp：提供中文分词, 词性标注, 命名体识别，情感分析，文本纠错，文本转拼音，文本摘要，偏旁部首，句子表征及文本相似度计算等功能
lexical-analysis ner nlp pinyin postagging radical segmentation sentence-embeddings sentence-similarity sentiment-analysis spell-checker
Language:Python 1277
JohnSnowLabs / nlu
1 line for thousands of State of The Art NLP models in hundreds of languages The fastest and most accurate way to solve text problems.
nlu natural-language-understanding sentiment-classifier text-classification transformers language-detection named-entity-recognition seq2seq t5 lemmatizer spell-checker sentence-embeddings sentiment-analysis bert-embedding text-summarization text-translation streamlit pandas dependency-parsing entity-resolution
Language:Python 938
wangyuxinwhy / uniem
unified embedding model
embeddings huggingface nlp sentence-embeddings sentence-transformers
Language:Python 869
Muennighoff / sgpt
SGPT: GPT Sentence Embeddings for Semantic Search
gpt information-retrieval language-model large-language-models retrieval semantic-search sentence-embeddings text-embedding neural-search sgpt
Language:Jupyter Notebook 863
goru001 / inltk
Natural Language Toolkit for Indic Languages aims to provide out of the box support for various NLP tasks that an application developer might need
nlp deep-learning indic-languages pytorch data-augmentation sentence-similarity sentence-encoding word-embeddings sentence-embeddings
Language:Python 835
oborchers / Fast_Sentence_Embeddings
Compute Sentence Embeddings Fast!
sentence-embeddings sentence-representation sentence-similarity document-similarity usif sif wordembedding gensim gensim-model word2vec-model fasttext cython embeddings maxpooling fse swem
Language:Jupyter Notebook 622
vectordb
jina-ai / vectordb
A Python vector database you just need - no more, no less.
embedding-similarity neural-search sentence-embeddings vector-database vector-database-embedding vector-search
Language:Python 601
ncbi-nlp / BioSentVec
BioWordVec & BioSentVec: pre-trained embeddings for biomedical words and sentences
natural-language-processing bionlp fasttext sent2vec sentence-embeddings word-embeddings sentence-similarity pubmed mimic-iii
Language:Jupyter Notebook 597
SeanLee97 / AnglE
Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard
llama llama2 semantic-similarity semantic-textual-similarity sentence-embedding stsbenchmark text-embedding sentence-embeddings text-similarity retrieval-augmented-generation sentence-vector text-vector text2vec embeddings sts mteb rag llm dense-retrieval information-retrieval
Language:Python 531
kaushalshetty / Structured-Self-Attention
A Structured Self-attentive Sentence Embedding
attention-mechanism attention-model self-attention self-attentive-rnn pytorch deep-learning python3 attention visualization classification sentence-embeddings attention-weights
Language:Python 492
sunyilgdx / SIFRank_zh
Keyphrase or Keyword Extraction 基于预训练模型的中文关键词抽取方法（论文SIFRank: A New Baseline for Unsupervised Keyphrase Extraction Based on Pre-trained Language Model 的中文版代码）
sifrank keyphrase-extraction keyword-extraction elmo pre-trained-language-models sif word-embeddings sentence-embeddings python36
Language:Python 426
JohnGiorgi / DeCLUTR
The corresponding code from our paper "DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations". Do not hesitate to open an issue if you run into any trouble!
contrastive-learning natural-language-processing allennlp pytorch transformers representation-learning sentence-embeddings sentence-similarity semantic-search semantic-text-similarity metric-learning self-supervised-learning
Language:Python 380
awesome-semantic-search
Agrover112 / awesome-semantic-search
A curated list of awesome resources related to Semantic Search🔎 and Semantic Similarity tasks.
awesome awesome-list hacktoberfest information-retrieval information-retrival nlp ranking semantic-search semantic-similarity sentence-embeddings
353
Doragd / Awesome-Sentence-Embedding
A curated list of research papers in Sentence Reprsentation Learning and a sts leaderboard of sentence embeddings.
sentence-embeddings sentence-similarity text-matching textual-similarity
315
voidism / DiffCSE
Code for the NAACL 2022 long paper "DiffCSE: Difference-based Contrastive Learning for Sentence Embeddings"
contrastive-learning representation-learning self-supervised-learning sentence-embeddings sentence-similarity sentence-transformers
Language:Python 293
gyunggyung / AGI-Papers
Papers and Book to look at when starting AGI 📚
nlg llm nlp dialogue sentence-similarity efficient distillation multimodal sentence-embeddings multiple-tasks stable-diffusion text-to-video tts all-to-all
Language:Python 288
geeks-of-data / knowledge-gpt
Extract knowledge from all information sources using gpt and other language models. Index and make Q&A session with information sources.
gpt openai context embedding embedding-vectors gpt3-turbo gpt4 huggingface huggingface-transformers information-extraction language-model llm python question-answering scraper sentence-embeddings sentence-similarity vector-search llama natural-language-processing
Language:Python 287
yumeng5 / Spherical-Text-Embedding
[NeurIPS 2019] Spherical Text Embedding
word-embeddings document-embeddings unsupervised-learning spherical-geometry sentence-embeddings
Language:C 177
dborrelli / chat-intents
Clustering sentence embeddings to extract message intent
clustering document-embeddings nlp sentence-embeddings unsupervised-learning
Language:Jupyter Notebook 173
robrua / easy-bert
A Dead Simple BERT API for Python and Java (https://github.com/google-research/bert)
bert language-model machine-learning natural-language-processing natural-language-understanding nlp sentence-embeddings tensorflow word-embeddings
Language:Java 171
KwangKa / SIMCSE_unsup
中文无监督SimCSE Pytorch实现
chinese nlp pytorch sentence-embeddings
Language:Python 134
pdrm83 / sent2vec
How to encode sentences in a high-dimensional vector space, a.k.a., sentence embedding.
ai artificial-intelligence encode-sentences machine-learning natural-language-processing nlp nlp-machine-learning sent2vec sentence-embeddings word2vec
Language:Python 134
YJiangcm / PromCSE
[EMNLP 2022] Improved Universal Sentence Embeddings with Prompt-based Contrastive Learning and Energy-based Learning
prompt contrastive-learning sentence-embeddings energy-based-learning pytorch
Language:Python 134
cpcdoy / rust-sbert
Rust port of sentence-transformers (https://github.com/UKPLab/sentence-transformers)
rust bert sbert sentence-transformers sentence-embeddings nlp sentence-bert rust-sbert
Language:Rust 113
TharinduDR / Simple-Sentence-Similarity
Exploring the simple sentence similarity measurements using word embeddings
python sentence-similarity sentence-embeddings word-embeddings ipynb word2vec glove fasttext elmo wmd
Language:Python 101
nikolamilosevic86 / local-genAI-search
Local-GenAI-Search is a generative search engine based on Llama 3, langchain and qdrant that answers questions based on your local files
generative-ai langchain large-language-models llama3 local msmarco python3 qdrant-client search-engine sentence-embeddings sentence-transformers
Language:Python 93
roomylee / self-attentive-emb-tf
Simple Tensorflow Implementation of "A Structured Self-attentive Sentence Embedding" (ICLR 2017)
self-attention attention attention-mechanism sentence-embeddings text-classification tensorflow iclr2017
Language:Python 91
kamalkraj / e5-mistral-7b-instruct
Finetune mistral-7b-instruct for sentence embeddings
finetuning huggingface lora mistral-7b peft pytorch sentence-embeddings transformers
Language:Python 81
hppRC / simple-simcse
A simple implementation of SimCSE
deep-learning pytorch sentence-embeddings
Language:Python 77
HITsz-TMG / KaLM-Embedding
Code for KaLM-Embedding models
embedding embedding-models retrieval sentence sentence-embeddings
Language:Python 74