huggingface-transformers

There are 14 repositories under huggingface-transformers topic.

christianversloot / machine-learning-articles
🧠💬 Articles I wrote about machine learning, archived from MachineCurve.com.
machine-learning deep-learning neural-networks tensorflow pytorch scikit-learn convolutional-neural-networks gan gans transformers huggingface-transformers dbscan clustering bert gpt albert keras keras-tensorflow pytorch-implementation pytorch-tutorial
3134
yuanzhoulvpi2017 / zero_nlp
中文nlp解决方案(大模型、数据、模型、训练、推理)
bert nlp transformers gpt2 chatglm-6b clip gpt gpt-neox pytorch text-generation dolly bloom huggingface-transformers falcon llama2 pipeline
Language:Python 2511
lxe / simple-llm-finetuner
Simple UI for LLM Model Finetuning
ai gpt-2 gpt-3 huggingface huggingface-transformers llama llm peft pytorch
Language:Jupyter Notebook 2035
katanaml / sparrow
Data processing with ML and LLM
computer-vision gpt huggingface-transformers llm machinelearning nlp-machine-learning rag
Language:Python 2029
SocialEcho
nz-m / SocialEcho
Social networking platform with automated content moderation and context-based authentication system
express jwt-authentication mern-project mongodb mongoose nodejs react redux bart-large-mnli huggingface-transformers azure-blob-storage azure-storage mern-stack authentication social-media
Language:JavaScript 1977
refuel-ai / autolabel
Label, clean and enrich text datasets with LLMs.
llm large-language-models huggingface-transformers python langchain anthropic-claude gpt-4 data-science llms machine-learning openai
Language:Python 1847
amazon-science / chronos-forecasting
Chronos: Pretrained (Language) Models for Probabilistic Time Series Forecasting
forecasting large-language-models llm machine-learning time-series foundation-models pretrained-models time-series-forecasting timeseries artificial-intelligence huggingface huggingface-transformers transformers
Language:Python 1782
Tencent / TurboTransformers
a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.
nlp transformer bert decoder gpu machine-translation inference huggingface-transformers pytorch albert roberta gpt2
Language:C++ 1442
uform
unum-cloud / uform
Pocket-Sized Multimodal AI for content understanding and generation across multilingual texts, images, and 🔜 video, up to 5x faster than OpenAI CLIP and LLaVA 🖼️ & 🖋️
huggingface-transformers language-vision multimodal pytorch semantic-search transformer cross-attention vector-search bert neural-network pretrained-models multi-lingual clip openai openclip contrastive-learning representation-learning clustering image-search llava
Language:Python 904
unitaryai / detoxify
Trained models & code to predict toxic comments on all 3 Jigsaw Toxic Comment Challenges. Built using ⚡ Pytorch Lightning and 🤗 Transformers. For access to our API, please email us at contact@unitary.ai.
bert bert-model huggingface-transformers huggingface nlp toxic-comment-classification toxicity toxic-comments sentence-classification kaggle-competition pytorch-lightning hatespeech hate-speech-detection toxicity-classification hate-speech
Language:Python 848
Denis2054 / Transformers-for-NLP-2nd-Edition
Transformer models from BERT to GPT-4, environments from Hugging Face to OpenAI. Fine-tuning, training, and prompt engineering examples. A bonus section with ChatGPT, GPT-3.5-turbo, GPT-4, and DALL-E including jump starting GPT-4, speech-to-text, text-to-speech, text to image generation with DALL-E, Google Cloud AI,HuggingGPT, and more
bert chatgpt chatgpt-api nlp transformers natural-language-processing gpt-4 gpt-3-5-turbo dall-e dall-e-api gpt-4-api huggingface-transformers openai roberta-model trax deep-learning machine-learning python pytorch
Language:Jupyter Notebook 646
georgian-io / Multimodal-Toolkit
Multimodal model for text and tabular data with HuggingFace transformers as building block for text data
huggingface-transformers transformer natural-language-processing tabular-data multimodal-learning
Language:Python 555
huggingface / transformers-bloom-inference
Fast Inference Solutions for BLOOM
bloom huggingface-transformers nlp pytorch
Language:Python 548
OpenAdapt
OpenAdaptAI / OpenAdapt
AI-First Process Automation with Large ([Language (LLMs) / Action (LAMs) / Multimodal (LMMs)] / Visual Language (VLMs)) Models
process-automation python transformers large-language-models large-multimodal-models gpt-4 gpt4-vision huggingface huggingface-transformers segment-anything large-action-model process-mining agents ai-agents ai-agents-framework anthropic google-gemini openai ultralytics
Language:Python 546
panaverse / learn-generative-ai
Learn Cloud Applied Generative AI Engineering (GenEng) using OpenAI, Gemini, Streamlit, Containers, Serverless, Postgres, LangChain, Pinecone, and Next.js
generative-ai langchain python neondb streamlit docker gemini fastapi openai pydantic sqlalchemy-orm docker-compose terraform pinecone aws azure google-cloud huggingface-transformers postgresql
Language:Python 538
xlang-ai / UnifiedSKG
[EMNLP 2022] Unifying and multi-tasking structured knowledge grounding with language models
natural-language-processing pytorch huggingface-transformers huggingface-datasets structured-knowledge-grounding semantic-parsing question-answering data-to-text text-generation fact-verification multi-task-learning prompt-learning nlp
Language:Python 532
r2d4 / rellm
Exact structure out of any language model completion.
huggingface-transformers llm transformers
Language:Python 491
keytotext
gagan3012 / keytotext
Keywords to Sentences
api docker huggingface-transformers keytotext keywords nlp sentences streamlit t5
Language:Jupyter Notebook 438
Xirider / finetune-gpt2xl
Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed
huggingface huggingface-transformers deepspeed gpt2 gpt3 finetuning gpt-neo gpt-neo-fine-tuning
Language:Python 422
barissayil / SentimentAnalysis
Sentiment analysis neural network trained by fine-tuning BERT, ALBERT, or DistilBERT on the Stanford Sentiment Treebank.
bert nlp machine-learning pytorch pytorch-implementation vuejs flask transformer huggingface huggingface-transformer huggingface-transformers sentiment-analysis bert-model stanford-sentiment-treebank albert distilbert
Language:Python 353
varunshenoy / super-json-mode
Low latency JSON generation using LLMs ⚡️
huggingface-transformers llm openai vllm
Language:Jupyter Notebook 342
THU-KEG / OmniEvent
A comprehensive, unified and modular event extraction toolkit.
event-detection event-extraction big-models bmtrain deep-learning huggingface-transformers information-extration natural-language-generation natural-language-processing pytorch
Language:Python 318
rizerphe / local-llm-function-calling
A tool for generating function arguments and choosing what function to call with local LLMs
chatgpt-functions huggingface-transformers json-schema llm llm-inference openai-function-call openai-functions
Language:Python 277
geeks-of-data / knowledge-gpt
Extract knowledge from all information sources using gpt and other language models. Index and make Q&A session with information sources.
gpt openai context embedding embedding-vectors gpt3-turbo gpt4 huggingface huggingface-transformers information-extraction language-model llm python question-answering scraper sentence-embeddings sentence-similarity vector-search llama natural-language-processing
Language:Python 269
krishnap25 / mauve
Package to compute Mauve, a similarity score between neural text and human text. Install with `pip install mauve-text`.
pytorch deep-learning text-generation huggingface-transformers nlp
Language:Python 260
aws-samples / amazon-sagemaker-local-mode
Amazon SageMaker Local Mode Examples
sagemaker amazon-sagemaker pytorch catboost lightgbm pycharm tensorflow-training pytorch-training sagemaker-processing prophet scikit-learn prophet-model hdbscan-clustering-algorithm huggingface huggingface-transformers machine-learning delta-lake gensim-word2vec dask tensorflow
Language:Python 232
sudharsan13296 / Getting-Started-with-Google-BERT
Build and train state-of-the-art natural language processing models using BERT
bert transformer huggingface-transformers albert roberta spanbert electra distilbert nlp pytorch videobert bart tinybert bertsum sentence-bert sbert clinical-bert
Language:Jupyter Notebook 208
ASR-project / Multilingual-PR
Phoneme Recognition using pre-trained models Wav2vec2, HuBERT and WavLM. Throughout this project, we compared specifically three different self-supervised models, Wav2vec (2019, 2020), HuBERT (2021) and WavLM (2022) pretrained on a corpus of English speech that we will use in various ways to perform phoneme recognition for different languages with a network trained with Connectionist Temporal Classification (CTC) algorithm.
phone-recognition asr deep-learning self-supervised-learning speech-processing speech-recognition huggingface huggingface-transformers wandb common-voice
Language:Python 177
daspartho / prompt-extend
extending stable diffusion prompts with suitable style cues using text generation
deep-learning gpt-2 huggingface-spaces huggingface-transformers machine-learning nlp prompt stable-diffusion text-generation
Language:Jupyter Notebook 174
ikergarcia1996 / Easy-Translate
Easy-Translate is a script for translating large text files with a SINGLE COMMAND. Easy-Translate is designed to be as easy as possible for beginners and as seamlesscustomizable and as possible for advanced users.
4-bit 8-bit cpu easy-to-use gpu hugginface hugginface-hub huggingface-transformers m2m100 machine-translation pytorch quantization transformers translation nllb200 begginers easy llm prompt
Language:Python 163
quickai
geekjr / quickai
QuickAI is a Python library that makes it extremely easy to experiment with state-of-the-art Machine Learning models.
ai dl ml python neural-network nlp easy-to-use fast research tensorflow2 pytorch huggingface-transformers gpt gpt-neo bert artificial-intelligence quickai yolo object-detection deep-learning
Language:Python 162
cahya-wirawan / indonesian-language-models
Indonesian Language Models and its Usage
machine-learning deep-learning nlp language-model pytorch fastai transformer huggingface-transformers
Language:Jupyter Notebook 150
Victarry / stable-dreambooth
Dreambooth implementation based on Stable Diffusion with minimal code.
diffusion-models stable-diffusion huggingface-transformers huggingface-diffusers
Language:Python 142
lxuechen / private-transformers
A codebase that makes differentially private training of transformers easy.
differential-privacy nlp transformers deep-learning pytorch huggingface-transformers
Language:Python 138
arihanv / Shush
Shush is an app that deploys a WhisperV3 model with Flash Attention v2 on Modal and makes requests to it via a NextJS app
flash-attention-2 huggingface-transformers machine-learning modal shadcn-ui transcription whisper
Language:TypeScript 132
Huffon / klue-transformers-tutorial
KLUE 데이터를 활용한 HuggingFace Transformers 튜토리얼
natural-language-processing nlp huggingface-transformers tutorials
Language:Jupyter Notebook 126

huggingface-transformers

christianversloot / machine-learning-articles

yuanzhoulvpi2017 / zero_nlp

lxe / simple-llm-finetuner

katanaml / sparrow

nz-m / SocialEcho

refuel-ai / autolabel

amazon-science / chronos-forecasting

Tencent / TurboTransformers

unum-cloud / uform

unitaryai / detoxify

Denis2054 / Transformers-for-NLP-2nd-Edition

georgian-io / Multimodal-Toolkit

huggingface / transformers-bloom-inference

OpenAdaptAI / OpenAdapt

panaverse / learn-generative-ai

xlang-ai / UnifiedSKG

r2d4 / rellm

gagan3012 / keytotext

Xirider / finetune-gpt2xl

barissayil / SentimentAnalysis

varunshenoy / super-json-mode

THU-KEG / OmniEvent

rizerphe / local-llm-function-calling

geeks-of-data / knowledge-gpt

krishnap25 / mauve

aws-samples / amazon-sagemaker-local-mode

sudharsan13296 / Getting-Started-with-Google-BERT

ASR-project / Multilingual-PR

daspartho / prompt-extend

ikergarcia1996 / Easy-Translate

geekjr / quickai

cahya-wirawan / indonesian-language-models

Victarry / stable-dreambooth

lxuechen / private-transformers

arihanv / Shush

Huffon / klue-transformers-tutorial