falcon

There are 5 repositories under falcon topic.

LocalAI
mudler / LocalAI
:robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.
llama rwkv ai llm stable-diffusion api kubernetes gpt4all falcon tts coqui musicgen mamba audio-generation image-generation text-generation gemma mistral llama3 rerank
Language:C++ 20354
bentoml / OpenLLM
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
llm llmops model-inference falcon fine-tuning stablelm llm-serving llama mpt vicuna bentoml llama2 llm-inference llm-ops open-source-llm openllm ai mistral ml mlops
Language:Python 8928
bigscience-workshop / petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
bloom chatbot deep-learning distributed-systems falcon gpt guanaco language-models large-language-models llama llama2 machine-learning neural-networks nlp pipeline-parallelism pretrained-models pytorch tensor-parallelism transformer volunteer-computing
Language:Python 8730
huggingface / text-generation-inference
Large Language Model Text Generation Inference
bloom nlp pytorch inference gpt deep-learning transformer falcon starcoder
Language:Python 8029
open-falcon / falcon-plus
An open-source and enterprise-level monitoring system.
monitoring falcon time-series grafana nightingale falcon-ng obsuite
Language:Go 7224
SJTU-IPADS / PowerInfer
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
falcon large-language-models llama llm llm-inference local-inference bamboo-7b
Language:C++ 7002
hug
hugapi / hug
Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.
hug-api python-api falcon python python3 http http-server command-line
Language:Python 6823
plotly / falcon
Free, open-source SQL client for Windows and Mac 🦅
electron visualization plotly sql mysql-client postgresql falcon redshift
Language:JavaScript 5132
kennethreitz / responder
A familiar HTTP Service Framework for Python.
http-framework python flask falcon graphql microservices web-services
Language:Python 3586
yuanzhoulvpi2017 / zero_nlp
中文nlp解决方案(大模型、数据、模型、训练、推理)
bert nlp transformers gpt2 chatglm-6b clip gpt gpt-neox pytorch text-generation dolly bloom huggingface-transformers falcon llama2 pipeline
Language:Python 2511
socketry / falcon
A high-performance web server for Ruby, supporting HTTP/1, HTTP/2 and TLS.
ruby server http-server async falcon async-http asynchronous concurrent
Language:Ruby 2508
ashishpatel26 / LLM-Finetuning
LLM Finetuning with peft
falcon fine-tuning huggingface llama llama2 llm llms lora peft pytorch text-generation
Language:Jupyter Notebook 1664
marshmallow-code / webargs
A friendly library for parsing HTTP request arguments, with built-in support for popular web frameworks, including Flask, Django, Bottle, Tornado, Pyramid, webapp2, Falcon, and aiohttp.
python django flask aiohttp pyramid falcon bottlepy marshmallow validation request-validation hacktoberfest
Language:Python 1365
hiyouga / FastEdit
🩹Editing large language models within 10 seconds⚡
bloom chatbots chatgpt falcon gpt large-language-models llama llms pytorch transformers
Language:Python 1196
explosion / spacy-llm
🦙 Integrating LLMs into structured NLP pipelines
large-language-models llm openai spacy dolly gpt-3 gpt-4 machine-learning named-entity-recognition natural-language-processing nlp text-classification prompt-engineering anthropic claude cohere falcon llama
Language:Python 956
truss
basetenlabs / truss
The simplest way to serve AI/ML models in production
machine-learning artificial-intelligence easy-to-use inference-api inference-server model-serving open-source packaging falcon stable-diffusion whisper wizardlm
Language:Python 843
explosion / curated-transformers
🤖 A PyTorch library of curated Transformer models and their composable components
albert bert camembert dolly2 falcon gptneox llama llm llms nlp pytorch roberta transformer transformers xlm-roberta
Language:Python 842
cak / secure
Secure 🔒 headers for Python web frameworks
fastapi flask django starlette bottle cherrypy falcon pyramid sanic responder aiohttp tornado masonite
Language:Python 678
georgian-io / LLM-Finetuning-Toolkit
Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
classification fine-tuning finetuning large-language-models nlp nlp-machine-learning summarization falcon flan-t5 llama2 lora qlora redpajama ablation-study llm-test mistral-7b unit-testing zephyr
Language:Python 677
guokr / swagger-py-codegen
a Python web framework generator supports Flask, Tornado, Falcon, Sanic
python swagger flask tornado falcon pypi swagger-codegen sanic
Language:Python 552
mallorbc / Finetune_LLMs
Repo for fine-tuning Casual LLMs
docker falcon gpt gpt-3 gpt-35-turbo gpt-4 gpt-j-6b llama llama2 llm llm-training mpt
Language:Python 440
jraska / Falcon
Take Android screenshots with Falcons bright eye!
screenshot screenshots screen-capture spoon falcon dialogs screenshot-library
Language:Java 409
yangjianxin1 / Firefly-LLaMA2-Chinese
Firefly中文LLaMA-2大模型，支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型
firefly llama llama-2 llama2 llm baichuan baichuan-13b bloom chatglm falcon internlm lora pretrain qlora qwen xverse baichaun2
Language:Python 373
open-falcon / dashboard
falcon-plus frontend
open-falcon data-visualization falcon monitoring
Language:JavaScript 367
CrowdStrike / psfalcon
PowerShell for CrowdStrike's OAuth2 APIs
crowdstrike falcon oauth2-client powershell powershell-module api-client api
Language:PowerShell 319
falconpy
CrowdStrike / falconpy
The CrowdStrike Falcon SDK for Python
crowdstrike oauth2 falconpy python3 python37 python38 python39 devsecops crowdstrike-apis sdk api python python-3 python310 falcon python311 security security-automation python312
Language:Python 308
spectree
0b01001001 / spectree
API spec validator and OpenAPI document generator for Python web frameworks.
apispec openapi swagger redoc flask falcon annotation pydantic annotations starlette hacktoberfest python openapi-document asgi wsgi pydantic-v2
Language:Python 305
tenstorrent / tt-metal
:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.
ml falcon llama llm low-level-programming metal mistral mixtral resnet stable-diffusion tenstorrent accelerator
Language:C++ 268
explosion / spacy-services
💫 REST microservices for various spaCy-related tasks
spacy rest-api rest-microservice falcon natural-language-processing nlp
Language:Python 239
Oksydan / falcon
Prestashop starter theme that provides great development experience.
prestashop prestashop-theme prestashop-1-7 starter-theme falcon falcon-themes webpack prestashop-8
Language:Smarty 237
inferflow / inferflow
Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
llama2 llamacpp llm-inference model-quantization multi-gpu-inference mixture-of-experts moe gemma falcon minicpm mistral bloom deepseek internlm phi-2 baichuan2 mixtral m2m100 qwen
Language:C++ 225
iamarunbrahma / finetuned-qlora-falcon7b-medical
Finetuning of Falcon-7B LLM using QLoRA on Mental Health Conversational Dataset
chatbot qlora fine-tuning llm lora peft falcon falcon-7b mental-health conversational-ai chatbots healthcare
Language:Jupyter Notebook 214
wimpysworld / umpc-ubuntu
Scripts for UMPCs such as GPD Pocket, Pocket 2, MicroPC & TopJoy Falcon
ubuntu linux gpd pocket micropc pocket2 topjoy falcon umpc netbook m pocket3 winmax p2max hacktoberfest
Language:Shell 197
stanleylsx / llms_tool
一个基于HuggingFace开发的大语言模型训练、测试工具。支持各模型的webui、终端预测，低参数量及全参数模型训练(预训练、SFT、RM、PPO、DPO)和融合、量化。
aquila baichuan bloom chatglm falcon internlm llama llama2 moss qwen chatglm2 xverse pytorch deepspeed baichuan2 mistral chatglm3 aquila2
Language:Python 179
guinmoon / llmfarm_core.swift
Swift library to work with llama and other large language models.
ai falcon gpt-2 gptneox llama llama2 rwkv starcoder swift
Language:C 170
strongbugman / apiman
Api document support for any python web framework
starlette openapi swagger-ui flask redoc api bottle swagger tornado django falcon
Language:Python 110