falcon

There are 6 repositories under falcon topic.

bentoml / OpenLLM
Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.
ai bentoml falcon fine-tuning llama llama2 llm llm-inference llm-ops llm-serving llmops mistral ml mlops model-inference mpt open-source-llm openllm stablelm vicuna
Language:Python 9612
bigscience-workshop / petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
bloom deep-learning distributed-systems language-models large-language-models machine-learning neural-networks pytorch volunteer-computing pipeline-parallelism tensor-parallelism guanaco llama chatbot gpt transformer nlp pretrained-models falcon mixtral
Language:Python 9036
huggingface / text-generation-inference
Large Language Model Text Generation Inference
bloom deep-learning falcon gpt inference nlp pytorch starcoder transformer
Language:Python 8631
SJTU-IPADS / PowerInfer
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
falcon large-language-models llama llm llm-inference local-inference bamboo-7b
Language:C++ 7799
open-falcon / falcon-plus
An open-source and enterprise-level monitoring system.
monitoring falcon time-series grafana nightingale falcon-ng obsuite
Language:Go 7248
hug
hugapi / hug
Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.
command-line falcon http http-server hug-api python python-api python3
Language:Python 6856
plotly / falcon
Free, open-source SQL client for Windows and Mac 🦅
electron visualization plotly sql mysql-client postgresql falcon redshift
Language:JavaScript 5127
kennethreitz / responder
A familiar HTTP Service Framework for Python.
falcon flask graphql http-framework microservices python web-services
Language:Python 3587
yuanzhoulvpi2017 / zero_nlp
中文nlp解决方案(大模型、数据、模型、训练、推理)
bert bloom chatglm-6b clip dolly falcon gpt gpt-neox gpt2 huggingface-transformers llama2 nlp pipeline pytorch text-generation transformers
Language:Jupyter Notebook 2793
socketry / falcon
A high-performance web server for Ruby, supporting HTTP/1, HTTP/2 and TLS.
ruby server http-server async falcon async-http asynchronous concurrent
Language:Ruby 2565
ashishpatel26 / LLM-Finetuning
LLM Finetuning with peft
falcon fine-tuning huggingface llama llama2 llm llms lora peft pytorch text-generation
Language:Jupyter Notebook 1984
marshmallow-code / webargs
A friendly library for parsing HTTP request arguments, with built-in support for popular web frameworks, including Flask, Django, Bottle, Tornado, Pyramid, webapp2, Falcon, and aiohttp.
python django flask aiohttp pyramid falcon bottlepy marshmallow validation request-validation hacktoberfest
Language:Python 1373
hiyouga / FastEdit
🩹Editing large language models within 10 seconds⚡
bloom chatbots chatgpt falcon gpt large-language-models llama llms pytorch transformers
Language:Python 1262
explosion / spacy-llm
🦙 Integrating LLMs into structured NLP pipelines
large-language-models llm openai spacy dolly gpt-3 gpt-4 machine-learning named-entity-recognition natural-language-processing nlp text-classification prompt-engineering anthropic claude cohere falcon llama
Language:Python 1048
truss
basetenlabs / truss
The simplest way to serve AI/ML models in production
artificial-intelligence easy-to-use falcon inference-api inference-server machine-learning model-serving open-source packaging stable-diffusion whisper wizardlm
Language:Python 874
explosion / curated-transformers
🤖 A PyTorch library of curated Transformer models and their composable components
bert dolly2 falcon gptneox llama llm nlp pytorch transformer xlm-roberta transformers albert camembert llms roberta
Language:Python 857
georgian-io / LLM-Finetuning-Toolkit
Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
classification fine-tuning finetuning large-language-models nlp nlp-machine-learning summarization falcon flan-t5 llama2 lora qlora redpajama ablation-study llm-test mistral-7b unit-testing zephyr
Language:Python 756
TypeError / secure
Implement secure headers in Python web frameworks to enhance application security
aiohttp bottle cherrypy django falcon fastapi flask masonite pyramid responder sanic starlette tornado
Language:Python 687
guokr / swagger-py-codegen
a Python web framework generator supports Flask, Tornado, Falcon, Sanic
falcon flask pypi python sanic swagger swagger-codegen tornado
Language:Python 554
mallorbc / Finetune_LLMs
Repo for fine-tuning Casual LLMs
docker falcon gpt gpt-3 gpt-35-turbo gpt-4 gpt-j-6b llama llama2 llm llm-training mpt
Language:Python 450
jraska / Falcon
Take Android screenshots with Falcons bright eye!
screenshot screenshots screen-capture spoon falcon dialogs screenshot-library
Language:Java 410
yangjianxin1 / Firefly-LLaMA2-Chinese
Firefly中文LLaMA-2大模型，支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型
baichaun2 baichuan baichuan-13b bloom chatglm falcon firefly internlm llama llama-2 llama2 llm lora pretrain qlora qwen xverse
Language:Python 393
open-falcon / dashboard
falcon-plus frontend
open-falcon data-visualization falcon monitoring
Language:JavaScript 370
tenstorrent / tt-metal
:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.
accelerator falcon llama llm low-level-programming metal mistral mixtral ml resnet stable-diffusion tenstorrent
Language:C++ 366
CrowdStrike / psfalcon
PowerShell for CrowdStrike's OAuth2 APIs
api api-client crowdstrike falcon oauth2-client powershell powershell-module
Language:PowerShell 345
falconpy
CrowdStrike / falconpy
The CrowdStrike Falcon SDK for Python
crowdstrike oauth2 falconpy python3 python37 python38 python39 devsecops crowdstrike-apis sdk api python python-3 python310 falcon python311 security security-automation python312
Language:Python 344
spectree
0b01001001 / spectree
API spec validator and OpenAPI document generator for Python web frameworks.
apispec openapi swagger redoc flask falcon annotation pydantic annotations starlette hacktoberfest python openapi-document asgi wsgi pydantic-v2
Language:Python 313
Oksydan / falcon
Prestashop starter theme that provides great development experience.
falcon falcon-themes prestashop prestashop-1-7 prestashop-8 prestashop-theme starter-theme webpack
Language:Smarty 246
explosion / spacy-services
💫 REST microservices for various spaCy-related tasks
spacy rest-api rest-microservice falcon natural-language-processing nlp
Language:Python 240
inferflow / inferflow
Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
llama2 llamacpp llm-inference model-quantization multi-gpu-inference mixture-of-experts moe gemma falcon minicpm mistral bloom deepseek internlm phi-2 baichuan2 mixtral m2m100 qwen
Language:C++ 232
iamarunbrahma / finetuned-qlora-falcon7b-medical
Finetuning of Falcon-7B LLM using QLoRA on Mental Health Conversational Dataset
chatbot qlora fine-tuning llm lora peft falcon falcon-7b mental-health conversational-ai chatbots healthcare
Language:Jupyter Notebook 230
wimpysworld / umpc-ubuntu
Scripts for UMPCs such as GPD Pocket, Pocket 2, MicroPC & TopJoy Falcon
ubuntu linux gpd pocket micropc pocket2 topjoy falcon umpc netbook m pocket3 winmax p2max hacktoberfest
Language:Shell 210
guinmoon / llmfarm_core.swift
Swift library to work with llama and other large language models.
ai gpt-2 gptneox llama rwkv starcoder swift falcon llama2
Language:C 203
stanleylsx / llms_tool
一个基于HuggingFace开发的大语言模型训练、测试工具。支持各模型的webui、终端预测，低参数量及全参数模型训练(预训练、SFT、RM、PPO、DPO)和融合、量化。
aquila baichuan bloom chatglm falcon internlm llama llama2 moss qwen chatglm2 xverse pytorch deepspeed baichuan2 mistral chatglm3 aquila2
Language:Python 197
strongbugman / apiman
Api document support for any python web framework
starlette openapi swagger-ui flask redoc api bottle swagger tornado django falcon
Language:Python 110
apache / falcon
Mirror of Apache Falcon
java big-data falcon
Language:Java 100