dacorvo / llm-hosting-container

Large Language Model Hosting Container

LLM Hosting Container

Welcome to the LLM Hosting Container GitHub repository!

This repository contains Dockerfile and associated resources for building and hosting containers for large language models.

• HuggingFace Text Generation Inference (TGI) container

Security

See CONTRIBUTING for more information.

License

This project is licensed under the Apache-2.0 License.