Talktolisten / talktolisten-LLM-prod

LLM Deployment

Talk To Listen LLM Deployment

• Talk To Listen LLM is deployed on Runpod serverless using Docker.
• The model is a fine-tuned from opensource model TheBloke/Mistral-7B-Instruct-v0.2-GPTQ using QLoRA and Supervised Learning. on the Talk To Listen dataset.