llm-test

There are 0 repository under llm-test topic.

uptrain-ai / uptrain
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
autoevaluation evaluation experimentation hallucination-detection jailbreak-detection llm-eval llm-prompting llm-test llmops machine-learning monitoring openai-evals prompt-engineering root-cause-analysis
Language:Python 2096
georgian-io / LLM-Finetuning-Toolkit
Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
classification fine-tuning finetuning large-language-models nlp nlp-machine-learning summarization falcon flan-t5 llama2 lora qlora redpajama ablation-study llm-test mistral-7b unit-testing zephyr
Language:Python 729
JohnSnowLabs / langtest
Deliver safe & effective language models
benchmarks ethics-in-ai large-language-models ml-safety ml-testing mlops model-assessment nlp responsible-ai llm-test ai-safety ai-testing artificial-intelligence benchmark-framework llm llm-as-evaluator llm-evaluation-toolkit llm-testing trustworthy-ai
Language:Python 468
athina-ai / athina-sdk
LLM Testing SDK that helps you write and run tests to monitor your LLM app in production
aiops llm llm-test llmops mlops monitoring testing-tools
Language:Python 129
levitation-opensource / Manipulative-Expression-Recognition
MER is a software that identifies and highlights manipulative communication in text from human conversations and AI-generated responses. MER benchmarks language models for manipulative expressions, fostering development of transparency and safety in AI. It also supports manipulation victims by detecting manipulative patterns in human communication.
benchmarking conversation-analysis conversation-analytics fraud-detection fraud-prevention llm llm-security llm-test llm-training manipulation prompt-engineering prompt-injection psychometrics misinformation expression-recognition sentiment-analysis sentiment-classification human-computer-interaction human-robot-interaction transparency
Language:HTML 8
Coldwave96 / LLM-Sec-Evaluation
Scripts for evaluating LLM security abilities.
baichuan-13b chatglm2-6b llm-test
Language:Python 5
awesome-software / nlptest
Deliver safe & effective language models
llm-test
Language:Python 1
prompt-foundry / typescript-sdk
The prompt engineering, prompt management, and prompt evaluation tool for TypeScript, JavaScript, and NodeJS.
llm-test prompt-engineering prompt-management prompt-testing typescript llm-eval llm-evaluation open-ai prompt-evaluation prompt-manager gpt gpt-3 gpt-4 llm llm-ops llmops
Language:TypeScript 1
awesome-software / promptfoo
Test your prompts. Evaluate and compare LLM outputs, catch regressions, and improve prompt quality.
llm-test
Language:TypeScript 0
prompt-foundry / go-sdk
The prompt engineering, prompt management, and prompt evaluation tool for Go.
go golang gpt gpt-4 llm-eval llm-evaluation llm-test open-api prompt-engineering prompt-management prompt-manager llm-testing prompt-eva prompt-test