structured-generation

There are 5 repositories under structured-generation topic.

dottxt-ai / outlines
Structured Outputs
generative-ai llms prompt-engineering symbolic-ai cfg json regex structured-generation
Language:Python 12811
BoundaryML / baml
The AI framework that adds the engineering to prompt engineering (Python/TS/Ruby/Java/C#/Rust/Go compatible)
baml boundaryml guardrails llm llm-playground playground prompt prompt-config prompt-templates structured-data structured-generation structured-output vscode
Language:Rust 6656
imaurer / awesome-llm-json
Resource list for generating JSON using LLMs via function calling, tools, CFG. Libraries, Models, Notebooks, etc.
awesome-list function-calling gpt-actions large-language-models llm structured-generation
2147
mlc-ai / xgrammar
Fast, Flexible and Portable Structured Generation
large-language-models structured-generation
Language:C++ 1352
dottxt-ai / outlines-core
Faster structured generation
fsm json-schema llms regex structured-generation
Language:Rust 257
RhythmicWave / NovelForge
AI辅助长篇小说创作，卡片式创作，支持基于 JSON Schema的结构化 AI 生成与上下文引用，可扩展性强。
ai-writing ai-writing-assistant creative-writing creative-writing-ai fiction json-schema llm longform novel-writing outline pydantic structured-generation
Language:Vue 183
parkervg / blendsql
Query language for blending SQL and LLMs across structured + unstructured data, with type constraints.
llm sql structured-generation symbolic-ai python query-language question-answering natural-language-processing nlp constrained-decoding
Language:Python 114
weaviate / structured-rag
Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
dspy retrieval-augmented-generation structured-generation
Language:Jupyter Notebook 111
MantisAI / sieves
Plug-and-play, zero-shot document processing pipelines.
few-shot-learning generative-ai llm machine-learning nlp structured-generation zero-shot-learning
Language:Python 105
guidance-ai / llgtrt
TensorRT-LLM server with Structured Outputs (JSON) built with Rust
cfg guidance json openai-api regex structured-generation tensorrt-llm
Language:Rust 60
Elijas / baml-agents
Building Agents with LLM structured generation (BAML), MCP Tools, and 12-Factor Agents principles
12-factor-agents ai-agents ai-agents-framework baml mcp-client structured-generation context-window framework llms memory orchestration rag 12-factor ai mcp
Language:Python 55
jndiogo / sibila
Extract structured data from local or remote LLM models
ai dataclasses gpt local-models openai pydantic python structured-data structured-extraction gguf large-language-models llamacpp llm-inference local-ai structured-generation
Language:Python 47
retab-dev / retab
The developper starter pack for document processing
api document-analysis llm structured-generation openai
Language:Jupyter Notebook 33
petrukha-ivan / mlx-swift-structured
Structured output generation in Swift
large-language-models mlx-swift structured-generation
Language:Swift 28
aastroza / structured-generation-benchmark
Structured Generation Evals
generative-ai llms structured-generation instructor modal outlines transformers
Language:Jupyter Notebook 12
EdAbati / outlines-haystack
Use `outlines` generators with Haystack.
ai generative-ai haystack llm machine-learning nlp outlines structured-generation
Language:Python 12
AidanCooper / constrained-decoding
A guide to structured generation using constrained decoding
constrained-decoding generative-model large-language-models nlp sglang structured-generation
Language:Jupyter Notebook 11
lydakis / alloy
Python for logic. English for intelligence.
agent-framework ai-agents anthropic dataclasses function-calling gemini-ai generative-ai json-schema llm llm-framework multi-provider ollama openai pypi python python-library structured-generation structured-output tool-calling type-hints
Language:Python 11
parkervg / grammar-guide
Speculative grammar backtracking algorithm for LLM decoding conforming to some lark context-free grammar (CFG)
constrained-decoding context-free-grammar lark-parser llm structured-generation
Language:Python 5
aastroza / chatstract
Progressively extracts structured information from multi-turn user chats using pydantic schemas and LLMs
instructor llm llms openai structured-generation pydantic-v2
Language:Python 1
alonsosilvaallende / 2024-IADevs
Presentación en la conferencia IADevs 2024: Potenciando la Generación Aumentada usando Recuperación con Grafos de Conocimiento
generative-ai graphrag rag structured-generation structured-outputs
Language:Jupyter Notebook 1
alonsosilvaallende / 2024-PyData-Global
Presentation at PyData Global: Building Knowledge Graph-Based Agents with Structured Text Generation and Open-Weights Models
generative-ai graphrag knowledge-graph-construction llms structured-generation structured-outputs
Language:Jupyter Notebook 1
borh-lab / lexi-align
Word alignment of multilingual sentences using structured generation
word-alignment structured-generation
Language:Python 1
mazzasaverio / structured-output-cookbook
Fast structured data extraction from text using LLMs. Pre-built templates for common use cases + custom schema support.
docker openai pydantic-v2 python3 structured-generation structured-output structured-outputs uv validation
Language:Python 1
HK3-Lab-Team / StructuredGenTutorial
A gentle tutorial on structured generation using Anthropic and Pydantic
anthropic llm-inference structured-generation
Language:Jupyter Notebook 0
ifmelate / baml-dotnet
BAML .NET Client Library
baml dotnet prompt prompt-config prompt-template structured-data structured-generation
Language:C# 0
aastroza / garden
A fiction machine inspired by Borges
borges cursed-code fiction llms structured-generation
Language:Python
aastroza / mistral-fine-tuning
Mistral AI Fine-tuning Hackathon
fine-tuning humor-generation instructor llm mistral mistral-api structured-generation
Language:Jupyter Notebook
aastroza / modal-outlines-examples
Examples of code that use Outlines to enable structured text generation for LLMs running on Modal
cloud generative-ai gpu json llms modal serverless structured-generation outlines
Language:Jupyter Notebook
BoundaryML / tc-benchmark
Benchmarks to help find the best, fastest and cheapest open models for structured output and tool use
ai-framework baml llm prompt prompt-engineering structured-generation structured-output tool-calling structured-data
brotSchimmelt / llm-offline-inference
A comprehensive toolkit for streamlining and simplifying the offline inference process for LLMs across various models and libraries.
batching llm llm-inference offline-inference structured-generation
Language:Python