There are 5 repositories under structured-generation topic.
The AI framework that adds the engineering to prompt engineering (Python/TS/Ruby/Java/C#/Rust/Go compatible)
Resource list for generating JSON using LLMs via function calling, tools, CFG. Libraries, Models, Notebooks, etc.
AI辅助长篇小说创作,卡片式创作,支持基于 JSON Schema的结构化 AI 生成与上下文引用,可扩展性强。
Query language for blending SQL and LLMs across structured + unstructured data, with type constraints.
Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
TensorRT-LLM server with Structured Outputs (JSON) built with Rust
Building Agents with LLM structured generation (BAML), MCP Tools, and 12-Factor Agents principles
Structured output generation in Swift
Structured Generation Evals
Use `outlines` generators with Haystack.
A guide to structured generation using constrained decoding
Speculative grammar backtracking algorithm for LLM decoding conforming to some lark context-free grammar (CFG)
Progressively extracts structured information from multi-turn user chats using pydantic schemas and LLMs
Presentación en la conferencia IADevs 2024: Potenciando la Generación Aumentada usando Recuperación con Grafos de Conocimiento
Presentation at PyData Global: Building Knowledge Graph-Based Agents with Structured Text Generation and Open-Weights Models
Word alignment of multilingual sentences using structured generation
Fast structured data extraction from text using LLMs. Pre-built templates for common use cases + custom schema support.
A gentle tutorial on structured generation using Anthropic and Pydantic
BAML .NET Client Library
Mistral AI Fine-tuning Hackathon
Examples of code that use Outlines to enable structured text generation for LLMs running on Modal
Benchmarks to help find the best, fastest and cheapest open models for structured output and tool use
A comprehensive toolkit for streamlining and simplifying the offline inference process for LLMs across various models and libraries.