Repository navigation
structured-generation
- Website
- Wikipedia
Structured Outputs
The AI framework that adds the engineering to prompt engineering (Python/TS/Ruby/Java/C#/Rust/Go compatible)
Resource list for generating JSON using LLMs via function calling, tools, CFG. Libraries, Models, Notebooks, etc.
Fast, Flexible and Portable Structured Generation
Faster structured generation
Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
Query language for blending SQL and LLMs across structured + unstructured data, with type constraints.
Plug-and-play document processing pipelines with zero-shot models.
TensorRT-LLM server with Structured Outputs (JSON) built with Rust
Extract structured data from local or remote LLM models
Extract structured data from local or remote LLM models
Building Agents with LLM structured generation (BAML), MCP Tools, and 12-Factor Agents principles
The developper starter pack for document processing
Structured Generation Evals
A guide to structured generation using constrained decoding
Use `outlines` generators with Haystack.
Speculative grammar backtracking algorithm for LLM decoding conforming to some lark context-free grammar (CFG)
Python for logic. English for intelligence.
Presentación en la conferencia IADevs 2024: Potenciando la Generación Aumentada usando Recuperación con Grafos de Conocimiento
Word alignment of multilingual sentences using structured generation