What are structured outputs?

Structured outputs make a model return data in a format your code can parse, usually JSON that matches a schema you supply. With strict schema enforcement the provider guarantees the response is valid against the schema. Without it, the model is only instructed to produce JSON and can still return something malformed.

Also called: JSON mode, JSON schema output · Last updated

JSON mode versus a JSON schema

JSON mode asks for any valid JSON object. A JSON schema names the exact fields and types. Support differs per model and per provider, so check both before relying on it.

Checking support

Model pages on LLM Gateway state whether a model supports strict JSON schema output.

Learn more

Related terms