Type Alias ChatResponseFormat

ChatResponseFormat:
    | { type: "text" }
    | { type: "json_object" }
    | {
        json_schema: {
            description?: string;
            name: string;
            schema: Record<string, unknown>;
            strict?: boolean;
        };
        type: "json_schema";
    }

OpenAI-compatible structured-output controls. Forwarded to the worker unchanged; honored natively by llama-server (compiles JSON Schema → GBNF internally) and vLLM (xgrammar / outlines). Per-request opt-in — when omitted, the model generates without constraint.

Type Alias ChatResponseFormat

Settings