Articles
Model serving and compatible APIs: one endpoint, several contracts
A serving engine adds a queue, a lifecycle and an API surface to a weights file.
Applications
Directly assigned
Articles
Prompt, context and constraints: what the request envelope decides
The model sees what the envelope builds: template, budget and stopping conditions.
Articles
Streaming, retry, timeout and idempotency
Streaming changes when you know; idempotency decides whether you may ask again.
Articles
Structured JSON output and schema validation
Asking for JSON and constraining the decoder to JSON are two different guarantees.
Articles
Model, application, workflow, agent: who decides what happens next
Who chooses the next step: the model, the application around it, a workflow or an agent.
Articles
Model, runtime and application: the three layers
The model file, the engine that runs it, the product around it — and what a symptom means.
Articles
Prompts, system instructions and messages
What a prompt and a system instruction are, and why an instruction is not a control.