Skip to content
Clairos Learn

Inference requests and APIs · Lesson 6 of 16 · 8 min

Distinguish client and server errors

Client and server status classes point to different boundaries. A malformed request calls for correction, while a transient server failure may warrant a bounded retry policy.

Mastery 0/3Run itExplain itApply it
learner@clairosSimulated AI Ops lab
learner@clairos:~ $
↑ history · Tab complete · Ctrl+C cancel · Esc, Tab to leaveExit 0

Understand the pattern

Client and server status classes point to different boundaries. A malformed request calls for correction, while a transient server failure may warrant a bounded retry policy.

Interpret the evidence

Correct the client request rather than repeatedly sending the same invalid envelope.

A tempting mistake

Treat every non-200 response as a transient server outage.

All names, measurements, prices, versions, and thresholds in this exercise are fictional training data. The evidence supports this bounded scenario, not a claim about a live provider.

Worked example and expected result
$ cat /opt/ai-lab/cases/aiops-inference-apis-006.json
{
  "fixture": "Fictional training data; not a live measurement.",
  "status": 400,
  "error": "invalid_request",
  "retry_unchanged": false
}

Exit status: 0. The command completed successfully in the training fixture.

$ jq .retry_unchanged /opt/ai-lab/cases/aiops-inference-apis-006.json
false

Exit status: 0. The command completed successfully in the training fixture.

$ printf '%s\n' 'correct-client-request' > /home/learner/lab/aiops-inference-apis-006-decision.txt
(no output; exit 0)

Exit status: 0. The command completed successfully in the training fixture.

Try a variation

Name the assumption that would have to change for “correct-client-request” to stop being the justified action. Do not silently replace missing evidence with a guess.

Explain it

What does the evidence in “Distinguish client and server errors” justify?

Apply it elsewhere

A colleague concludes: “Treat every non-200 response as a transient server outage.” What should you do?

Keep the momentum.

Complete the lab, then explain and apply the pattern.

Next: Reason about timeoutsTry an incident drill

Anonymous lesson and mastery progress lasts for this session. Sign in to keep synced lesson XP between sessions; mastery stays device-local. No speed bonus, lost lives, or hint penalties.

Keep learning

  1. 01Inspect token usageUsage accounts for input and generated tokens separately. Compare the sum with the recorded total and keep the tokenizer/model context with any estimate.Practice
  2. 02Reason about timeoutsTimeouts must identify which layer stopped waiting. If the client deadline is shorter than normal server work, the client can time out while the server keeps processing.Practice
  3. 03Review retry boundariesRetry policies need a maximum attempt count, delay and retryable failure set. Unbounded retries can amplify overload and duplicate work.Practice