Skip to content
Clairos Learn

Cost, capacity, and reliability · Lesson 4 of 14 · 7 min

Inspect cache effectiveness

Cache effectiveness depends on hit rate, eligible work and correctness. A high hit rate is harmful when responses come from stale or improperly shared entries.

Mastery 0/3Run itExplain itApply it
learner@clairosSimulated AI Ops lab
learner@clairos:~ $
↑ history · Tab complete · Ctrl+C cancel · Esc, Tab to leaveExit 0

Understand the pattern

Cache effectiveness depends on hit rate, eligible work and correctness. A high hit rate is harmful when responses come from stale or improperly shared entries.

Interpret the evidence

Investigate the stale hits rather than celebrating the hit rate alone.

A tempting mistake

An 80 percent hit rate proves cache correctness.

All names, measurements, prices, versions, and thresholds in this exercise are fictional training data. The evidence supports this bounded scenario, not a claim about a live provider.

Worked example and expected result
$ cat /opt/ai-lab/cases/aiops-cost-reliability-004.json
{
  "fixture": "Fictional training data; not a live measurement.",
  "cache_hit_rate": 0.8,
  "stale_hits": 12,
  "tenant_keyed": true
}

Exit status: 0. The command completed successfully in the training fixture.

$ jq .stale_hits /opt/ai-lab/cases/aiops-cost-reliability-004.json
12

Exit status: 0. The command completed successfully in the training fixture.

$ printf '%s\n' 'repair-stale-cache' > /home/learner/lab/aiops-cost-reliability-004-decision.txt
(no output; exit 0)

Exit status: 0. The command completed successfully in the training fixture.

Try a variation

Name the assumption that would have to change for “repair-stale-cache” to stop being the justified action. Do not silently replace missing evidence with a guess.

Explain it

What does the evidence in “Inspect cache effectiveness” justify?

Apply it elsewhere

A colleague concludes: “An 80 percent hit rate proves cache correctness.” What should you do?

Keep the momentum.

Complete the lab, then explain and apply the pattern.

Next: Read concurrency limitsTry an incident drill

Anonymous lesson and mastery progress lasts for this session. Sign in to keep synced lesson XP between sessions; mastery stays device-local. No speed bonus, lost lives, or hint penalties.

Keep learning

  1. 01Compare model cost profilesModel cost comparison should use the same workload and required quality. A cheaper request that repeatedly fails the task may not be the better operating choice.Practice
  2. 02Read concurrency limitsConcurrency limits bound in-flight work; they do not directly state requests per second. Throughput also depends on service time and workload size.Practice
  3. 03Estimate capacity headroomCapacity headroom compares measured demand with a relevant tested limit. State the workload and measurement assumptions instead of calling all unused resources interchangeable.Practice