Skip to content
Clairos Learn

Observability and tracing · Lesson 1 of 15 · 9 min

Read an observability map

Logs, metrics and traces answer different questions. Combine a metric trend with a trace and targeted logs instead of treating any single view as the complete explanation.

Mastery 0/3Run itExplain itApply it
learner@clairosSimulated AI Ops lab
learner@clairos:~ $
↑ history · Tab complete · Ctrl+C cancel · Esc, Tab to leaveExit 0

Understand the pattern

Logs, metrics and traces answer different questions. Combine a metric trend with a trace and targeted logs instead of treating any single view as the complete explanation.

Interpret the evidence

Correlate the slow retrieval span with the index timeout and latency trend.

A tempting mistake

A metric graph alone identifies the exact failing source line.

All names, measurements, prices, versions, and thresholds in this exercise are fictional training data. The evidence supports this bounded scenario, not a claim about a live provider.

Worked example and expected result
$ cat /opt/ai-lab/cases/aiops-observability-tracing-001.json
{
  "fixture": "Fictional training data; not a live measurement.",
  "metric": "p95 increased",
  "trace": "retrieval span slow",
  "log": "index timeout"
}

Exit status: 0. The command completed successfully in the training fixture.

$ jq .trace /opt/ai-lab/cases/aiops-observability-tracing-001.json
"retrieval span slow"

Exit status: 0. The command completed successfully in the training fixture.

$ printf '%s\n' 'correlate-three-signals' > /home/learner/lab/aiops-observability-tracing-001-decision.txt
(no output; exit 0)

Exit status: 0. The command completed successfully in the training fixture.

Try a variation

Name the assumption that would have to change for “correlate-three-signals” to stop being the justified action. Do not silently replace missing evidence with a guess.

Explain it

What does the evidence in “Read an observability map” justify?

Apply it elsewhere

A colleague concludes: “A metric graph alone identifies the exact failing source line.” What should you do?

Keep the momentum.

Complete the lab, then explain and apply the pattern.

Next: Inspect gateway metricsTry an incident drill

Anonymous lesson and mastery progress lasts for this session. Sign in to keep synced lesson XP between sessions; mastery stays device-local. No speed bonus, lost lives, or hint penalties.

Keep learning

  1. 01Inspect gateway metricsMetrics need units, scope and a time window. Counters, rates and gauges should not be compared as though they measured the same thing.Practice
  2. 02Read latency percentilesA p95 latency describes a percentile within an observed window. It does not mean that every request or the average request has that latency.Practice
  3. 03Compare throughput signalsRequests per second and tokens per second measure different throughput. Workload length can change token throughput without the same change in request throughput.Practice