Skip to content
Clairos Learn

Observability and tracing · Lesson 6 of 15 · 9 min

Follow a request trace

A trace follows one request through its spans. Use parent-child relationships and IDs so unrelated concurrent work does not get included in the incident path.

Mastery 0/3Run itExplain itApply it
learner@clairosSimulated AI Ops lab
learner@clairos:~ $
↑ history · Tab complete · Ctrl+C cancel · Esc, Tab to leaveExit 0

Understand the pattern

A trace follows one request through its spans. Use parent-child relationships and IDs so unrelated concurrent work does not get included in the incident path.

Interpret the evidence

Follow retrieve-07 and infer-07 within trace-07.

A tempting mistake

Add all spans from other traces because they ran at the same time.

All names, measurements, prices, versions, and thresholds in this exercise are fictional training data. The evidence supports this bounded scenario, not a claim about a live provider.

Worked example and expected result
$ cat /opt/ai-lab/cases/aiops-observability-tracing-006.json
{
  "fixture": "Fictional training data; not a live measurement.",
  "trace_id": "trace-07",
  "root": "gateway",
  "children": [
    "retrieve-07",
    "infer-07"
  ]
}

Exit status: 0. The command completed successfully in the training fixture.

$ jq .children /opt/ai-lab/cases/aiops-observability-tracing-006.json
[
  "retrieve-07",
  "infer-07"
]

Exit status: 0. The command completed successfully in the training fixture.

$ printf '%s\n' 'follow-related-spans' > /home/learner/lab/aiops-observability-tracing-006-decision.txt
(no output; exit 0)

Exit status: 0. The command completed successfully in the training fixture.

Try a variation

Name the assumption that would have to change for “follow-related-spans” to stop being the justified action. Do not silently replace missing evidence with a guess.

Explain it

What does the evidence in “Follow a request trace” justify?

Apply it elsewhere

A colleague concludes: “Add all spans from other traces because they ran at the same time.” What should you do?

Keep the momentum.

Complete the lab, then explain and apply the pattern.

Next: Find a slow spanTry an incident drill

Anonymous lesson and mastery progress lasts for this session. Sign in to keep synced lesson XP between sessions; mastery stays device-local. No speed bonus, lost lives, or hint penalties.

Keep learning

  1. 01Inspect error-rate evidenceAn error rate needs both failures and total eligible requests over a stated window. A count of failures without a denominator cannot show the rate.Practice
  2. 02Find a slow spanCompare span duration with the total trace and distinguish sequential from overlapping work. A long span is a starting point for investigation, not automatic proof of CPU saturation.Practice
  3. 03Connect logs and tracesLogs and traces correlate through stable identifiers, not approximate timestamps alone. Keep the relevant request and span identifiers in diagnostic events.Practice