Skip to content
Clairos Learn

AI systems foundations · Lesson 14 of 15 · 8 min

Write a system baseline

A reproducible baseline records artifact, configuration, dataset and environment versions together. Keeping only an average score makes later comparisons ambiguous.

Mastery 0/3Run itExplain itApply it
learner@clairosSimulated AI Ops lab
learner@clairos:~ $
↑ history · Tab complete · Ctrl+C cancel · Esc, Tab to leaveExit 0

Understand the pattern

A reproducible baseline records artifact, configuration, dataset and environment versions together. Keeping only an average score makes later comparisons ambiguous.

Interpret the evidence

Record all four versions so the result can be compared with a later run.

A tempting mistake

Keep the score but discard the version identifiers.

All names, measurements, prices, versions, and thresholds in this exercise are fictional training data. The evidence supports this bounded scenario, not a claim about a live provider.

Worked example and expected result
$ cat /opt/ai-lab/cases/aiops-systems-foundations-014.json
{
  "fixture": "Fictional training data; not a live measurement.",
  "model": "m3",
  "prompt": "p7",
  "dataset": "gold-v4",
  "runtime": "r2"
}

Exit status: 0. The command completed successfully in the training fixture.

$ jq .dataset /opt/ai-lab/cases/aiops-systems-foundations-014.json
"gold-v4"

Exit status: 0. The command completed successfully in the training fixture.

$ printf '%s\n' 'capture-versions' > /home/learner/lab/aiops-systems-foundations-014-decision.txt
(no output; exit 0)

Exit status: 0. The command completed successfully in the training fixture.

Try a variation

Name the assumption that would have to change for “capture-versions” to stop being the justified action. Do not silently replace missing evidence with a guess.

Explain it

What does the evidence in “Write a system baseline” justify?

Apply it elsewhere

A colleague concludes: “Keep the score but discard the version identifiers.” What should you do?

Keep the momentum.

Complete the lab, then explain and apply the pattern.

Next: Foundations review checkpointTry an incident drill

Anonymous lesson and mastery progress lasts for this session. Sign in to keep synced lesson XP between sessions; mastery stays device-local. No speed bonus, lost lives, or hint penalties.

Keep learning

  1. 01Use evidence before actionSeparate observations from hypotheses. A correlation with a deployment is a useful lead, but logs, traces and a controlled comparison are needed before claiming cause.Practice
  2. 02Foundations review checkpointA sound system review connects one observed failure to a component, its evidence and a reversible next step. Do not turn a system map into an unsupported diagnosis.Practice