AI operations lab

Observability and tracing

Use logs, metrics, traces, request identifiers, latency percentiles, and error budgets to explain behavior.

Track progress 0/180 lessons 0/18 missions 0/11 briefings 12 courses
0%
Continue View profile
01 Observability and tracing Read an observability map

Read an observability map through a bounded evidence-first AI operations workflow in the training lab.

Admin Checkpoint 9 min · cat /opt/ai-lab/observability/metrics.txt, aiops traces show read-an-observability-map, curl http://127.0.0.1:8080/metrics
02 Observability and tracing Inspect gateway metrics

Inspect gateway metrics through a bounded evidence-first AI operations workflow in the training lab.

Admin 5 min · cat /opt/ai-lab/observability/metrics.txt, aiops traces summary inspect-gateway-metrics, journalctl -u ai-gateway -n 3
03 Observability and tracing Read latency percentiles

Read latency percentiles through a bounded evidence-first AI operations workflow in the training lab.

Admin 6 min · cat /opt/ai-lab/observability/metrics.txt, aiops traces latency read-latency-percentiles, grep p95 /opt/ai-lab/observability/metrics.txt
04 Observability and tracing Compare throughput signals

Compare throughput signals through a bounded evidence-first AI operations workflow in the training lab.

Admin 7 min · cat /opt/ai-lab/observability/metrics.txt, aiops traces show compare-throughput-signals, curl http://127.0.0.1:8080/metrics
05 Observability and tracing Inspect error-rate evidence

Inspect error-rate evidence through a bounded evidence-first AI operations workflow in the training lab.

Admin 8 min · cat /opt/ai-lab/observability/metrics.txt, aiops traces summary inspect-error-rate-evidence, journalctl -u ai-gateway -n 3
06 Observability and tracing Follow a request trace

Follow a request trace through a bounded evidence-first AI operations workflow in the training lab.

Admin 9 min · cat /opt/ai-lab/observability/metrics.txt, aiops traces latency follow-a-request-trace, grep p95 /opt/ai-lab/observability/metrics.txt
07 Observability and tracing Find a slow span

Find a slow span through a bounded evidence-first AI operations workflow in the training lab.

Admin 5 min · cat /opt/ai-lab/observability/metrics.txt, aiops traces show find-a-slow-span, curl http://127.0.0.1:8080/metrics
08 Observability and tracing Connect logs and traces

Connect logs and traces through a bounded evidence-first AI operations workflow in the training lab.

Admin Checkpoint 6 min · cat /opt/ai-lab/observability/metrics.txt, aiops traces summary connect-logs-and-traces, journalctl -u ai-gateway -n 3
09 Observability and tracing Inspect token metrics

Inspect token metrics through a bounded evidence-first AI operations workflow in the training lab.

Admin 7 min · cat /opt/ai-lab/observability/metrics.txt, aiops traces latency inspect-token-metrics, grep p95 /opt/ai-lab/observability/metrics.txt
10 Observability and tracing Review model saturation

Review model saturation through a bounded evidence-first AI operations workflow in the training lab.

Admin 8 min · cat /opt/ai-lab/observability/metrics.txt, aiops traces show review-model-saturation, curl http://127.0.0.1:8080/metrics
11 Observability and tracing Read an SLO window

Read an SLO window through a bounded evidence-first AI operations workflow in the training lab.

Admin 9 min · cat /opt/ai-lab/observability/metrics.txt, aiops traces summary read-an-slo-window, journalctl -u ai-gateway -n 3
12 Observability and tracing Calculate error-budget posture

Calculate error-budget posture through a bounded evidence-first AI operations workflow in the training lab.

Advanced 5 min · cat /opt/ai-lab/observability/metrics.txt, aiops traces latency calculate-error-budget-posture, grep p95 /opt/ai-lab/observability/metrics.txt
13 Observability and tracing Build an incident timeline

Build an incident timeline through a bounded evidence-first AI operations workflow in the training lab.

Advanced 6 min · cat /opt/ai-lab/observability/metrics.txt, aiops traces show build-an-incident-timeline, curl http://127.0.0.1:8080/metrics
14 Observability and tracing Prepare an observability summary

Prepare an observability summary through a bounded evidence-first AI operations workflow in the training lab.

Advanced 7 min · cat /opt/ai-lab/observability/metrics.txt, aiops traces summary prepare-an-observability-summary, journalctl -u ai-gateway -n 3
15 Observability and tracing Observability checkpoint

Observability checkpoint through a bounded evidence-first AI operations workflow in the training lab.

Advanced 8 min · cat /opt/ai-lab/observability/metrics.txt, aiops traces latency observability-checkpoint, grep p95 /opt/ai-lab/observability/metrics.txt
Command coverage

Commands you will practice here.

aiops models

Inspect the simulated model catalog, manifests, and version comparisons.

aiops prompts

Review versioned prompt metadata and deterministic prompt diffs.

aiops evals

Run and inspect bounded evaluation fixtures without model execution.

aiops rag

Inspect retrieval documents, chunks, index status, and reviewed results.

aiops traces

Read deterministic request traces, summaries, and latency evidence.

aiops guardrails

Review simulated guardrail policies, checks, and audit summaries.

aiops cost

Estimate cost and capacity from fixed training metrics.

aiops incidents

Review incident timelines, evidence bundles, and operator notes.

curl

Read only fixed loopback training endpoints; external URLs and request bodies are blocked.

journalctl

Read bounded simulated AI service logs.