Retrieval and embeddings

Compare retrieval configurations

Compare retrieval configurations through a bounded evidence-first AI operations workflow in the training lab.

8 min Admin Lesson 104 of 180

cat /opt/ai-lab/rag/index-status.jsonaiops rag status compare-retrieval-configurationsjq . /opt/ai-lab/rag/index-status.json

Lesson 104 of 180 0/180 lessons 0/18 missions 0/11 briefings Retrieval and embeddings · 8 min

0%

Continue View profile

New learnerrank 0XP 0%complete

learner@aiops:/home/learner $ AI operations lab: type a command, press Enter

Instructions 8 min

Click any instruction for the command details, the why, and the common mistake to avoid.

Inspect the retrieval and embeddings baseline

Type this exactly: cat /opt/ai-lab/rag/index-status.json

cat /opt/ai-lab/rag/index-status.json

Run the rag review

Type this exactly: aiops rag status compare-retrieval-configurations

aiops rag status compare-retrieval-configurations

Confirm the evidence

Type this exactly: jq . /opt/ai-lab/rag/index-status.json

jq . /opt/ai-lab/rag/index-status.json

Save progress

Keep learning across sessions.

Create a free account to sync completed lessons, XP, streaks, course status, and your next lesson across sessions.

Checking account status...

Progress sync is idle.

0XP New learnerrank 0day streak 0best streak 0daily streak 0lessons 0courses 0missions 0tasks Noverified

Continue

Progress sync stores completion IDs, scores, streaks, badges, and game settings. Terminal contents, editor snippets, lab scratch, email, and real names are never published on leaderboards or share cards.

Lesson support

What to notice while you play.

Objective

Use commands and observable output to explain compare retrieval configurations without changing a real model or service.

Hint

Start with cat /opt/ai-lab/rag/index-status.json. Then run aiops rag status compare-retrieval-configurations before collecting the final evidence.

Why it matters

Compare retrieval configurations is an operator skill because AI behavior must be connected to versioned configuration, runtime state, and inspectable evidence.

Common mistakes

Skipping the baseline fixture before reasoning about compare retrieval configurations.
Treating one simulated output as proof of root cause instead of one bounded piece of evidence.

Reference

Commands in this lesson.

aiops models

Inspect the simulated model catalog, manifests, and version comparisons.

aiops prompts

Review versioned prompt metadata and deterministic prompt diffs.

aiops evals

Run and inspect bounded evaluation fixtures without model execution.

aiops rag

Inspect retrieval documents, chunks, index status, and reviewed results.

aiops traces

Read deterministic request traces, summaries, and latency evidence.

aiops guardrails

Review simulated guardrail policies, checks, and audit summaries.

aiops cost

Estimate cost and capacity from fixed training metrics.

aiops incidents

Review incident timelines, evidence bundles, and operator notes.

jq

Query JSON fixtures with a small declarative path subset; no expression execution occurs.