Skip to content
Clairos Learn

Retrieval and embeddings · Lesson 1 of 16 · 6 min

Map the retrieval pipeline

A retrieval pipeline separates ingestion, chunking, embedding, indexing and querying. Locate where evidence disappears before changing the answer-generation prompt.

Mastery 0/3Run itExplain itApply it
learner@clairosSimulated AI Ops lab
learner@clairos:~ $
↑ history · Tab complete · Ctrl+C cancel · Esc, Tab to leaveExit 0

Understand the pattern

A retrieval pipeline separates ingestion, chunking, embedding, indexing and querying. Locate where evidence disappears before changing the answer-generation prompt.

Interpret the evidence

Inspect the indexing boundary because embedded chunks never reached the index.

A tempting mistake

Blame the response prompt for an empty index.

All names, measurements, prices, versions, and thresholds in this exercise are fictional training data. The evidence supports this bounded scenario, not a claim about a live provider.

Worked example and expected result
$ cat /opt/ai-lab/cases/aiops-retrieval-embeddings-001.json
{
  "fixture": "Fictional training data; not a live measurement.",
  "ingested": 120,
  "chunked": 842,
  "embedded": 842,
  "indexed": 0
}

Exit status: 0. The command completed successfully in the training fixture.

$ jq .indexed /opt/ai-lab/cases/aiops-retrieval-embeddings-001.json
0

Exit status: 0. The command completed successfully in the training fixture.

$ printf '%s\n' 'inspect-index-write' > /home/learner/lab/aiops-retrieval-embeddings-001-decision.txt
(no output; exit 0)

Exit status: 0. The command completed successfully in the training fixture.

Try a variation

Name the assumption that would have to change for “inspect-index-write” to stop being the justified action. Do not silently replace missing evidence with a guess.

Explain it

What does the evidence in “Map the retrieval pipeline” justify?

Apply it elsewhere

A colleague concludes: “Blame the response prompt for an empty index.” What should you do?

Keep the momentum.

Complete the lab, then explain and apply the pattern.

Next: Inspect source documentsTry an incident drill

Anonymous lesson and mastery progress lasts for this session. Sign in to keep synced lesson XP between sessions; mastery stays device-local. No speed bonus, lost lives, or hint penalties.

Keep learning

  1. 01Inspect source documentsRetrieved evidence is only as useful as its source coverage and validity. Inspect the original document identity and revision before reasoning from a fragment.Practice
  2. 02Review chunk boundariesChunk boundaries should preserve enough local context to interpret a passage. Separating a condition from its exception can change the meaning of the retrieved evidence.Practice
  3. 03Read embedding metadataEmbeddings have a model identity and dimension contract. Query and document vectors must use a compatible embedding setup; equal storage format alone is not enough.Practice