SEO, performance, and hosting · Lesson 6 of 8 · 7 minutes

SEO, performance, and hosting: Robots guidance

A robots meta noindex directive asks compatible crawlers not to index a page; they must be allowed to fetch it to see the directive.

Open the lab Course map

Mastery 0/3Run itExplain itApply it

Current edit

PreviewNo external resources

Your objectives

Hints are always available. Wrong turns never cost XP.

1
Build robots guidance
Build this first target: <head>; <title> inside <head> containing “Private draft preview”. Inspect the structure before checking the lesson.
Hint & worked example
A robots meta noindex directive asks compatible crawlers not to index a page; they must be allowed to fetch it to see the directive.
The requested elements, attributes, content, and hierarchy exist outside comments.
```
<head><title>Private draft preview</title></head>
```
Common mistake to avoid: A visual appearance alone guarantees the intended HTML meaning.
2
Extend the robots guidance example
Extend your file to include: <head>; <title> inside <head> containing “Private draft preview”; <meta> inside <head> (name="robots", content="noindex"). Inspect the structure before checking the lesson.
Hint & worked example
A robots meta noindex directive asks compatible crawlers not to index a page; they must be allowed to fetch it to see the directive.
The requested elements, attributes, content, and hierarchy exist outside comments.
```
<head><title>Private draft preview</title><meta name="robots" content="noindex"></head>
```
Common mistake to avoid: Replacing semantic elements with generic divs automatically improves accessibility.
3
Verify the complete robots guidance pattern
Finish the pattern with: <head>; <title> inside <head> containing “Private draft preview”; <meta> inside <head> (name="robots", content="noindex"); <main>; <h1> inside <main> containing “Draft preview”; <p> inside <main> containing “Authentication is still required for private information.”. Inspect the structure before checking the lesson.
Hint & worked example
A robots meta noindex directive asks compatible crawlers not to index a page; they must be allowed to fetch it to see the directive.
The requested elements, attributes, content, and hierarchy exist outside comments.
```
<head><title>Private draft preview</title><meta name="robots" content="noindex"></head><main><h1>Draft preview</h1><p>Authentication is still required for private information.</p></main>
```
Common mistake to avoid: A visual appearance alone guarantees the intended HTML meaning.

Understand the pattern

A robots meta noindex directive asks compatible crawlers not to index a page; they must be allowed to fetch it to see the directive.

Misconceptions to reject

A visual appearance alone guarantees the intended HTML meaning.
Replacing semantic elements with generic divs automatically improves accessibility.

The preview is a sanitized subset, not a full browser compatibility test.

Worked example and expected result

<head><title>Private draft preview</title><meta name="robots" content="noindex"></head><main><h1>Draft preview</h1><p>Authentication is still required for private information.</p></main>

A robots meta noindex directive asks compatible crawlers not to index a page; they must be allowed to fetch it to see the directive.

Try a variation

Adapt the final example to a different project name while retaining its structure and relationships. A different context still needs a real browser and accessibility check.

Explain it

Which statement correctly explains robots guidance?Replacing semantic elements with generic divs automatically improves accessibility.A robots meta noindex directive asks compatible crawlers not to index a page; they must be allowed to fetch it to see the directive.A visual appearance alone guarantees the intended HTML meaning.

Apply it elsewhere

You reuse robots guidance in a different project. What must still be verified?The meaning, relationships, and accessible names in the new document.Nothing; passing a single exercise guarantees every future use.Only whether the source code has the same number of lines.

Keep the momentum.

Complete the lab, then explain and apply the pattern.

Next: SEO, performance, and hosting: Helpful 404 pages Try an incident drill

Anonymous lesson and mastery progress lasts for this session. Sign in to keep synced lesson XP between sessions; mastery stays device-local. No speed bonus, lost lives, or hint penalties.

Keep learning

MDN: HTML structure