Case-Based Critical Thinking Question Tyler does not want parts of his website indexed, so he is creating a robots.txt file.
Tyler uses the code Disallow: / to instruct bots ____.
A) not to index the entire website
B) to index the entire website
C) to index only the main directory
D) to index the website at their own discretion

Question

Case-Based Critical Thinking Question Tyler does not want parts of his website indexed, so he is creating a robots.txt file.
Tyler uses the code Disallow: /   to instruct bots ____.
A) not to index the entire website
B) to index the entire website
C) to index only the main directory
D) to index the website at their own discretion

Quizplus · Accepted Answer

The code Disallow: / tells bots not to index the entire website, meaning they are not allowed to access any part of the website.

Case-Based Critical Thinking Question Tyler Does Not Want Parts of His