What is the term for a protocol on websites that determines whether and how an automated system can search and index the site.
A) Robots Exclusion Standard
B) Corporate interlocks
C) Homophily
D) Internet Archive

Question

Quizplus · Accepted Answer

The term for a protocol on websites that determines whether and how an automated system can search and index the site is called the Robots Exclusion Standard. This protocol tells web crawlers which pages or sections of the site should not be indexed or crawled by search engines.

What Is the Term for a Protocol on Websites That