The Robots Exclusion Protocol (REP) is a standard that enables website owners to control which URLs may be accessed by automated clients (i.e. crawlers) through a simple text file with a specific ...

This version replaces the one dated September 2024. This notice has been updated to reflect the change in requirements when requesting a ruling for grocery products. This publication explains the ...