$ 0 0 Google is trying to make the Robots Exclusion Protocol (REP) an official standard. See original: Google wants to open source web crawlers