# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: # User-agent: * # Disallow: / User-agent: * Disallow: /projects/*/splice/*/signup Disallow: /studio/* Disallow: /messages/* Disallow: /terms Disallow: /privacy_policy Disallow: /vip/* Disallow: /explore/* Allow: /explore/popular/ Allow: /explore/popular