Blasphemous robots.txt Free Download For Android | GetJar

Over 3,500 downloads!The Robot Exclusion Protocol is a convention for instructing web search engine spiders about which portions of your websites they should access. Search engines, such as Google's Googlebot, look for a "robots.txt" file for these