SearchArtGallery views the comprehensiveness of our search results as an extremely important priority. We're committed to providing thorough and unbiased search results for our users. We stop indexing pages of a site only at the request of the webmaster who's responsible for those pages or as required by law. This policy is necessary to ensure that pages aren't inappropriately removed from our index.
See below for specific instructions. Removals will take effect the next time SearchArtGallery crawls your site.
Remove your entire website
If you wish to exclude your entire website from SearchArtGallery's results, you can place a file at the root of your server called robots.txt. This is the standard protocol that most web crawlers observe for excluding a web server or directory from any search engine. More information on robots.txt is available here: http://www.robotstxt.org/wc/norobots.html. Please note that the SearchArtGallery crawler does not interpret a 401/403 response ("Unauthorized"/"Forbidden") to a robots.txt fetch as a request not to crawl any pages on the site.
To remove your site from all search engines, including SearchArtGallery and prevent all robots from crawling it in the future, place the following robots.txt file in your server root:
User-agent: * Disallow: /
To remove your site from SearchArtGallery only and prevent just SearchArtGallery from crawling your site in the future, place the following robots.txt file in your server root:
User-agent: SearchArtGalleryBot Disallow: /
Each port must have its own robots.txt file. In particular, if you serve content via both http and https, you'll need a separate robots.txt file for each of these protocols. For example, to allow SearchArtGallery to index all http pages but no https pages, you'd use the robots.txt files below.
For your http protocol (http://yourserver.com/robots.txt):
User-agent: * Allow: /
For the https protocol (https://yourserver.com/robots.txt):
User-agent: * Disallow: /
Remove a specific image from SearchArtGallery
To remove an image (rather than your whole site) from SearchArtGallery's image results, add a robots.txt file to the root of the server as described above.
Example: If you want SearchArtGallery to exclude the johndoe.jpg image that appears on your site at www.yoursite.com/images/artists/johndoe.jpg, add the following text to your robots.txt file:
User-agent: SearchArtGalleryBot Disallow: /images/artists/johndoe.jpg
This is the standard protocol that most web crawlers observe for excluding a web server or directory from an index. More information on robots.txt is available here: http://www.robotstxt.org/wc/norobots.html.