I’ve set my robots.txt to disallow indexing of a folder or subpath, but it’s still showing in search results. Why?

June 14, 2017

A

I’ve set my robots.txt to disallow indexing of a folder or subpath, but it’s still showing in search results. Why?

If you provide us sitemap and the folder/subpath is listed there, we will ignore your robots.txt. To get around without changing your sitemap, you can use our blacklist feature.