Replies: 2
I’m trying to use Google’s “URL Inspection” to notice my corrected robots.txt file, but because the “X-Robots-Tag” header is on this response, I can’t use that tool.
Any way around this?
The original issue is that for less than an hour I had a bad robots.txt on a website, and because I tried to use the structured data testing tool during that time, the bad “robots.txt” file has been “stuck” in Google since this weekend, after a big website revamp.