I suggest excluding pages like /modcp/ from IndexNow as the crawler can't access them anyway.

207.46.13.11 - [07/Jan/2023 +0100] "GET /modcp/reports/4120/ HTTP/1.1" 403 11672 "-" "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"

IPS won't send any requests to IndexNow suggesting to index such an URL.

 

I guess you mean to add an no index directory to the robots.txt file?

ok thanks, Bing Search shows me that this page was sent by IndexNow. Don't know why, maybe a single case.

55 minutes ago, Daniel F said:

I guess you mean to add an no index directory to the robots.txt file?

 

no, not that 🙂

Edited January 9, 20232 yr by SeNioR-

 

I'll create a ticket to take a look at this.

@SeNioR- check the value of this setting in Cloudflare:

Edited January 9, 20232 yr by 13.

18 hours ago, 13. said:

@SeNioR- check the value of this setting in Cloudflare:

Wouldn't this show Cloudflare as the source? At least that's what I get when the crawler hints are enabled.

I had two options enabled, I didn't notice it 😛