Back to feed
Dev.to
Dev.to
8/3/2026
My site-indexation checker passed once, then failed 8 times in a row. Same query, same minute.

My site-indexation checker passed once, then failed 8 times in a row. Same query, same minute.

Short summary

A developer's site-indexation checker for an iOS side project proved fundamentally unreliable: datacenter egress IPs get blocked by Google, DuckDuckGo, Bing, and Mojeek, with Bing silently returning wrong results. Adding a control query (known-good answer) fixed correctness but revealed the tool only works ~10% of the time due to aggressive rate limiting. The key lesson: validating correctness is not the same as validating reliability, and a control gate that fires first can consume the only available query budget.

  • Datacenter IPs are blocked by all major search engines, making automated site: queries unreliable
  • Bing silently returns HTTP 200 with wrong results, which is more dangerous than a hard block
  • Control-validated checks are correct but only pass ~10% of the time due to rate limits, so reliability must be measured separately from correctness

Generated with AI, which can make mistakes.

Is this a good recommendation for you?

Comments

Failed to load comments. Please try again.

Explore more