Search Knowledge Base by Keyword
HREFLang Builder Bot
If you have landed on this page you have either encountered our diagnostic bot in your log files or you are looking to set up bot permissions to allow HREFLang Builder to access your site.
Bot Name:
“HreflangBuilder/0.1 +https://www.hreflangbuilder.com/bot.html”
Why it visits your site
If you see our diagnostic bot named “HreflangBuilder/0.1” in your log files or security logs it is because your organization or marketing agency subscribes to our HREFLang Builder service to create HREFLang XML site maps. We have no reason to visit your site and waste our resources unless you are a client.
The only purpose and its only purpose is to request URL’s (web pages) to ensure that they can be requested by the search engines by checking the Header Status Code, Meta Robots Exclusions and Rel=Canonical tags.
HREFLang Builder Bot does not, capture, cache or store any web content or any personal data. We only perform the tests noted above and record the response.
Before Blocking or Submitting Abuse Reports
Before you automatically block this bot and/or submit an abuse report please do the following:
- Talk to your SEO team or agency and ask they if they subscribe to HREFlang Builder to build HREFLang XML site maps.
- Check your actual HREFlang XML site maps, usually referenced in the robots.txt file to look for our “Created By Signature” which is in the second line of the country XML files.
Excluding our Bot
We obey the Robots.txt protocol and will not crawl your site if you exclude the our user-agent in your robots.txt file. To do this add the following entry:
User-agent: HreflangBuilder
Disallow: /
Note, please notify the Marketing and SEO teams if you block this user agent so they can adjust their service and/or cancel their account. If you need us to suspend our requests during specific seasons or other reasons please contact your SEO or Marketing team and/or send us a note at help@hreflangbuilder.com so that we can pause or cancel your projects.
Including our Bot
If you wish to whitelist HREFLang Builder in your CDN and Security tools please follow our guide. Note, if your DevOps or Web Security Team has excluded us and you wish to use our tools you will need to remove this entry to allow us access.