Join the Webstudio community

Updated 2 months ago

Ahrefs Audit

At a glance
The community members are experiencing an issue where the Ahrefs SiteAudit bot is returning a 403 error when accessing their websites built on Webstudio and hosted on Cloudflare. Some community members have suggested that the issue may be related to Ahrefs updating their IP addresses or Cloudflare's bot verification process. The community members are trying to troubleshoot the issue, but there is no explicitly marked answer. They have been directed to contact both Ahrefs and Cloudflare about the problem.
Useful resources
The website returns a 403 error to the Ahrefs SiteAudit bot. Has anyone encountered a similar issue and if so, how did you resolve it? The site is built on Webstudio and hosted on Cloudflare.
J
I
O
20 comments
Hm I'm using Ahrefs too and not having a problem. It's on the list of approved bots. Do you have any config for blocking bots on your Cloudflare account?
I published a website last week and another one today. Both return 403 errors, even though I haven't set up any configurations on Cloudflare yet. It could be that Ahrefs changed their IP addresses yesterday.
Thanks for your reply
It's not based on ip
Could you please advise me what I should check? Ahrefs Site Audit works fine on all my websites except two that I built with Webstudio. This is not a complaint - I'm just trying to figure out the situation.
I am not sure what's wrong, we need to see what you see
Are they custom URLs or wstd.io domain? I don't think it should matter but just trying to figure out what the difference could be. And also per Oleg request can you screenshot what youre seeing
Oh mine are failing now too. Maybe it is related to them updating their IPs
Attachment
Screenshot_2024-12-24_at_12.27.50_PM.png
Cloudflare maybe uses a combo of hints about the bot as i supposed anyone can just say "Im ahrefs"
The domain was purchased on Cloudflare and connected according to the instructions in the article https://docs.webstudio.is/university/foundations/publishing-and-custom-domains. I didn't make any additional configurations beyond those described in the article.

Then I connected Google Search Console and then Ahrefs. Ahrefs shows the following error:
Attachment
Screenshot_2024-12-24_at_21.20.12.png
if ours are failing now then somebodyis gonna fix it soon
maybe ahrefs changed the bot signature and cloudflare list hasn't been updated yet
pretty sure this will be resolved by someone else
someone can ping ahrefs just in case you are first
Wouldnt it be Cloudflare?
maybe, not sure who is in charge of that list specific entries
each individual owners or cf for all of them
The thing is, Site Audit works fine for my other websites. So I think the issue might be on my end rather than something general.

Ahrefs support directed me to contact both you and Cloudflare about this issue.
Cloudflare manually approves well-behaved services that benefit the broader Internet and honor robots.txt.
https://radar.cloudflare.com/traffic/verified-bots
Add a reply
Sign up and join the conversation on Discord