Webstudio

Log inLog into community

Join the Webstudio community

Updated 2 months ago

Searchatlas integration not working? (Urgent!)

Searchatlas integration not working? (Urgent!)

At a glance

·

I've spoken to Searchatlas support and they said that something is blocking their onpage crawler. Is there any way around this?

They told me to find out if there is a way to "Whitelist IP" in WS

Please let me know what further information you need from me to help?

T

J

O

14 comments

Searchatlas integration not working? (Urgent!)

This is the message I get when trying to crawl the site...

Attachment

@Theo, I have a similar issue and reported it here.
https://github.com/webstudio-is/webstudio/issues/4355

Can you add to that ticket.

only verified bots by cloudflare are allowed, otherwise every spammer can call themselves a bot

Attachment

they need to get into verified bots list from cloudflare

https://radar.cloudflare.com/traffic/verified-bots

@Oleg Isonen is there no faster way of circumventing this block? It's absolutely essential for my client delivery...

Pick one of the verified tools that are in the list now

Attempted that already with moz and it still didn't work

Can you explain?

@Theo, MOZ has two bots there already. Maybe it's something else you're getting blocked by.

Attachment

CleanShot_2024-11-13_at_15.08.552x.png

MOZ was still unable to crawl any of my WS sites. Trying Semrush which seems to work better.

maybe you are talking about some different moz than the one in the list

https://moz.com

is this the wrong one?

Add a reply

Sign up and join the conversation on Discord