Webstudio
Log in

Join the Webstudio community

Updated 2 months ago

dev / prod robots.txt

At a glance

The community member has a Webstudio project with a ".wstd.io" domain for development ("dev") and a live "prod" domain "myDomain.com". They want to test new designs/features on the dev domain without affecting the published prod site. The community members are concerned that the dev pages might be found by search engines. The comments explain that wstd.io domains are automatically no indexed when a custom domain is added, so the dev pages won't show up in search results. The community members are reassured that this is a built-in feature and their concern is not an issue.

JJeremy
·
How would I accomplish this:
  • I have a Webstudio project with ".wstd.io" domain. I consider this "dev".
  • In the same project I have my live "prod" url. "myDomain.com".
I want to test new designs/features and only push them to the dev domain (which I see possible by unchecking my prod site). However, I've previously had my prod site published, and I've enabled the page to be found in search results. When I publish my new testing stuff on "dev", will all my pages will be found by the search engines?

Any chance all .wstd.io domains are blocked globally?
JJohn Siciliano
Marked as solution
wstd.io domains are automatically no indexed when a custom domain is added. It's not the same as blocking crawls, but it will prevent the site from showing up in search
View full solution
J
J
O
6 comments
JJohn Siciliano
wstd.io domains are automatically no indexed when a custom domain is added. It's not the same as blocking crawls, but it will prevent the site from showing up in search
JJohn Siciliano
Typically though, your dev domain won't be crawled unless you link to it somewhere as Google won't be able to find it until somebody tells them about it
JJeremy
So my concern is not really a concern?
JJohn Siciliano
Yes if your concern is about your pages on wstd.io getting into Google's index, then not to worry if you have a custom domain as wstd.io are no indexed (even if you check index on a single page, the entire domain is blocked)
OOleg Isonen
you can always check the meta tag on the published site <meta name="robots" content="noindex">
JJeremy
Found it! Thanks. I didn't realize this was built in. Nice. 🙂
Add a reply
Sign up and join the conversation on Discord