Join the Webstudio community

Updated 47 minutes ago

Robots.txt generated by webstudio

At a glance

The community member is asking if there is a way to see the robots.txt file generated by Webstudio, and if they can manually trigger the Google crawler to add the robots.txt from Webstudio. The comments suggest that the robots.txt file is available at a specific URL, and there is a question about whether it can be modified in the editor. Additionally, a link to a GitHub issue is provided, but no explicit answer is given.

Useful resources
Is there a way to see the robots.txt that is generated by webstudio? Would like to trigger the google crawler manually and add the robots.txt from webstudio.
1
B
J
J
4 comments
Is there a way we can modify this in the editor?
I would like to edit the robots.txt file too. For SEO purposes it is rather necessary, not being able to do so is impeding some services to crawl my website. Thanks guys!
Add a reply
Sign up and join the conversation on Discord