Robots and Sitemap Generator
Generate robots.txt and sitemap.xml from the manually entered base URL and paths; the site is not crawled.
How to Use the Robots and Sitemap Generator
The Robots and Sitemap generator processes input only in the current browser; nothing is uploaded, accessed over the network, or stored.
Input content
Enter the basic URL, allow/deny rules, and manually specified path list.
Select a processing method
Normalize URL, check XML escaping and duplicate paths.
Check and export
Copy or download robots.txt and sitemap.xml separately.
Limitations and Notes
- Pages are not discovered automatically, and paths are not verified to actually exist.
- The generated content reflects only the current manual input; review it against the site routes before publishing.
- The tool only provides locally processed results; important configurations, secrets, documents, and published content must still be reviewed in the target environment.
FAQ
Will the input be uploaded to a server?
No. The page only uses browser memory, the local file API, and local resources already provided with the site.
Does the tool automatically crawl my website?
No. All paths must be entered by the user; the page does not make network requests.
Why do the results still require manual review?
Edge-case syntax, regional standards, third-party readers, and target runtime environments may differ; the tool does not replace final validation.