Favorites
← All tools

robots.txt Generator

Generate crawler directives from paths and your sitemap URL.

Usage example

Example: enter /private/ as a blocked path, then download robots.txt.

Tool limitations

robots.txt does not protect private files or replace access control.

Are inputs uploaded?

No. Calculations and file generation are local. Opening X for contact takes you to an external platform.

Related tools