Robots.txt Generator

Create search-crawler control parameters dynamically. Guide search engine bots with custom paths.

Directives Config

Asterisk (*) represents all search crawlers.

Generated Output

User-agent: * Disallow: /api/ Disallow: /admin/