Webmaster Generators
Fill in a form and get the files and tags a website needs, from robots.txt and sitemaps to schema markup and redirect rules. All but the sitemap crawl run in your browser, free and without limits.
Share this page
Webmaster Generators: all 10 tools
Files that guide crawlers
Robots.txt Generator writes rules for Googlebot, Baiduspider and nine AI crawlers, with a one-click preset that blocks AI training crawlers. XML Sitemap Generator crawls your site from our server, or turns a pasted list of URLs into sitemap.xml. llms.txt Generator writes a short Markdown guide to your site for AI assistants.
Tags for search results and shared links
Meta Tag Generator measures your title and description in characters and pixels and previews the Google and Baidu snippet. Open Graph Generator builds the card people see when your link is shared, with Facebook, X and WeChat previews. Schema Markup Generator writes JSON-LD for 12 types, and Hreflang Tag Generator connects the language versions of a page.
Server rules and campaign links
301 Redirect Generator turns lists of old and new URLs into Apache, Nginx, IIS, PHP, meta refresh or JavaScript redirects. Htpasswd Generator puts a password on a folder in Apache or Nginx, and UTM Link Builder tags campaign links for WeChat, Douyin, newsletters and ads.
Where they run, and what to check next
Every generator except the sitemap crawl runs in your browser: nothing is uploaded, nothing is counted, and the page keeps working offline once it has loaded. A sitemap crawl runs on our server and counts as one task. Once the code is live, test it with the Robots.txt Tester, the Structured Data Checker or the Redirect Checker.