User-agent: * Allow: / # Filtered and sorted catalogue views. They carry noindex already; disallowing # the query strings keeps them out of crawl budget too, since every combination # of q, sort and page is a distinct URL that resolves to the same templates. # The clean /templates and /templates/category/* pages stay crawlable. Disallow: /templates?* # Two sitemaps, not one. The pages sitemap is prerendered at build time; the # templates sitemap is served per request, because a template published an hour # ago has to be discoverable without waiting for a deploy. Sitemap: https://dbplanner.io/sitemap.xml Sitemap: https://dbplanner.io/sitemap-templates.xml