# robots.txt for https://sciencecenter.org/ sitemap: https://sciencecenter.org/sitemaps-1-sitemap.xml # live - don't allow web crawlers to index cpresources/ or vendor/ User-agent: * Disallow: /cpresources/ Disallow: /vendor/ Disallow: /.env Disallow: /cache/ # Filtered listing views are not pages to index: every category/year # combination is a full render. Entries themselves are in the sitemap. Disallow: /news? Disallow: /events? Disallow: /engage? Disallow: /blog?