# /robots.txt for http://dealnews.com/ User-agent: * Crawl-delay: 2 Sitemap: https://www.dealnews.com/sitemap_index.xml Sitemap: https://www.dealnews.com/sitemap-articles-01.xml.gz Sitemap: https://www.dealnews.com/sitemap-black-friday-01.xml.gz Sitemap: https://www.dealnews.com/sitemap-brands-01.xml.gz Sitemap: https://www.dealnews.com/sitemap-categories-01.xml.gz Sitemap: https://www.dealnews.com/sitemap-facets-01.xml.gz Sitemap: https://www.dealnews.com/sitemap-other-01.xml.gz Sitemap: https://www.dealnews.com/sitemap_news-features-01.xml.gz Disallow: /dead-end/