# Crawlers Setup User-agent: * # Directories Disallow: /app/ Disallow: /bin/ Disallow: /dev/ Disallow: /lib/ Disallow: /phpserver/ Disallow: /pkginfo/ Disallow: /report/ Disallow: /setup/ Disallow: /update/ Disallow: /var/ Disallow: /vendor/ # Paths (clean URLs) Disallow: */checkout Disallow: */review/ Disallow: */catalogsearch/ Disallow: */search Disallow: */customer/account/ Allow: */customer/account/forgotpassword/ Disallow: */customer/account/login/referer/ Allow: */customer/account/create/ Allow: */customer/account/login/ Disallow: */catalog/product_compare/ Disallow: */catalog/category/view/ Disallow: */catalog/product/view/ Disallow: */sendfriend/ # Parameters (Blocking all parameters until better fix later) Disallow: */*?*= #Pages blocked before upgrade Allow: */signup-banner Disallow: */media/upfiles/instructions/*pdf$ Disallow: */blog/tag/ Disallow: */regulations-family-giveaway Disallow: */jysk-friends-and-family-giveaway Disallow: */12-days-of-christmas-giveaway-facebook Disallow: */signup-facebook Disallow: */signup Disallow: */email-correction # Website Sitemap Sitemap: https://www.jysk.ca/media/sitemap.xml Sitemap: https://www.jysk.ca/media/sitemap_fr.xml