# pahuchi.ua # # Listings, product pages, the category × brand landings and the company pages # are open to every crawler. Kept out: the cart, the checkout, the cabinet, the # search page, the order's own page whose address is its secret (all five in # Ukrainian and under /ru/), the sign-in endpoints and the JSON endpoints behind # the widgets, # plus every filtered or sorted listing (they are noindex anyway): the filters # are path segments (/category/zhinochi/verchni_noti=ambretta/), the sort order # a query string. The plain pagination of a listing (/page=2/) and the landing # of one brand (/made_by=creed/) stay open, so a crawler reads what each landing # names canonical or that it is noindex; two brands or more do not. # # The old site's AJAX endpoints (/action/comment/data/470/, /errlog/create/) # have no page here and are kept out too, so Google stops asking for them. # Those of its listings (/action/brand/creed/data/) stay open: each leads to # the listing itself, and Google has to read that to let the old address go. # /cdn-cgi/ is Cloudflare's own. # # The product photos and the product pages stay open with a query string too: # the feed links each photo with ?v= and Google Merchant Center may add its # utm_ parameters to a product's link; Googlebot and Googlebot-Image must # reach both, or the products leave Google. The longer Allow outweighs the # shorter "Disallow: /*?" (Google takes the most specific rule). # # Stage and preview copies of the shop are closed by a "X-Robots-Tag: noindex" # header on every response instead, as Google recommends for a site that must # not be indexed. User-agent: * Allow: /storage/ Allow: /product/ Allow: /ru/product/ Disallow: /cart Disallow: /checkout Disallow: /cabinet Disallow: /auth/ Disallow: /orders/ Disallow: /comments/ Disallow: /search Disallow: /order/ Disallow: /action/ Disallow: /ru/action/ Allow: /action/brand/ Allow: /action/category/ Allow: /ru/action/brand/ Allow: /ru/action/category/ Disallow: /errlog/ Disallow: /cdn-cgi/ Disallow: /ru/cart Disallow: /ru/checkout Disallow: /ru/cabinet Disallow: /ru/search Disallow: /ru/order/ Disallow: /product/*/comments Disallow: /up$ Disallow: /*? Disallow: /*/made_by=*, Disallow: /*/osoblyvi= Disallow: /*/price= Disallow: /*/bazovi_noti= Disallow: /*/verchni_noti= Disallow: /*/virobnik= Disallow: /*/nota= Disallow: /*/noti_sertsya= Disallow: /*/ob_yem= Disallow: /*/parfumer= Disallow: /*/povnotsinniy_flakon= Disallow: /*/rik= Disallow: /*/simeystvo= Disallow: /*/stat= Sitemap: https://pahuchi.ua/sitemap_index.xml