User-agent: * Disallow: /sitecore* Disallow: /Search-Result?searchdata=* Disallow: /*.zip$ Disallow: /*.dat$ Disallow: */link.aspx? Disallow: /-/media/fisglobal/files/campaigns/global-payments-report/*