# *.nike.com robots.txt -- just crawl it. User-agent: * Allow: / Disallow: /nikegolf/global/ Disallow: /nikegolf/en_US/ Disallow: /nikegolf/en_CA/ Disallow: /nikegolf/en_EU/ Disallow: /nikegolf/ko_KR/ Disallow: /nikegolf/zh_TW/ Disallow: /nikegolf/zh_CN/ Disallow: /nikegolf/mobile/ Crawl-delay: 20