User-agent: * Disallow: /nobots/ Disallow: /products/features/ Disallow: /product/features/ Disallow: /product/reviews/ Disallow: /webservices/ajax/ User-agent: yahoo-mmcrawler Disallow: /m/ User-agent: MJ12bot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: Bingbot Crawl-delay: 10 Disallow: /nobots/ Disallow: /products/features/ Disallow: /product/features/ Disallow: /product/reviews/ Disallow: /webservices/ajax/ User-agent: dotbot Crawl-delay: 1 User-agent: Goodzer Crawl-delay: 1 User-agent: rogerbot Crawl-delay: 5 User-agent: Baiduspider Disallow: / User-agent: YandexBot Disallow: / User-agent: YandexImages Disallow: / User-agent: Linguee Bot Disallow: / User-agent: Seekport Crawler Disallow: / User-agent: GrapeshotCrawler Crawl-Delay: 1 User-agent: istellabot Disallow: / User-agent: SeznamBot Disallow: / Sitemap: https://www.tiptopbikeshop.com/sitemap.xml