User-agent: *
Disallow: */additional-offers*
Disallow: /myaccount
Disallow: /twlogin
Disallow: /events/
Disallow: /events/org/
Disallow: /checkout/
Noindex: /?q=*
Noindex: /checkout/
Noindex: /events/
Noindex: /events/org/
Noindex: /twlogin
 
## Throttle Bing Crawler
User-agent: msnbot
Crawl-delay: 2
 
User-agent: AhrefsBot
Disallow: /
User-agent: SemrushBot
Disallow: /
User-agent: SemrushBot-SA
Disallow: /