# Block Amazonbot User-agent: Amazonbot Disallow: / # http://ahrefs.com/robot/ User-agent: AhrefsBot Disallow: / # http://webmeup-crawler.com/ User-agent: BLEXBot Disallow: / # http://www.opensiteexplorer.org/dotbot User-agent: DotBot Disallow: / # http://jooble.org/jooble-bot User-agent: Jooblebot Disallow: / # http://megaindex.com/crawler User-agent: MegaIndex.ru Disallow: / # http://mj12bot.com/ User-agent: MJ12bot Disallow: / # http://seekport.com/ User-agent: Seekport Crawler Disallow: / # http://www.semrush.com/bot.html User-agent: SemrushBot Disallow: / # https://www.seokicks.de/robot.html User-agent: SEOkicks Disallow: / # https://platform.openai.com/docs/bots User-agent: GPTBot Disallow: / # https://commoncrawl.org/faq User-agent: CCBot Disallow: / # Bytespider by ByteDance (TikTok) User-agent: Bytespider Disallow: /