Known Bots

xF2 Add-on Known Bots 6.0.3

No permission to download
Current list of bots detected by this addon (original XF2 definitions in italics):
  • adbeat
  • ahrefsbot
  • aiohttp
  • archive.org_bot
  • apache-httpclient
  • applebot
  • baiduspider
  • bingbot
  • bingpreview
  • binglocalsearch
  • brokenlinkcheck
  • companybook-crawler
  • contacts-crawler
  • crawler4j
  • cukbot
  • dalvik
  • dataprovider
  • dispatch
  • domainappender
  • facebookexternalhit
  • garlikcrawler
  • go-http-client
  • googlebot
  • ia_archiver
  • indeedbot
  • knowknot
  • linguee
  • linkdexbot
  • linkpadbot
  • ltx71
  • magpie-crawler
  • mail.ru
  • mediapartners-google
  • megaindex
  • mfibot
  • microsoft office protocol discovery
  • mixrankbot
  • mj12bot
  • msnbot
  • nlnz_iaharvester
  • outclicksbot
  • panscient
  • pcore-http
  • php
  • proximic
  • python-requests
  • quick-crawler
  • scoutjet
  • scrapy
  • semrushbot
  • seokicks-robot
  • sitesucker
  • smtbot
  • sogou web spider
  • spbot
  • sqlmap
  • statuscake/virusscanner
  • symfony2 browserkit
  • vegi bot
  • wonderbot
  • wotbox
  • xenu link sleuth
  • yahoo! slurp
  • yandex