Known Bots

xF2 Add-on Known Bots 6.0.3

No permission to download
weekly new bots:
  • antbot/1.0
  • becomebot
  • castlebot
  • custom-crawler
  • feedsearch bot
  • gulper web bot
  • istellabot
  • lmspider
  • marketingminer bot
  • my nutch spider
  • networking4all bot
  • nfwebcrawler
  • tombapublicwebcrawler
  • uptimebot
  • vuhuvbot
  • webcrawl.net
  • webspider 1.0
new Cubot phone false positives:
  • cubot a5
  • cubot j3 pro
weekly new bots:
  • addsugarspiderbot
  • annuairefrancais.fr
  • coibotparser
  • criteobot
  • discobot
  • domainspider-bot
  • dropboxpreviewbot
  • dumbot
  • gnowitnewsbot
  • hoaxybot
  • ichiro
  • lamarkbot
  • media-bot
  • nusearch spider
  • radian6_default_
  • xovionpagecrawler
  • zyborg
weekly new bots:
  • experiancrawluk
  • impact radius compliance bot
  • kauaibot
  • leuchtfeuer crawler
  • redirectbot
  • simpleanalyticsbot
  • skimbot
  • sogou pic spider
  • testcrawler
  • Like
Reactions: bouix
weekly new bots:
  • girafabot
  • googebot malware scanning
  • i-market-bot
  • intelx.io_bot
  • ninjabot
  • pywebcopybot
  • serpstatbot
  • supremesearch.net
  • todoexpertosbot
  • webmoney megastock robot
  • wordchampbot
  • xaldon webspider
  • yesslebot
weekly new bots:
  • aasa-bot
  • amazon-advertising-ad-standards-bot
  • crawler/0.0.1
  • danibot
  • dragonbot
  • irlbot
  • jooblebot
  • ldspider
  • linkisbot
  • mohawk-crawler
  • newsgator
  • ottobot
  • pigafetta
  • pingdom.com_bot
  • planckspider
  • rss bot
  • speedy spider
  • summalybot
  • virusdie crawler
weekly new bots:
  • earwigbot
  • fess
  • metadata-downloader-bot
  • page audit bot
  • plurkbot
  • r6_commentreader
  • r6_feedfetcher
  • sc_bot
  • tkbot
  • willie irc bot
weekly new bots:
  • ag_dm_spider
  • aihitbot
  • avocetcrawler
  • b2b bot
  • checkbot
  • em-crawler
  • feedsearch-crawler
  • fullstorybot
  • krzana-rss-bot
  • mediacloud bot for open academic research
  • mlbot
  • niuebot
  • ocarinabot
  • prft-bot
  • qwantbot
  • rasabot
  • riverbot
  • rytebot
  • sabsimbot
  • scribbr-citation-bot
  • seodiver
  • snapbot
  • solomonobot
  • temeliobot-keyword-scrapper
  • vsusearchspider
  • your-search-bot
  • new Cubot phone false positives:
    • cubot dinosaur
  • new GLX phone false positives:
    • GLX Spideri
  • weekly new bots:
    • ant.com beta
    • bha2r_bot
    • browserspybot
    • c-t bot
    • cms crawler
    • ioncrawl
    • js-crawler
    • k7mlwcbot
    • quora-bot
    • qwarrycrawler
    • sidetrade indexer bot
    • webzip
  • new Cubot phone false positives:
    • cubot cheetah 2
  • weekly new bots:
    • better uptime bot
    • btcrawler
    • crawler_eb_germany_2.0
    • dle_spider.exe
    • dyno mapper crawler
    • flockbrain robot
    • infoobot
    • microadbot
    • nesotebot
    • reachabilitycheckbot
    • se ranking gentle bot
    • seobilitybot
    • siteguru linkchecker
    • statonlinerubot
    • tombot
    • viulinkcrawler
    • webgains-bot'
    • _zbot
  • Like
Reactions: isidro77
  • new Cubot phone false positives:
    • cubot magic
    • cubot_manito
    • cubot_power
  • simplify seokicks-robot match to just seokicks to catch new bot user agent
  • weekly new bots:
    • applenewsbot
    • bl.uk_lddc_bot
    • dcrawl
    • dy robot
    • ezlynx
    • fast-webcrawler
    • gdark-spider
    • gethpinfo.com-bot
    • gowikibot
    • image size by siteimprove.com
    • linkcheck by siteimprove.com
    • loaderio;verification-bot
    • pingdompagespeed
    • pmoz.info odp link checker
    • refindbot
    • seebot.org
    • siteanalyzerbot
    • sitecheck-sitecrawl
    • sottopop
    • superbot
    • tineye-bot
    • webliobot
Top