weekly new bots:
- antbot/1.0
- becomebot
- castlebot
- custom-crawler
- feedsearch bot
- gulper web bot
- istellabot
- lmspider
- marketingminer bot
- my nutch spider
- networking4all bot
- nfwebcrawler
- tombapublicwebcrawler
- uptimebot
- vuhuvbot
- webcrawl.net
- webspider 1.0
new Cubot phone false positives:
weekly new bots:
- cubot a5
- cubot j3 pro
- addsugarspiderbot
- annuairefrancais.fr
- coibotparser
- criteobot
- discobot
- domainspider-bot
- dropboxpreviewbot
- dumbot
- gnowitnewsbot
- hoaxybot
- ichiro
- lamarkbot
- media-bot
- nusearch spider
- radian6_default_
- xovionpagecrawler
- zyborg
weekly new bots:
- experiancrawluk
- impact radius compliance bot
- kauaibot
- leuchtfeuer crawler
- redirectbot
- simpleanalyticsbot
- skimbot
- sogou pic spider
- testcrawler
weekly new bots:
- girafabot
- googebot malware scanning
- i-market-bot
- intelx.io_bot
- ninjabot
- pywebcopybot
- serpstatbot
- supremesearch.net
- todoexpertosbot
- webmoney megastock robot
- wordchampbot
- xaldon webspider
- yesslebot
weekly new bots:
- aasa-bot
- amazon-advertising-ad-standards-bot
- crawler/0.0.1
- danibot
- dragonbot
- irlbot
- jooblebot
- ldspider
- linkisbot
- mohawk-crawler
- newsgator
- ottobot
- pigafetta
- pingdom.com_bot
- planckspider
- rss bot
- speedy spider
- summalybot
- virusdie crawler
weekly new bots:
- earwigbot
- fess
- metadata-downloader-bot
- page audit bot
- plurkbot
- r6_commentreader
- r6_feedfetcher
- sc_bot
- tkbot
- willie irc bot
weekly new bots:
- ag_dm_spider
- aihitbot
- avocetcrawler
- b2b bot
- checkbot
- em-crawler
- feedsearch-crawler
- fullstorybot
- krzana-rss-bot
- mediacloud bot for open academic research
- mlbot
- niuebot
- ocarinabot
- prft-bot
- qwantbot
- rasabot
- riverbot
- rytebot
- sabsimbot
- scribbr-citation-bot
- seodiver
- snapbot
- solomonobot
- temeliobot-keyword-scrapper
- vsusearchspider
- your-search-bot
- new Cubot phone false positives:
- cubot dinosaur
- new GLX phone false positives:
- GLX Spideri
- weekly new bots:
- ant.com beta
- bha2r_bot
- browserspybot
- c-t bot
- cms crawler
- ioncrawl
- js-crawler
- k7mlwcbot
- quora-bot
- qwarrycrawler
- sidetrade indexer bot
- webzip
- new Cubot phone false positives:
- cubot cheetah 2
- weekly new bots:
- better uptime bot
- btcrawler
- crawler_eb_germany_2.0
- dle_spider.exe
- dyno mapper crawler
- flockbrain robot
- infoobot
- microadbot
- nesotebot
- reachabilitycheckbot
- se ranking gentle bot
- seobilitybot
- siteguru linkchecker
- statonlinerubot
- tombot
- viulinkcrawler
- webgains-bot'
- _zbot
- new Cubot phone false positives:
- cubot magic
- cubot_manito
- cubot_power
- simplify seokicks-robot match to just seokicks to catch new bot user agent
- weekly new bots:
- applenewsbot
- bl.uk_lddc_bot
- dcrawl
- dy robot
- ezlynx
- fast-webcrawler
- gdark-spider
- gethpinfo.com-bot
- gowikibot
- image size by siteimprove.com
- linkcheck by siteimprove.com
- loaderio;verification-bot
- pingdompagespeed
- pmoz.info odp link checker
- refindbot
- seebot.org
- siteanalyzerbot
- sitecheck-sitecrawl
- sottopop
- superbot
- tineye-bot
- webliobot