xF2 Add-on Known Bots 6.0.3

[ENXF NET]

ENXF NET updated Known Bots with a new update entry:

v3.15.0 weekly bot updates

• new Dinobot Android TV false positives:
  • dinobot 4k plus
• weekly new bots:
  • cis455crawler
  • crystalsemanticsbot
  • discoverspider
  • envolk[its]spider
  • geograph linkcheck bot
  • gg peekbot
  • iccrawler
  • mybot
  • psbot
  • suggybot
  • testbot

Read the rest of this update entry...

 

[ENXF NET]

ENXF NET updated Known Bots with a new update entry:

v3.17.0 weekly bot updates

new false positives:

• cubot r11
• spider v7 build/lmy47i
• spider v7 (MyCell Spider v7 from Bangladesh)

weekly bot updates:

• adbot/1.0
• ahrefssiteaudit
• amazonadbot
• amg-bot
• ampxfbot
• anybot
• aranea web-crawled corpora project
• backlinkcrawler
• botelaire
• chirpyhubbot
• cookiebot
• crawl/1.0
• dataforseobot
• diffeobot
• digitalshadowsbot
• discoverbot
• dmasslinksafetybot
• domcopbot
• echocrawl
• emeraldshield.com webbot...

Read the rest of this update entry...

 

[ENXF NET]

ENXF NET updated Known Bots with a new update entry:

v3.18.0 lots of new bots

new false positives:

• cubot; j5
• baiduboxapp

new bots:

• 200pleasebot
• a8bot
• abilogicbot
• acoonbot
• adform robot
• arhpostbot
• atomseobot
• awariorendererbot
• badoobot
• bl.uk_ldfc_bot
• brobot
• charityengine bot
• charlotte
• cosmos
• coveobot
• crawlbot/1.0.0
• cxensebot
• facebot
• fandomopengraphbot
• freshpingbot
• fuelbot
• geedobot
• getlocalbot
• google-safety
• gpcsupbot
• grub-client
• gynxbot
• healrworld crawler...

Read the rest of this update entry...

 

[ENXF NET]

ENXF NET updated Known Bots with a new update entry:

v3.19.0 new bots

new false positives:

• spider v9 phone

new bots:

• 80legs.com: 80legs Crawler
• adssellerscrawler: Ads Sellers Crawler
• apesearch crawler: ApeSearch Crawler
• aportcatalogrobot: AportCatalogRobot
• bot dns-cache.fr...

Read the rest of this update entry...

 

[ENXF NET]

ENXF NET updated Known Bots with a new update entry:

v3.20.0 June 2021 new bots

new bots discovered in June 2021

• btbot: BT Bot
• catchbot: Catchbot
• comodospider: Comodo SSL Spider
• deepnoc: deepnoc bot (network optimized crawling)
• dispenserbot: Dispenser Dab Solver Checklinks Bot
• epicbot...

Read the rest of this update entry...

 

[ENXF NET]

ENXF NET updated Known Bots with a new update entry:

Complete re-write

KnownBots v4 is a completely new build - bots are no longer hard coded, but updated via API calls and uses the XF code cache to store bot data

• raw bot data downloaded from API is stored in internal_data/knownbots.json
• new CLI tool for manually fetching bots from API (Cron task is also provided)
• new CLI tool for manually loading bots from knownbots.json
• new CLI tool for testing user agent matches

Read the rest of this update entry...

 

[ENXF NET]

ENXF NET updated Known Bots with a new update entry:

v4.0.1 - broken API mitigation

This release includes additional sanity checks to prevent bad data returned from the API from breaking the forums.

If any of the data returned by the API is not in the exact format we expect, the entire download is discarded and no changes applied to the forum. An error message will be logged prompting further investigation.

After upgrading to 4.0.1, you should manually force a fetch of new API data by executing the following command from your forum root:

php cmd.php...

Read the rest of this update entry...

 

[ENXF NET]

ENXF NET updated Known Bots with a new update entry:

v5.0.0 major rewrite

v5.0.0 is a major rewrite of the core functionality of this addon aimed at improving processing speed, bot detection sophistication and greatly enhancing our ability to identify new bots.

Note that the options have changed - so please check the options after upgrading. More information about each option is provided on the main addon page.

• major rewrite - no longer use "bot|spider|crawl" search strings and false-positive lists to identify possible bots, rely instead on search...

Read the rest of this update entry...

 

[sfan]

Requesting 6.0.1 please.

 

[ENXF NET]

ENXF NET updated Known Bots with a new update entry:

v6 major rewrite

v6 is another major rewrite of the core functionality of the addon, aimed at improving the submission process for newly detected useragents and performance improvements.

Important for v4 users: with this release, I am deprecating the v1 API - addon versions v4.x and earlier will continue to function for a while but will then start returning 404 error codes once I turn off the v1 API. Anyone still running KnownBots v4.x should upgrade as soon...

Read the rest of this update entry...

 

[ENXF NET]

ENXF NET updated Known Bots with a new update entry:

6.0.3 bugfix - handle malformed UTF-8 in user agent strings

This update contains an important bugfix to handle malformed UTF-8 in user agent strings.

This update will simply ignore any user agents with malformed UTF-8, avoiding errors when trying to send updates via the API. These user agents are invalid and so there is no point undertaking any further analysis - thus they are silently discarded.

This new version also contains an additional CLI tool for importing user agents from a text file, for testing purposes.

Read the rest of this update entry...