• 0

[IPB] Biggest Bot List Ever v5.0.1 Released!


Question

After neglecting the bot lists for over a year, I have taken it upon myself to rebuild the lists from scratch. This has led to the creation of 5.0.0. Many new bots have been added, with some removed as well. Also, a new technique for IDing bots has been implemented allowing one ID on the list to catch dozens or more bots IDs from the same site.

I've created a new site dedicated for all this bot-goodness which can be found at IPBots.info!

On the site you will find current download links, changelogs, and everything you need!

I've only had time to finish the Biggest Bot List, but others will be coming soon!

If you really do love my work, please consider making a small (or large!) donation with the link on the homepage.

>> Get what you need now at IPBots.info <<

Edited by Fred Derf

Recommended Posts

  • 0

Bot/Spider List 4.0.0 Released! Whats new?

  • 5 New bot lists.
  • 150 Dead bots removed.
  • 18 Bot entries beginning with "Mozilla" have been removed due to issues with the list logging members as bots.
  • 27 Updated bots (mostly campitilaztion errors.)
  • Changed list name.

The removal of (exactly) 150 dead bots should speed up the board - although you probably won't notice it.

All lists are now avaliable in .docx format.

It's quite an amazing format! Reduced the size of the .doc Bot List from 92KB to 25KB. It's even smaller than the .rtf format sitting at 46KB.

Enjoy! :D

  • 0
if i add the Spider List is this will archive my site in the search engines ?

No.

Any updates coming?

Yes. (see below)

Hey cooldude.

I was wondering if I could post a link to this guide in my Complete IPB Guide topic?

Thanks,

SadJoker

Sure, but please give credit.

Is this still alive?

Yes!

I've just started work on version 5.0.0. Going to add a BUNCH of new bots, remove dead ones, make a "Most Common" list for those who don't want all the extra tracking, and make the document prettier!

  • 0

Thanks Fred!

This is my first time posting this here at IPSBeyond, but many of you probably know about this from other sites like Invisionize or the official IPS forums.

After neglecting the bot lists for over a year, I have taken it upon myself to rebuild the lists from scratch. This has led to the creation of 5.0.0. Many new bots have been added, with some removed as well. Also, a new technique for IDing bots has been implemented allowing one ID on the list to catch dozens or more bots IDs from the same site.

I've created a new site dedicated for all this bot-goodness which can be found at IPBots.info!

On the site you will find current download links, changelogs, and everything you need!

I've only had time to finish the Biggest Bot List, but others will be coming soon!

If you really do love my work, please consider making a small (or large!) donation with the link on the homepage.

>> Get what you need now at IPBots.info << :thumbs:

  • 0

Before you use this list, I strongly recommend you run the following command on your IPB install:

TRUNCATE TABLE `ibf_spider_logs`

This will empty your bot logs and will remove old logs and remove some empty tables you will likely have as a result of many bot entries being removed.

Within 10 seconds of me running this command, my board was already logging 25+ new spider hits.

Again - this is highly recommended!

  • 0

I've drafted up a list of popular bots that seem to visit often and search engines that people use often.

Get it at http://ipbots.info/download.htm - only .doc and .docx are available atm.

Please let me know here if you feel anything should be added or taken off. The list will be final later this week if no one has anything to say.

  • 0

Biggest Bot List 5.0.3 has been released!

  • Changes:
  • 9 New bots have been added

Simply download the list from ipbots.info and grab the changes off the first page if you are already using 5.0.2!

Core Bot List 1.0.1 has been released!

  • Changes:
  • Fixed typo in Gsa-Crawler entry. (Thanks NetPanther!)

Simply download the list from ipbots.info and grab the changes off the first page if you are already using 1.0.0!

(Can a mod please change the 5.0.1 in the title to 5.0.3?)

  • 0

5.0.4 has been released. The only difference is the Ack entry has been removed due to it causing legitimate guests to be treated as bots if they had the ImageShack toolbar installed.

Get it at ipbots.info

  • 0

Biggest Bot List 5.0.5 has been released!

  • Changes:
  • Fixed Accoona typo (thanks Axel Wers!)
  • Removed duplicate entry of eBot (thanks Axel Wers!)
  • 4 New bots (thanks to GreasyTech for 2 contributions!)

Simply download the list from ipbots.info and grab the new list!

(You are invited to say "thanks!" if you like this!)

This topic is now closed to further replies.
  • Recently Browsing   0 members

    • No registered users viewing this page.
  • Posts

    • Why? Does anybody actually want this? The constant need to close all browser sessions and wait for a new version to install, just so that there’s a integrated coupon manager feels like a waste of everyone’s time
    • I remember when Louis used to just do interesting Mac/iPhone repairs, now he's boring and just launches "crusades" every week
    • A shame it don't allow people to bypass the MS account, I will stick to using Rufus.
    • Microsoft about to radically change how often your Edge browser updates by Paul Hill Microsoft has just announced that starting with Edge 152, it will be moving to a two-week release cycle for faster, smaller updates. This faster release cadence will begin on August 27. This change comes just several months after Microsoft switched Visual Studio Code to weekly updates. The company said that the Extended Stable releases will remain on an eight-week cycle and that no admin changes are needed to experience the faster release cycle on the Stable channel. The new two-week release cycle will enable the faster delivery of security updates and platform improvements, all while reducing the size and complexity of individual updates. Microsoft claims that organizations will benefit from this change as it offers predictable validation cycles. For organizations that prefer a “more deliberate pace”, the Extended Stable channel remains an option. This change will affect Edge Stable releases on Windows, macOS, Linux, and mobile. The Extended Stable channel will continue to be updated every eight weeks, or every fourth Stable release, for example: versions 152, 156, 160, and 164. The Extended Stable could be a good option for organizations that don’t want the latest updates twice a month and don’t want as much hassle constantly updating browsers. In the case of Visual Studio Code, many of the updates being pushed by Microsoft are AI-related. As we all know, Microsoft Edge has a lot of AI features, so we could see Microsoft pushing more AI, thanks to the faster cycles. On the flip side, quicker releases could mean faster security updates, which is beneficial in a world where AI systems are hunting for software exploits. What do you think? Let us know in the comments. For more updates on Edge, be sure to follow Neowin's coverage. In May alone, we reported on Edge offering in-browser pop-ups to assist users with website compatibility issues, that Edge was losing Copilot Mode, and that Microsoft had fixed a plain-text password bug in Edge. Source: Microsoft 365 Admin Center
    • not yet, because at the moment it is not a threat to MS, if and I mean if it did become a threat to MS Office, then it may be a different thing. MS don't like competition
  • Recent Achievements

    • Week One Done
      davidbazooked earned a badge
      Week One Done
    • One Month Later
      Jamswaz earned a badge
      One Month Later
    • Week One Done
      Jamswaz earned a badge
      Week One Done
    • Rookie
      Marzoid went up a rank
      Rookie
    • Community Regular
      coch went up a rank
      Community Regular
  • Popular Contributors

    1. 1
      +primortal
      514
    2. 2
      PsYcHoKiLLa
      185
    3. 3
      +Edouard
      159
    4. 4
      Steven P.
      83
    5. 5
      ATLien_0
      75
  • Tell a friend

    Love Neowin? Tell a friend!