Badly Behaved Spiders / Bots / Automated Scripts

Status
Not open for further replies.

mneylon

Administrator
Staff member
Over the last few weeks a couple of servers running forums and other dynamic content have been getting slammed by some form of spider or bot. It's really annoying!

Has anyone else seen anything similar?
 

grandad

Member
As a matter of interest, did this start around the 10th August?

I run a couple of small forums on Enniskerry - Gateway to the Garden of Ireland and Jack and Jill Childrens Foundation using SMF [I switched from phpBB because of hacking attempts].

Since the 10th I have been plagued with attempted postings for porn sites, dubious medical sites and the like. Most of the postings are coming from Russia [boom.ru, bk.ru, list.ru etc etc] and Egypt [gawab.com]. Every morning there is a new clutch of non-authenticated 'new members' which have to be cleared out and a new series of bans inserted.
 

mneylon

Administrator
Staff member
They're not actually posting anything.. I keep seeing them in logs.. On my own blog I'm using a script to block bad requests, so they just create a lot of log traffic, but they have caused slightly more serious issues on a couple of other sites by opening up so many requests to the forum at once that the default MySQL settings are no longer enough ...
 

grandad

Member
But would I be right in saying that this all started around the 10th?

Life was peaceful up to then. Now it's a pain in the *ss. Thay rarely do any damage as I have so many filters in place - it's just the extra time involved.

Personally I would happily castrate the lot of them with a rusty [blunt] pair of garden shears :cool:
 

mneylon

Administrator
Staff member
I wonder would it be possible to mod the Bad Behaviour script for use on forums to stop bad requests?

I think I'll be contacting a few guys about that :)

Even if you do use it though you still have to process the requests. Tying it in with iptables would be a better solution
 

frakilk

New Member
I use phpbb and I have been having a ton of list.ru registrations. I installed a little script that rejects any user trying to supply a website address during registration. Human visitors don't have the option to enter this when signing up. So if it is trying to be entered it is definitely a bot. I have not seen as many spam registrations since.
 

louie

New Member
alright - I thought is something you designed because I was looking into that myself. That mod only works on phpbb websites.

Thanks man
 

louie

New Member
that's actually a nice script.
Had a look at it. need to get it working with a database.
Thanks man
 

mneylon

Administrator
Staff member
You sound almost surprised :)

It's pretty effective against a lot of the junk that might hit a blog or other php/mysql site, but I still need another layer on top of it
 
Status
Not open for further replies.
Top