[DEV] Forum Assassin (Spam Filter)

A place for MOD Authors to post and receive feedback on MODs still in development. No MODs within this forum should be used within a live environment! No new topics are allowed in this forum.
Forum rules
READ: phpBB.com Board-Wide Rules and Regulations

IMPORTANT: MOD Development Forum rules

On February 1, 2009 this forum will be set to read only as part of retiring of phpBB2.
Post Reply
WulfX
Registered User
Posts: 6
Joined: Sat Dec 09, 2006 1:33 am

[DEV] Forum Assassin (Spam Filter)

Post by WulfX »

Currently working on a spam filter based on the popular e-mail filtering software SpamAssassin... an open-source add-on for Apache.

Current Features:
  • + Pattern matching from SpamAssassin in SQL form.
  • + Removal of posts from topic view that exceed spam score
  • + Code for reduction of spam score for users with high post count (longstanding members of the community with 5,000+ posts aren't likely to be spammers
  • + Admins view topic with questionable post shown in RED.
Features in Development:
  • + Configurable spam values in ACP (SQL already supports this)
  • + Unflag posts marked as spam when instructed otherwise
  • + Add/subtract to spam value when posts are flagged/unflagged as spam, allowing it to learn with the forum (Bayesian Filtering).
I'm going to need some help with this project, especially setting up the ACP interface, since I'm not too familiar with that. I've done a lot of searching, and there appears to be no mod already like this. This is beyond a simple spam word list. I'm sure users at my forum say Viagra without it being spam. It depends on context, which this program hopes to analyze.

Development Boards: http://spam.wulfslair.com/

Also would like help with some patterns, since I'm not that great with them. New trend in spam is to double some letters to avoid it matching patterns... like "haarddcore".

Comments very welcome. :D
User avatar
igorw
Former Team Member
Posts: 8024
Joined: Fri Dec 16, 2005 12:23 pm
Location: {postrow.POSTER_FROM}
Name: Igor Wiedler

Post by igorw »

Looks very nice! What is always great for anti spam MODs, is some sort of "moderation queue" for spam posts... :)
Igor Wiedler | area51 | GitHub | trashbin | Formerly known as evil less than three
WulfX
Registered User
Posts: 6
Joined: Sat Dec 09, 2006 1:33 am

Post by WulfX »

Pre-release DEV now available at:
http://spam.wulfslair.com/forum-assassin_0.5.0-dev.mod

The code works. If I screwed up and omitted something from my mod file, please let me know. Or if I happen to have an error in my SQL Syntax. I'm not sure whether this will work with EM... it SHOULD. Then again, this is my first time using the EM Template.

I'd need some help getting an ACP interface into play. And of course, if you can clean up my code a tad, that'd be great. It works, but it's not necessarily elegant. Template support is not included in this version -- everything is hard coded in.

Future Plans:
Plan to release the Alpha version in the near future as soon as all the main features (flagging and unflagging of posts, admin alerts) are in place and functioning.

Development/Testing board:
http://spam.wulfslair.com/
galoscho
Registered User
Posts: 1
Joined: Tue Dec 19, 2006 3:21 pm

Cool Idea

Post by galoscho »

I've not found a word based spam filter yet (do you know any?), therefore I really appreciate your work.
I'm currently studying computer science. Mostly I've been playing around with C++ and not too much with PHP.
Anyway I will download the source code and have a look at it...

Greets,
Hannes
User avatar
Vampy
Registered User
Posts: 140
Joined: Mon May 12, 2003 4:25 pm

Post by Vampy »

Hi! I read with great interest about the mod you are making. I was wondering how does the spam SQL get updated? Via Spam Assassin? The way I understand it so far is that when you first install the mod, you add in the spam data into the SQL table. But as we know spam words get updated every now and then, so how does the mod update its spam table?

Also, I was wondering how far down is the mod since you last posted? Thank you.
Julian
Post Reply

Return to “[2.0.x] MODs in Development”