CastleCops, Internet Crime Fighters
Need help? Click here to register for free! Absolutely zero advertisements on this site!

$9736.22 of $21422.68
left sidedonated so farneed $11686.46 donated to reach our goalright side, our goal
Help CastleCops serve the community on new servers, Donate Here to reach our goal.

Donation/Premium
spacer
block bottom
Security Central
spacer
· Home
· PIRT/Fried Phish
· MIRT
· SIRT
· Deutsch
· Wiki
· Newsletter
· O16/ActiveX
· CLSID List
· Contest2007
· Downloads
· Feedback (send)
· Forums
· HijackThis
· Hijacktrend
· LSPs
· My Downloads
· O18
· O20
· O21
· O22
· O23
· O9
· Premium
· Private Messages
· Proxomitron
· Reviews
· Search
· StartupList
· Stories Archive
· Submit News
· WsIRT
· Your Account
· Acceptable Use Policy
block bottom
Survey
spacer
Was 2007 a good year?

Yes it was a wonderful year
Yes, but there is always room for improvement
Status quo
It was a challenge
Other (leave comment)



Results
Polls

Votes: 952
Comments: 28
block bottom
spacer spacer

A new filter set for MWP users brought to you by Wizcrafts!
Goto page Previous  1, 2, 3, 4, 5, 6, 7, 8, 9  Next
 
Post new topic   Reply to topic       All -> FavForums -> Mailwasher - Troubleshooting / General [del.icio.us!] [digg it!] [reddit!]
View previous topic :: View next topic  
Author Message
Wizcrafts

Sergeant
Sergeant
Premium Member

Joined: Jun 05, 2003
Posts: 95
Location: Michigan
Premium

PostPosted: Wed Aug 08, 2007 3:37 am    Post subject:
Reply with quote

Today's updates to the MWP Filters were to add a rule to the "RX Spam" filter and to correct a Regular Expression error in the "Blocked Countries" filter that caused a few false positives.


_________________
Submitted by Wiz
Guarding the Castle against spammers and scammers
Back to top
View users profile Send private message Visit posters website AIM Address Yahoo Messenger
LoPhatPhuud

Security Expert
Microsoft MVP

Joined: Mar 09, 2002
Posts: 2204

MVP Phishing Squad Premium Security Experts

PostPosted: Thu Aug 09, 2007 2:11 am    Post subject:
Reply with quote

I have been using the Wizcraft filters for a few weeks now and would like to complement on them. The shorter list is more than sufficient for the mail I receive.

I have discovered an anomaly with MWP involving your filter set. If you do not have bounce enabled for any account and you trigger a filter rule that uses bounce, MWP will hang for a while, presumably waiting for a time out, and then will continue.

I more or less stumbled across the solution while I was checking the filter rules to see if I could get any ideas why MWP was hanging. I saw one of the Image Spam filters was using bounce. Invoking the swag (Scientific Wild Add Guess) priinciple of debugging, I did a search and replace on the ruleset removing bounce wherever it appeared. I ran MWP for a few days and never had the hanging issue.

For confirmation, I replaced the modified filter rules with an original set. The next morning, sure enough, MSW hung scanning the incoming mail.

Note: The MWP slowdown did not occur all the time. It tended to be during scans of email that contained the most spam.

This may be just my system (Vista Ultimate, Outlook 2007, MWP 5.3.4.44 beta) but removing the bounce statement eliminated the slowdown.


_________________
Duct tape is like the Force. It has Light side and a Dark side and it holds the world together.

Microsoft MVP/Consumer Security 2005-2008
Back to top
View users profile Send private message Visit posters website AIM Address Yahoo Messenger MSN Messenger
Wizcrafts

Sergeant
Sergeant
Premium Member

Joined: Jun 05, 2003
Posts: 95
Location: Michigan
Premium

PostPosted: Thu Aug 09, 2007 2:25 am    Post subject:
Reply with quote

LoPhatPhuud;
Thanx for the heads-up! I went through both lists and removed any lingering bounce directives. They are left overs from earlier days when spammers actually sent their own spam and should be removed. Virtually all of today's spam is sent from infected zombie computers that are in botnets.

Bouncing spam is no longer a useful tactic because almost every piece of spam you will receive has a forged "From" and "Return To" address, and the sender is a compromised personal computer that has become part of a spam botnet. The computer's owner is probably not aware that this is happening on his/her computer, until somebody like me files a report with SpamCop and his ISP is notified and they hopefully take him offline until his or her computer is disinfected. Please join Spamcop as a reporting member and forward all spam messages to them for reporting to the ISPs and web hosts involved!


_________________
Submitted by Wiz
Guarding the Castle against spammers and scammers
Back to top
View users profile Send private message Visit posters website AIM Address Yahoo Messenger
Wizcrafts

Sergeant
Sergeant
Premium Member

Joined: Jun 05, 2003
Posts: 95
Location: Michigan
Premium

PostPosted: Thu Aug 09, 2007 3:05 am    Post subject:
Reply with quote

I mentioned reporting spam to SpamCop in my last post, but I neglected to make it clear that this can be done directly from MailWasher Pro. After you join SpamCop you will receive a password and personal code by email, to use when reporting spam. You will input these credentials into the (MWP) configuration utility by clicking on "Spam Tools" then "SpamCop" where you should check the checkbox to enable SpamCop reporting, then copy and paste your personal encoded SpamCop email address into the (SpamCop) "Email" field.

Set a valid SMTP (outgoing) email server in the SMTP field (as supplied by your ISP or use one on your website), click OK, and OK again and you will be ready to report spam. When a message is flagged as spam a new field will appear under the label SpamCop. You can add a checkmark to spam messages and they will be forwarded directly to SpamCop. In a little while SpamCop will send you a confirmation request link to click on, where you will see the content of the spam headers and tracking details. You yourself must finish the reporting process by scrolling down and clicking the "Send Spam Report Now" button.

That ends tonight's special lesson.


_________________
Submitted by Wiz
Guarding the Castle against spammers and scammers
Back to top
View users profile Send private message Visit posters website AIM Address Yahoo Messenger
JEfromCanada

Guest
IP: 24.57.*.*






PostPosted: Thu Aug 09, 2007 4:46 pm    Post subject: Sorry to be lazy...
Reply with quote

I apologize for not taking the time to read through five pages of past posts on this thread.

For the past couple of months, Mailwasher doesn't appear to be doing nearly as good a job as it used to. This dates back to before the time when people started sending PDF attachments.

Anyway, I was wondering whether the Wiz filters should help weed out some of the current crud.

Can you please supply a download link for the Wiz filter.

Thank you very much

Back to top
JEfromCanada

Trooper
Trooper


Joined: Mar 25, 2004
Posts: 19
Location: Canada

PostPosted: Thu Aug 09, 2007 5:23 pm    Post subject: Re: my previous post
Reply with quote

Sorry it appeared to be anonymous. I hadn't logged in!

Back to top
View users profile Send private message
Wizcrafts

Sergeant
Sergeant
Premium Member

Joined: Jun 05, 2003
Posts: 95
Location: Michigan
Premium

PostPosted: Thu Aug 09, 2007 5:44 pm    Post subject: Re: Sorry to be lazy...
Reply with quote

JEfromCanada wrote:
I apologize for not taking the time to read through five pages of past posts on this thread.

Can you please supply a download link for the Wiz filter.

Thank you very much

JE;
My filters are available on and from this page (copy/paste or save as): www.wizcrafts.net/mwp-filters.html

My current filters (filters2.txt) are very efficient for current types of spam, while the larger filters.txt includes rules going back 5 years or longer. Some of those rules will catch spam that my current rules may miss, but I have yet to see that happen. Filter rules slow the processing time when downloading email and the larger the list, and the more Regular Expressions I use, the longer it takes to examine the incoming email. I update the rules in the smaller file almost every day, responding to variations in the incoming spam.

Let me know if my filters help your spam problem (reply here), or if they cause processing problems for you (and tell us how many accounts are being checked).


_________________
Submitted by Wiz
Guarding the Castle against spammers and scammers
Back to top
View users profile Send private message Visit posters website AIM Address Yahoo Messenger
Wizcrafts

Sergeant
Sergeant
Premium Member

Joined: Jun 05, 2003
Posts: 95
Location: Michigan
Premium

PostPosted: Fri Aug 10, 2007 9:16 pm    Post subject:
Reply with quote

I have updated my MailWasher Pro Filters to detect and hide the latest type of PDF spams - composed in Qualcomm's email client. The new filter is PDF Spam #3. I expect that I will have to alter this rule over the next week or two, as variants appear. Your input on any filters that fail to identify their type of spam will be appreciated!

I also updated the "Postcard Trojan Scam" and the "RX Spam" filters last night, and have moved the most common spam rules to the top of the list. This will save processing time, because once a filter rule matches a type of spam no further rules are checked (and some of you have commented on how CPU-intensive my rules can be). I will be moving the order around to respond to changing spam runs and as certain types become less prevalent.


_________________
Submitted by Wiz
Guarding the Castle against spammers and scammers
Back to top
View users profile Send private message Visit posters website AIM Address Yahoo Messenger
davews

Sergeant
Sergeant


Joined: May 03, 2003
Posts: 75


PostPosted: Sat Aug 11, 2007 5:48 am    Post subject:
Reply with quote

Maybe identifying the email client is not a good idea for the PDF's. I have seen them sent with OE5.5 as well as OE6 and Thunderbird. If sent via zombies they could literally be sent with anything.

Back to top
View users profile Send private message
Wizcrafts

Sergeant
Sergeant
Premium Member

Joined: Jun 05, 2003
Posts: 95
Location: Michigan
Premium

PostPosted: Sat Aug 11, 2007 5:53 am    Post subject:
Reply with quote

davews wrote:
Maybe identifying the email client is not a good idea for the PDF's. I have seen them sent with OE5.5 as well as OE6 and Thunderbird. If sent via zombies they could literally be sent with anything.

It is a trivial matter to edit a rule and remove the X-Mailer or User-agent string. Everybody is free to modify my filters to suit their own situation. The only reason I include them is to try to minimize collateral damage. Sometimes people receive legitimate images or pdf file attachments from sources not yet on their Friends list.

Regarding the spam being sent from zombies, this has nothing to do with the program in which the spam was composed by the spammer. The zombies are dumb relays with scripts and servers or relays installed. The script supplies the headers and text and usually contains it's own SMTP engine. It is entirely possible that some of the spam zombie computers don't even have a default email client configured, yet they emit spam upon remote command and control. Since so many of each spam run have the same user agent or x-mailer it is obvious to me that they were all composed in that program by the spammer(s). I see this when I read the source codes over time. After each successful run the spammers alter this or that to elude Spam Assassin and MailWasher rules, but we catch up quickly and sometimes even stay one step ahead.

If nobody ever replied to spam messages, or ever bought any spamvertised items, that business would dry up and the idiots behind these schemes might get real jobs that are legitimate. However, since there are more gullible people who respond to, or act upon the crap in spam messages than there are spammers, the business of spamming thrives.


_________________
Submitted by Wiz
Guarding the Castle against spammers and scammers
Back to top
View users profile Send private message Visit posters website AIM Address Yahoo Messenger
Wizcrafts

Sergeant
Sergeant
Premium Member

Joined: Jun 05, 2003
Posts: 95
Location: Michigan
Premium

PostPosted: Sat Aug 11, 2007 6:09 am    Post subject:
Reply with quote

Davews, i like your icon. Do you know what this means?
... .--. .- -- ... ..- -.-. -.- ...


_________________
Submitted by Wiz
Guarding the Castle against spammers and scammers
Back to top
View users profile Send private message Visit posters website AIM Address Yahoo Messenger
JEfromCanada

Trooper
Trooper


Joined: Mar 25, 2004
Posts: 19
Location: Canada

PostPosted: Sat Aug 11, 2007 4:09 pm    Post subject: Re: Sorry to be lazy...
Reply with quote

Wizcrafts wrote:

Let me know if my filters help your spam problem (reply here), or if they cause processing problems for you (and tell us how many accounts are being checked).


I've started by cutting/pasting from the filters in the dialog box of your website. Don't know if that's the long or short version.

I modified your filters to remove all the "Automatic" deletions, since my Mailwasher Pro has trouble with the recycle bin processing when I use automatic directives.

It's currently hard to tell whether your filter is making a difference, since many of your filters "hide" emails. I may need to remove the "hide" directive so I can see just how many emails you are flagging.

But I've looked at some of the regular expressions and I must say you've been quite creative.

I currently monitor 15 accounts with Mailwasher Pro. The delay in processing is quite noticeable, but I'm more than happy to put up with a longer delay if it means I don't have to pick through the emails as carefully as I was doing before.

Back to top
View users profile Send private message
Wizcrafts

Sergeant
Sergeant
Premium Member

Joined: Jun 05, 2003
Posts: 95
Location: Michigan
Premium

PostPosted: Sat Aug 11, 2007 4:30 pm    Post subject:
Reply with quote

Thanks for the input JE. Hiding spam is the last resort before opting for automatic deletions. I use it to test filters for accuracy and sometimes just leave it that way after a rule proves effective, especially if it occasionally flags legitimate email as spam. If hiding flagged email is an annoyance just remove that directive by editing out this phrase from all filter rules: Hidden,
You can use your text editor's built-in Find feature, or even find and replace, where you would replace Hidden, with nothing (test this before saving changes).

Alternately, open the filters sidebar in MailWasher Pro and switch the display option to "Display the email" instead of "Hide the email."

Notice: I removed the version number from the X-Mailer in PDF Spam #2 because a new run of that spam was composed using a later email client version. If you ever receive pdf attachments from contacts I advise you to add these accounts or domains to your Friends List now.

Regarding restoring deleted messages; I set my scanning options to at least 250 lines, or 300, depending on the current types of spam I am seeing, and how much my filters slow down the processing time. This way if I restore a deleted message I get most of it back. Anything less than 250 lines will probably toast an HTML message, unless it was really minimal.

If you experience problems restoring deleted messages there are two main things to check.
1: Did you check the option to "Allow deleted email to be restored from the Summary screen"
2: Have you set a valid SMTP server, along with the correct port number, user name and password?

Those items are found in the MailWasher Pro Options, on the "Summary" tab.


_________________
Submitted by Wiz
Guarding the Castle against spammers and scammers
Back to top
View users profile Send private message Visit posters website AIM Address Yahoo Messenger
davews

Sergeant
Sergeant


Joined: May 03, 2003
Posts: 75


PostPosted: Sat Aug 11, 2007 4:42 pm    Post subject:
Reply with quote

Wizcrafts wrote:
Davews, i like your icon. Do you know what this means?
... .--. .- -- ... ..- -.-. -.- ...


Yes I do, won't bother repeating it. Approaching 50,000 morse contacts in amateur radio since 1969...

By the way, when editing filters.txt it should be noted that it is in MW's internal format which is UTF16 (16 bit encoding). Most text editors including current versions of Windows Notepad will open this properly, but some programs only accept 8 bit coding. I found this a problem with Notepad+, an excellent Notepad replacement, which does not recognise UTF16 and I had to use an alternative.

Most of my small spamload is caught by MW Bayesian so only using your filters for those few which dont. In any case it is no great hassle to manually mark a few for deletion.

Dave

Back to top
View users profile Send private message
Wizcrafts

Sergeant
Sergeant
Premium Member

Joined: Jun 05, 2003
Posts: 95
Location: Michigan
Premium

PostPosted: Sat Aug 11, 2007 8:55 pm    Post subject:
Reply with quote

davews wrote:

By the way, when editing filters.txt it should be noted that it is in MW's internal format which is UTF16 (16 bit encoding). Most text editors including current versions of Windows Notepad will open this properly, but some programs only accept 8 bit coding. I found this a problem with Notepad+, an excellent Notepad replacement, which does not recognise UTF16 and I had to use an alternative.

Dave

Dave;
Thanks for that behind the scenes information. Even I didn't realize that about the 16 bit encoding. I use NoteTab Pro for all of my text and HTML editing and it saves MailWasher filters properly as well.


_________________
Submitted by Wiz
Guarding the Castle against spammers and scammers
Back to top
View users profile Send private message Visit posters website AIM Address Yahoo Messenger
Display posts from previous:   
Post new topic   Reply to topic       All -> FavForums -> Mailwasher - Troubleshooting / General All times are GMT
Goto page Previous  1, 2, 3, 4, 5, 6, 7, 8, 9  Next
Page 5 of 9

 
Quick Reply:
Username: 

Quote the last message
Attach signature (signatures can be changed in profile)
 
You can post new topics in this forum
You can reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You can download files in this forum


Powered by phpBB © 2001 phpBB Group
spacer spacer