CastleCops, Internet Crime Fighters
Need help? Click here to register for free! Absolutely zero advertisements on this site!

Donation/Premium
spacer
block bottom
Security Central
spacer
· Home
· PIRT/Fried Phish
· MIRT
· SIRT
· Deutsch
· Wiki
· Newsletter
· O16/ActiveX
· CLSID List
· Contest2007
· Downloads
· Feedback (send)
· Forums
· HijackThis
· Hijacktrend
· LSPs
· My Downloads
· O18
· O20
· O21
· O22
· O23
· O9
· Premium
· Private Messages
· Proxomitron
· Reviews
· Search
· StartupList
· Stories Archive
· Submit News
· WsIRT
· Your Account
· Acceptable Use Policy
block bottom
spacer spacer

filtering message content which is "unfilterable"

 
Post new topic   Reply to topic       All -> FavForums -> Mailwasher - Troubleshooting / General [del.icio.us!] [digg it!] [reddit!]
View previous topic :: View next topic  
Author Message
steve.frye

Guest
IP: 12.95.*.*






PostPosted: Fri May 23, 2003 1:56 pm    Post subject: filtering message content which is "unfilterable"
Reply with quote

Hi,

I get lots of spam which "should" be filtered by my content filters, but isn't. Apparently the sender does something to the text to make it readable by me but not by the mailwasher filter. I've looked at the raw source of such messages recently and a couple of things appear more or less regularly: something about charset=iso-8859-1 and something about encoding base 64.

Is either or both of these things keeping me from filtering the messages?

If so, how can one figure out what "viagra" is in that charset and encoding so I can put the appropriate string in my content filter?

Thanks.

Steve Frye

Back to top
gary

Lieutenant
Lieutenant
Premium Member

Joined: Dec 22, 2002
Posts: 260
Location: Dallas/Ft. Worth, USA
Premium

PostPosted: Sat May 24, 2003 4:49 am    Post subject:
Reply with quote

Messages that are encoded require something to decode them, such as Benign. While MailWasher will decode a number of things in Normal View in the preview window, including cleaning up the HTML and deciphering "escaped" characters, this view is not accessible by the filters.

My solution has been to either mark encoded messages as such using a filter, run them through Benign first, or run them throgh some other product which will decipher the message, like POPFile.

Back to top
View users profile Send private message
aj

Guest
IP: 12.243.*.*






PostPosted: Sat May 24, 2003 6:40 pm    Post subject: how to mark encoded messages
Reply with quote

I like your idea of using a filter to mark encoded messages. Can you explain how to do that?

Also, is there any reason not to automatically reject any message that has been encoded in this way, since I assume people I'm likely to correspond with wouldn't need (or think to) encode?

Thanks.
AJ

Back to top
gary

Lieutenant
Lieutenant
Premium Member

Joined: Dec 22, 2002
Posts: 260
Location: Dallas/Ft. Worth, USA
Premium

PostPosted: Sun May 25, 2003 4:06 pm    Post subject:
Reply with quote

Hi AJ,

You probably don't want to automatically reject messages that are encoded in this manner. Certain e-mail clients -- especially the ones that are popular nowadays that "enhance" your e-mails, like Incredimail -- tend to use it extensively. In addition, most e-mail clients use it for attachments.

You can set up a filter to search for the words "Content-Transfer-Encoding: base64" in the entire header and in the body, as they may occur in either place.

If you know how to edit your filters.txt file, you can just insert this line:

[enabled],"Base 64 Encoded","Base 64 Encoded",33023,OR,Blacklist,Delete,Body,contains,"Content-Transfer-Encoding: base64",EntireHeader,contains,"Content-Transfer-Encoding: base64"

Change the colors, name, etc. to whatever you like.

Gary


_________________
Gary
Back to top
View users profile Send private message
SteveFrye

Cadet
Cadet


Joined: May 23, 2003
Posts: 2
Location: USA

PostPosted: Mon May 26, 2003 2:56 pm    Post subject:
Reply with quote

Thanks for the pointers.

Is there a free or shareware program that could be used to encode phrases base 64 so that I could put them in my filter? Alternatively, can you point me to the specification for how to "encode base 64"?

Back to top
View users profile Send private message
gary

Lieutenant
Lieutenant
Premium Member

Joined: Dec 22, 2002
Posts: 260
Location: Dallas/Ft. Worth, USA
Premium

PostPosted: Mon May 26, 2003 3:51 pm    Post subject:
Reply with quote

If you have access to a Unix box, a number of the uudencode's support base64 using the -m or
--base64 option.

If not, I happened to run accross this page, which looks like it would be an easy way to do what you want:

http://makcoder.sourceforge.net/demo/base64.php

I'm sure there are a lot more encoders out there, I just haven't looked around much for them.

Good luck!

Back to top
View users profile Send private message
AJ

Guest
IP: 12.243.*.*






PostPosted: Mon May 26, 2003 4:44 pm    Post subject:
Reply with quote

Thanks, Gary. I'll give it a try.

AJ

Back to top
SteveFrye

Cadet
Cadet


Joined: May 23, 2003
Posts: 2
Location: USA

PostPosted: Mon May 26, 2003 9:56 pm    Post subject:
Reply with quote

Wow! the encoder/decoder web page is great. Ask and ye shall receive.

Thanks, Gary.

Steve

Back to top
View users profile Send private message
IP: 202.37.*.*

Guest






PostPosted: Tue May 27, 2003 7:35 am    Post subject:
Reply with quote

gpartain wrote:
Hi AJ,

You probably don't want to automatically reject messages that are encoded in this manner. Certain e-mail clients -- especially the ones that are popular nowadays that "enhance" your e-mails, like Incredimail -- tend to use it extensively. In addition, most e-mail clients use it for attachments.


I have not checked incredimail etc, but AFAIK Anything that is text/html shouldn't be encoded in base64. So you should be able to cull the encoded spams quite nicely by filtering for:

Content-Type: text/html;
Content-Transfer-Encoding: base64

Back to top
Display posts from previous:   
Post new topic   Reply to topic       All -> FavForums -> Mailwasher - Troubleshooting / General All times are GMT
Page 1 of 1

 
Quick Reply:
Username: 

Quote the last message
Attach signature (signatures can be changed in profile)
 
You can post new topics in this forum
You can reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You can download files in this forum


Powered by phpBB © 2001 phpBB Group
spacer spacer