CastleCops, Internet Crime Fighters
Need help? Click here to register for free! Absolutely zero advertisements on this site!

Donation/Premium
spacer
block bottom
Security Central
spacer
· Home
· PIRT/Fried Phish
· MIRT
· SIRT
· Deutsch
· Wiki
· Newsletter
· O16/ActiveX
· CLSID List
· Contest2007
· Downloads
· Feedback (send)
· Forums
· HijackThis
· Hijacktrend
· LSPs
· My Downloads
· O18
· O20
· O21
· O22
· O23
· O9
· Premium
· Private Messages
· Proxomitron
· Reviews
· Search
· StartupList
· Stories Archive
· Submit News
· WsIRT
· Your Account
· Acceptable Use Policy
block bottom
spacer spacer

HowTo: MailWasher with POPFile (Bayesian Filter)
Goto page Previous  1, 2, 3, 4, 5, 6, 7, 8, 9, 10  Next
 
Post new topic   Reply to topic       All -> FavForums -> Mailwasher - Troubleshooting / General [del.icio.us!] [digg it!] [reddit!]
View previous topic :: View next topic  
Author Message
Johnny

Guest
IP: 195.97.*.*






PostPosted: Thu Aug 07, 2003 8:24 pm    Post subject: For all you popfile and MW users .... the patch is here
Reply with quote

Dear Friends,

There is a fantastic patch by Martin Geisler that works like a charm for Popfile, and from my view boosts performance of the parse engine by 100 since it allows checking for invalid HTML tags, so all words end up right in the corpus and not cut in pieces.

try the link
http://sourceforge.net/tracker/index.php?func=detail&aid=758482&group_id=63137&atid=502958

(sourceforge.net patches section /removing invalid tags patch)

I am delighted, and I suggest you try it, and keep your corpus free of those hated half words. Very Happy

JOhn

Back to top
Ikeb

Special Response Team
Forums Admin

Joined: Apr 20, 2003
Posts: 16535

Forums Admin Moderators MVP Premium SRT Team CC Committee Team F@H

PostPosted: Thu Aug 14, 2003 3:26 am    Post subject: Re: HowTo: MailWasher with POPFile (Bayesian Filter)
Reply with quote

gary wrote:

[snipped the set of instructions]
.... That's it! Remember that you will have to start the Web interface into POPFile and train it to be effective. You will also need to change the setup to suit your fancy. MailWasher can read the POPFile X field with a simple filter:

"The entire header" "Contains" "X-Text-Classification: spam"

Caveats and hints:

1) If you download a message more than once from MailWasher, it will show up twice in your history. Likewise, if you have your e-mail client configured to go through POPFile, and you download the message from MailWasher, and then your e-mail client, it will show up twice. This is not harmful, but please turn off the "Send statistics daily" option in the security tab, as it will skew the POPFile folks' statistics to look better than they actually are.

2) If a message is in the history more than once, and it is not correctly classified, you need only reclassify one copy of the message.


Let me know if you have trouble understanding these directions, and I'll try to clarify them.


I'm having problems auto-starting POPFile when I initialize Windows. I use perl version method of auto-starting POPFile but I don't recall how I determined what to do. I must have either set it up myself or found directions elsewhere.

Currently I attempt to initiate POPFile via "Local User Run" using ...\POPFile\wperl.exe invoked with
Code:
popfile.pl -pop3_toptoo 1
as parameters. POPFile will not initiate via this method but can be initiated via the shortcut "...\POPFile\wperl.exe popfile.pl -pop3_toptoo 1". Any idea why "Local User Run won't start POPFile but the shortcut will?

Back to top
View users profile Send private message
Ikeb

Special Response Team
Forums Admin

Joined: Apr 20, 2003
Posts: 16535

Forums Admin Moderators MVP Premium SRT Team CC Committee Team F@H

PostPosted: Tue Aug 26, 2003 4:53 am    Post subject:
Reply with quote

I attempted to automatically start POPFile using the NT srvany.exe reskit utility to no avail. Has anyone managed to automatically start POPFile upon login?

Back to top
View users profile Send private message
TalonTSi

Corporal
Corporal


Joined: Mar 16, 2003
Posts: 55
Location: Canada

PostPosted: Tue Aug 26, 2003 7:00 am    Post subject:
Reply with quote

I'm starting POPfile through my Startup group. I have a shortcut that reads

Code:
"C:\Program Files\POPFile\wperl.exe" popfile.pl "-pop3_toptoo 1"
with Start In set to
Code:
"C:\Program Files\POPFile"
Haven't had any troubles with it...


_________________
--Darren.
Back to top
View users profile Send private message Visit posters website
Paul

CastleCops Founder


Joined: Feb 22, 2002
Posts: 27351

Administrators Firetrust Forums Admin MIRT Moderators MVP Phishing Squad Premium Team CC Committee

PostPosted: Thu Aug 28, 2003 2:23 pm    Post subject:
Reply with quote

Now is there a way for this filter to be integrated in with an MTA like Sendmail?


_________________
Paul Laudanski - http://www.laudanski.com
http://www.linkedin.com/pub/1/49a/17b
Back to top
View users profile Send private message Send email Visit posters website
Ikeb

Special Response Team
Forums Admin

Joined: Apr 20, 2003
Posts: 16535

Forums Admin Moderators MVP Premium SRT Team CC Committee Team F@H

PostPosted: Thu Aug 28, 2003 4:45 pm    Post subject:
Reply with quote

Paul wrote:
Now is there a way for this filter to be integrated in with an MTA like Sendmail?


I don't see why not. This filter runs as a proxy and since it's written in perl, I expect you could run it on a Linux/Unix system just as well. While Gary's hacks only apply to the Windows version, you probably wouldn't want to apply those since they are specific to MWP.

For a more informed view, you might want to check out the forums referenced at the POPFile site....

Back to top
View users profile Send private message
ServMe

Cadet
Cadet


Joined: Jun 17, 2003
Posts: 9
Location: Afghanistan

PostPosted: Tue Sep 16, 2003 4:10 pm    Post subject:
Reply with quote

Has anyone tried (or successfully) installed the new 0.19.1 version of POPfile? I tried a few days ago, did the MW hack again and everything just went kaboom.

MW wasn't able to retrieve mail anymore, although my regular client was. Seems that either they changed something around in regard to retrieving mail, or I messed up - probably a combination of both Wink

So, did anyone get it working, and then I look at Gary in particular since he came up with the hack in the first place.

Back to top
View users profile Send private message
Ikeb

Special Response Team
Forums Admin

Joined: Apr 20, 2003
Posts: 16535

Forums Admin Moderators MVP Premium SRT Team CC Committee Team F@H

PostPosted: Tue Sep 16, 2003 5:01 pm    Post subject:
Reply with quote

I was wondering whether to upgrade but suspected there might be a problem since Gary's hack isn't exactly supported. Wink Also, I haven't checked out what I'd gain by upgrading. What does version 19.1 provide that 19.0 doesn't?

Back to top
View users profile Send private message
gary

Lieutenant
Lieutenant
Premium Member

Joined: Dec 22, 2002
Posts: 260
Location: Dallas/Ft. Worth, USA
Premium

PostPosted: Wed Sep 17, 2003 4:11 am    Post subject:
Reply with quote

Egad! I've been pretty busy with work and some other things lately, so I haven't really kept up. I'll try to take a look at it within the next few days. Sorry about falling behind, guys.


Oops, update - I just installed 0.19.1, and found that instead of modifying line 337, you should modify line 338. The rest is the same, and it seems to work fine. What is the error message that you are receiving?

I'll update the hack instructions to reflect the proper lines and verion number soon.


_________________
Gary
Back to top
View users profile Send private message
ServMe

Cadet
Cadet


Joined: Jun 17, 2003
Posts: 9
Location: Afghanistan

PostPosted: Wed Sep 17, 2003 11:16 am    Post subject:
Reply with quote

Gary,

Seems I was a bit too tired when I tried hacking 0.19.1 last time. I just applied your hacks again and now they seem to work fine. My mistake!

Ikeb,

In regard to your question about upgrading : 0.19.1 is a maintenance release, nothing more or less. The following has been fixed (source : POPfile readme file)

THE GORY DETAILS FOR v0.18.3 and v0.19.1

1. Fixed a bug causing long message download to fail.

Reports: 753940 (mfichtner) (fixed by sschinke)

2. Provided a workaround for incompatibilties caused by odd HTTP headers from Norton Internet Security.

Reports: Many (fixed by jgrahamc)

3. Fixed a case that could prevent delivery of email

Reports: Via forums and email. (fixed by sschinke)

Back to top
View users profile Send private message
MagicSpeller

Cadet
Cadet


Joined: Sep 25, 2003
Posts: 3
Location: USA

PostPosted: Thu Sep 25, 2003 4:37 am    Post subject:
Reply with quote

Hi. I'm a latecomer to this thread--I found it by searching.

I'm one of the original users of Mailwasher, but haven't used it for a long time. However, I have been using POPFile for some time.

I received a Mailwasher update notification today and wondered what's been happening with it, which led me here.

I skimmed through this thread, and it definitely looks like something I'd like to try. However, it looks as though there have been several additions and corrections to Gary's originally posted procedure. Gary, have you had a chance to post this on your Web page yet? If not, is there someone else where I can get a currently working procedure for accomplishing this, without having to wade through all the messages?

Thanks very much.

Back to top
View users profile Send private message Send email
Ikeb

Special Response Team
Forums Admin

Joined: Apr 20, 2003
Posts: 16535

Forums Admin Moderators MVP Premium SRT Team CC Committee Team F@H

PostPosted: Thu Sep 25, 2003 5:11 am    Post subject:
Reply with quote

MagicSpeller,

According to Gary, he modified his original post to reflect the latest "version" of his hack. In all this long thread there was only a single change he made (posted Tue Jun 17, 2003 3:14 pm) to correct a problem.

Back to top
View users profile Send private message
gary

Lieutenant
Lieutenant
Premium Member

Joined: Dec 22, 2002
Posts: 260
Location: Dallas/Ft. Worth, USA
Premium

PostPosted: Thu Sep 25, 2003 4:58 pm    Post subject:
Reply with quote

My apologies, I've not yet reflected the small change in the original post necessary to get the hack working with the latest version of POPFile, but the difference is only the placement of one line, which can be easily determined by looking at the surrounding code. As I recall, the issue was that the line number for the second hack needed to be changed to the next line, or something - no biggie.


_________________
Gary
Back to top
View users profile Send private message
MagicSpeller

Cadet
Cadet


Joined: Sep 25, 2003
Posts: 3
Location: USA

PostPosted: Thu Sep 25, 2003 5:02 pm    Post subject:
Reply with quote

Thanks, Ikester and Gary.

With all the discussion and suggestions, I was sure there would be more than one change required (which I did see). Guess it's time to get to work Very Happy .

Wish I could figure out how to print the first page of the thread without having the right end cut off....

Back to top
View users profile Send private message Send email
Ikeb

Special Response Team
Forums Admin

Joined: Apr 20, 2003
Posts: 16535

Forums Admin Moderators MVP Premium SRT Team CC Committee Team F@H

PostPosted: Thu Sep 25, 2003 5:56 pm    Post subject:
Reply with quote

MagicSpeller wrote:
With all the discussion and suggestions, I was sure there would be more than one change required (which I did see). Guess it's time to get to work Very Happy .


Whoops, I forgot about the latest change (adjusting the line number that's modified). Gary, the post I was referring to was to fix a problem where an email would sometimes not be read:
gary wrote:
Hehe. Thanks!

Okay guys, give this a try. This is a quick hack, and I've only tested it enough to make sure the system does not blow up, but it may do what you want.

For line 268 in POP3.pm, use:

Code:
            if ( ($2 ne '99999999') && ($2 < 100) )  {


For line 337 in POP3.pm, use:

Code:
        if ( ( $command =~ /RETR (.*)/i ) || ( $command =~ /TOP (.*) (.*)/i ) )  {


The effect will be that any TOP request of 100 lines or more will show up in the history, and all TOP requests will be echoed to the log and/or to the window that you are running POPFile in.

TalonTSi, note that I finally figured out how to post code. You, uh, use the "Code" attribute. Embarassed

MagicSpeller wrote:
Wish I could figure out how to print the first page of the thread without having the right end cut off....

Try pasting it into Word. I often do so for web pages I want to keep.

Back to top
View users profile Send private message
Display posts from previous:   
Post new topic   Reply to topic       All -> FavForums -> Mailwasher - Troubleshooting / General All times are GMT
Goto page Previous  1, 2, 3, 4, 5, 6, 7, 8, 9, 10  Next
Page 7 of 10

 
Quick Reply:
Username: 

Quote the last message
Attach signature (signatures can be changed in profile)
 
You can post new topics in this forum
You can reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You can download files in this forum


Powered by phpBB © 2001 phpBB Group
spacer spacer