Cerebrus Email Guardian for POP3, Hotmail and Yahoo Email
Cerebrus Version: 1.6.5 Document Version: 1.4 Compkarori
- 1. Introduction
- 2. Installation
- 3. Shutting Cerebrus Down
- 4. Download Beta test version
- 5. How Does Cerebrus Work?
- 6. The Configuration Screens
- 7. Configuration File
- 8. Setting up your Email Program
- 9. Controlling Cerebrus By Email
- 9.1. help
- 9.2. status
- 9.3. password
- 9.4. listenPort
- 9.5. repair
- 9.6. quit
- 9.7. strict
- 9.8. GUI
- 9.9. ChangeSubject
- 9.10. ban content
- 9.11. remove content
- 9.12. ban from
- 9.13. remove from
- 9.14. allow from
- 9.15. ban subject
- 9.16. remove subject
- 9.17. allow subject
- 9.18. ban Spamtrap
- 9.19. remove SpamTrap
- 9.20. ban server
- 9.21. remove server
- 9.22. ban header
- 9.23. remove header
- 9.24. ban virus
- 10. Other Anti-Spam Measures
- 11. Explanation of the Reasons for Mail Classified as Spam
- 12. Virus Found
- 13. Trouble Shooting
- 13.1. Timeout
- 14. Test Mode
- 15. Windows Compatibility
- 16. Email Client Compatibility (Tested)
- 17. Support
- 18. Changes Log
Cerebrus is a program that guards your POP mailbox from spam and other unwanted mail, and is fairly straight forward to set up. It works by being an intermediary between your Internet Provider’s POP3 server, and your email client. All data that is transferred from your ISP’s POP3 server, is first examined by Cerebrus to see if it might be spam, or other unwanted mail. Cerebrus then optionally alters the subject header so that your email client can easily divert the mail to a holding area for you to inspect at your leisure. Cerebrus does not delete any mail so that you can not lose any mail by accident.
Million fresh email addresses
will get changed to:
[Spam?][subject] Million fresh email addresses
This allows you to use your email program to direct all email with the subject line containing [Spam?] to a holding folder. The second insertion [subject] tells you that Cerebrus decided on the basis of the subject line that the mail might be spam. You might wish to make a rule that also acts on the second insertion eg. immediately delete mail if it has “[banned from]” in the subject line.
Installation is easy. Just unzip the archive cerebrus.zip into any folder on your hard drive, and the cerebrus-data.zip file into the same directory. Just make sure that you have enough space. Cerebrus may save a compressed copy minus attachments of all the received mail in sub directories so it will need adequate space. It will automatically attempt to create the directories “inbox” “good” and “spam”. You can also download optional modules that support web based email, and these go into the same directory as Cerebrus.
Cerebrus does not make any registry changes, and so if you wish to delete it, you can just remove the folder into which it was installed. If you plan to share Cerebrus with others on a TCP/IP network, then the same just applies. In this case, Cerebrus works best when all the users on the network share the same POP server. However, this is not a requirement.
If you want Cerebrus to start up automatically when you start your PC, just drag a link from the Cerebrus.exe to the windows startup folder.
3. Shutting Cerebrus Down
When the GUI option is set to false( refer to the Configuration section), Cerebrus brings up a console window. Pressing ESC will cause Cerebrus to halt.
You can use the “Quit Cerebrus” button on the Cerebrus control panel.
When the GUI option is set to true and you have closed the control panel down, then you have to wait till the POPUP appears above the system tray. You can then click on the email statistics text, and a requester will appear giving you the option to shut Cerebrus down.
You can also use the Windows Task Manager to shut Cerebrus down. No data will be lost. The task name will be “Cerebrus”.
4. Download Beta test version
The Windows download site is:
5. How Does Cerebrus Work?
Cerebrus works by performing exhaustive analysis of the headers which accompany each email. Here is an example header of some spam that was received recently after it was passed thru Cerebrus. The only thing that has been changed is that the real mail box name has been altered to a fictitious one where ever it occurred in the header.
Return-Path: <[email protected]> Received: from 126.96.36.199 (account [email protected]) by compkarori.co.nz (CommuniGate Pro RPOP 3.5.9) with RPOP id 530019 for [email protected]; Sun, 27 Oct 2002 14:22:54 +1300 Received: from nkrxvm ([188.8.131.52]) by netlink.co.nz (8.9.3/8.9.3) with SMTP id OAA08558 for <[email protected]>; Sun, 27 Oct 2002 14:08:37 +1300 (NZDT) From: Cassandra Crawhall <[email protected]> To: <[email protected]> Subject: [spam?][subject] Webcam Site Alert for joebloggs Date: Sun, 27 Oct 2002 08:37:35 -0500 Mime-Version: 1.0 Content-Type: text/html Content-Transfer-Encoding: base64 Message-Id: <[email protected]>
Cerebrus examines each line of the header looking for clues. To help it make the decision as to whether mail is spam or not, it uses a mixture of filters based upon the subject, various other header lines, content, and probabilistic content filters. In addition, it can do a look up on black listing DNS servers, as well as validate the “Received:” headers.
To do this properly, Cerebrus needs to know as much about your normal mail as possible.
6. The Configuration Screens
7. Configuration File
Here is an example configuration file that is used by Cerebrus. This gets added to in use so that Cerebrus learns more about the type of email that you want and do not want. A lot has been removed to ensure readibility, and you can check your distribution to see what is there now. The file is called “cerebrus.config”.
log? false rename-attachments? true strict true listenPort 110 ISP [ "netlink.co.nz" ] password "Persephone" GUI true ChangeSubject true ReportSpam? false invisible false reserved-ipaddresses [ "184.108.40.206" "220.127.116.11" ] attachments [ "vbs" "scr" ] SpamTrap [ [email protected] ] ban content [ " rape" "HGH" ] ban subject [ "!!!" "$$$" "/ADV" "ADV:" "Porn" "RAPE" "Trade secrets" ] allow subject [ "[a-w-h]" "[amigaone]" "[Rebol]" "[Zope]" ] allow from [ [email protected] [email protected] ] ban from [ aol.com msn.com hotmail.com ] bad header [ "may be forged" "nobody" "HELO Hotmail" ] ban virus [ "Klez Worm" "AAAAAAAA2AAAAA4fug4AtAnNIbgBTM0hVGhpcyBwcm9ncmFtIGNhbm5vdCBiZSBydW4gaW4g" ] ban server [ "18.104.22.168" "19-Oct-2002/4:27:59+13:00" "22.214.171.124" "22-Oct-2002/10:00:41+13:00" ]
We will go through each line to explain how they are used.
- log? can be true or false. If true, then Cerebrus maintains a log file (”cerebrus.log”) of each operation and stores it in the same installation directory. You would only set it true if trying to see why something was not working correctly. When set to true, and GUI is set to false, then Cerebrus will print the log directly to a window as well to the log file.
- As a final line of defense against viruses, Cerebrus defaults to renaming incoming attachments if they belong to one of the dangerous types. Viruses, when coming in through email, pretty well only come as an infected attachment. If the attachment is renamed to an non-executable form, they can not damage your system. The line “attachments [ “vbs” “scr” ]” lists only two of the 20 or so included in your distribution. So, for example, an attachment “notsoinnocent.vbs” would be renamed to “notsoinnocent.vbs.scan-me-for-viruses.scan-me-for-viruses”. The double extension of “scan-me-for-viruses” is used as sometimes email programs do not show the extension.
- If set to true, then Cerebrus will examine the “Received:” line which is inserted by your ISP to see if the sender is who they claim to be.
- defaults to 110. This is the tcp port that Cerebrus listens to for commands from an email client. If you change this, you must make sure that your email client is set to open the POP3 port on the new port number that you have chosen.
- Here you need to change this to your own ISP. If you have more than one ISP, then include them all within the parentheses. There are two reasons for this.
- Bulk email often does not come with the usual “message-id:” header. When there is no message-id, then your ISP’s POP server will add one. Here’s an example of bulk mail that is not spam that has had this done.
Message-Id: <[email protected]> Received: (qmail 23716 invoked from network); 23 Oct 2002 01:32:50 -0000 Received: from unknown (HELO sharon) (126.96.36.199) by mail2.lga.net.sg with SMTP; 23 Oct 2002 01:32:50 -0000 From: Seagate Partner Program Specialist<[email protected]>
To help detect bulk email, Cerebrus checks to see if the message-id comes from your ISP, and if it does then the “From:” address should also be from your ISP. If it is not, then it is almost certainly bulk email, but not necessarily spam as in the example above.
- Forged Headers occur when the sender pretends to be someone else. Often fictitious accounts from Hotmail, and Yahoo are used. But Cerebrus can guess from the “received:” lines whether a forgery has occurred. Here’s an example of a forged header:
Return-Path: <[email protected]> Received: from 188.8.131.52 (account [email protected]) by compkarori.co.nz (CommuniGate Pro RPOP 3.5.9) with RPOP id 529987 for [email protected]; Sun, 27 Oct 2002 11:03:53 +1300 Received: from hotmail.com ([184.108.40.206]) by netlink.co.nz (8.9.3/8.9.3) with SMTP id KAA19911 for <[email protected]>; Sun, 27 Oct 2002 10:53:45 +1300 (NZDT) From: [email protected]
This spammer is pretending to be originating from hotmail.com but a DNS lookup of 220.127.116.11 shows that it is actually host66-233.pool217141.interbusiness.it. Cerebrus does a reverse DNS lookup on hotmail.com and confirms that it is not 18.104.22.168. Now, the most important line for Cerebrus is:
Received: from hotmail.com ([22.214.171.124]) by netlink.co.nz (8.9.3/8.9.3) with SMTP id KAA19911 for <[email protected]>; Sun, 27 Oct 2002 10:53:45 +1300 (NZDT)
where our ISP “netlink.co.nz” appears. So, knowing the ISP helps Cerebrus locate that line.
- The default password for Cerebrus. You should change it to something else. We will cover later on how the password is used in the “Controlling Cerebrus” section.
- If true, then a windows pops up just above the system tray when receiving mail. If you click on the text, then an option to quit Cerebrus comes up. You can set this to “false” if running on a server when no one will see the popups appear. You might want to set it to true when first running it, and then change to false once you are happy it is working well.
- If true, then Cerebrus annotates the subject line of the email as described above. If false, then it will create a new header line of “Cerebrus-filter: “ and annotate that instead. Additionally, if false, it will alter the CC: field to include [email protected], so that you can filter on this “email address” instead of filtering on the subject line if your email client is unable to filter on custom headers.
- If true, then after Cerebrus closes the connection to the POP server, and if you have received identified spam, then a report screen
will pop up. Choose the “guess” button and then “send” to send off your complaints. You can customise the text for the buttons 1… 4 by creating files complaint1.txt .. complaint4.txt in the same directory as Cerebrus.
- if true, then no windows pop ups will appear ( apart from the very first if GUI is true ), and no console windows will appear either. You will need to kill Cerebrus via the task manager ( cerebrus.exe ), or via an email “Quit” command.
- Cerebrus does a lookup on Spamcop to see if a particular IP address is listed as a spam source. To prevent Cerebrus looking up your own IP address, you should list your ISP’s mail servers IP addresses here. Also, if you have a static IP address of your own, you should add it here. If you do not know what these numbers are, you can ask your ISP’s helpdesk. Alternatively we will soon provide a tool that can do the lookup for you.
- If any incoming attachment has one of these extensions, then it will be renamed.
- Any email sent to these emails will be treated as spam, and email servers that were used to send these emails will be added to your banned server list.
- ban content
- Cerebrus examines the content of all incoming email. If it finds base64 encoded messages, it will decode them. It then scans them for content, and if it finds any of these words listed in the banned content list, it will mark them as spam.
- ban subject
- Any incoming mail that has these word fragments in the subject line will be marked as spam.
- allow subject
- Any incoming mail that has these word fragments in the subject line will not be examined any further. This is to allow mailing list emails in. The allowed subject list takes precedence over the banned subject list.
- allow from
- Any email which matches the allowed from list will not be examined any further. If you decide to ban all of hotmail.com, you can still allow email in from specific hotmail addresses.
- ban from
- Any email that matches the banned from list will be marked as spam unless they also appear in the allowed from list.
- ban header
- Often mail servers will add strings like “unknown” or “may be forged” to the “Received:” header strings. This does not mean that they are spam, but they often are.
- ban virus
- Cerebrus will scan incoming base64 encoded attachments for several common viral signatures. At the time of writing, only those for the BugBear Virus, and the Klez Worm have been included. This is not intended to be a substitute for a good virus scanner.
- ban server
- Cerebrus collects a list of IP addresses which are known spam sources. Each time it has to do a lookup on SpamCop, and finds a positive, it adds to this list so that it does not have to do another lookup on Spamcop. If you have a correspondent who uses a banned server, you can still let them in by adding them to your allowed from list.
8. Setting up your Email Program
Cerebrus is what is called a “POP proxy server”. This means that it takes all the instructions that your email program would normally send to your POP server, and then sends them on itself. Any data it receives from your POP server, it then returns to your email program but after first classifying the email. This ensures maximum compatibility with most email programs. Although Cerebrus is designed to work only with POP3 servers, from version 1.4.2, support was introduced for Hotmail and Yahoo web email accounts.
8.1. Setup on local PC
If you are going to run Cerebrus on your own PC, then you need to configure your email program accordingly. The procedure for Outlook Express is as follows.
Go to the properties of your email account ( Tools->Accounts->Mail->Properties ), and on the server tab, note what is there. This is the POP3 server. Now, change “Incoming Mail (POP3):” to “localhost” instead. Now, change your account name from say, joebloggs to [email protected]
So, if your POP3 server were pop3.paradise.net.nz, and your userid is joebloggs, then your userid is now [email protected] This is so that Cerebrus can determine which pop server to use, especially when you might have a number of different pop accounts.
8.2. Setup on network PC
Do the same as for local PC, except change the server to the IP address of the networked PC that is running Cerebrus.
9. Controlling Cerebrus By Email
Cerebrus was initially conceived as running on a network PC. Since it would be inconvenient to access the network PC to make changes, commands can be sent to Cerebrus via email! In most cases, you just send yourself an email to achieve this.
Cerebrus therefore looks for a particular subject in every email to see if it is a set of commands for itself. If it sees:
it knows that the body of the email contains instructions for it. Note that the email must be sent as plain text, and not formatted as HTML.
Body commands must be formatted so that only one command occurs on a single line. They can be single words, or they can be words that take an argument.
“help” will display a shortened version of this help
“status” shows the current configuration, and all the data for every list
Changes the password to “newpassword”
Sets the port that Cerebrus listens to for commands from an email client. Defaults to 110 which is the POP3 port.
Repairs the attachment so that “src<>” is changed back to “src=” in an email that was considered to be spam. Just forward the email back to yourself with “repair” the only command, and “password: <Cerebrus password>” as the subject. Refer to the section “Other Anti-Spam Measures” for more information.
Shuts Cerebrus down. All changes are saved automatically.
If strict is set to true, then Cerebrus will check the message-id to see if it has originated from your ISP, and if it has, ensure that the from address is in one of your named ISPs.
If GUI is true, then a popup will appear above your system tray when Cerebrus has finished analysing your email. If you click on the email statistics text in the popup, then a requester will appear asking you if you wish to stop Cerebrus.
If Changesubject is true, then the subject line will be annotated when a spam is identified.
9.10. ban content
ban content "Ivory Coast" HGH "Human growth hormone"
Adds these three phrases to the banned content lists
9.11. remove content
remove content HGH
Removes the phrase “HGH” from the banned content lists
9.12. ban from
ban from aol.com msn.com
Adds aol.com and msn.com to banned list. All mail purporting to be coming from these domains will be labelled as spam.
9.13. remove from
remove from aol.com
Removes aol.com from the banned list
9.14. allow from
allow from [email protected]
9.15. ban subject
ban subject SEX "million emails"
Adds the phrases “SEX” and “million emails” to the banned subject list. Note that it is a good idea to add your username to the banned subject list as spammers often place this in the subject line, whereas valid email never does.
9.16. remove subject
remove subject SEX
Removes the word SEX from the banned and allowed subject lists
9.17. allow subject
allow subject [Rebol] [spam_brigade]
Adds these two phrases to the allowed subject lists. This format with  surrounding a word is most often used by mailing lists, which is a form of bulk mail you wish to allow in.
9.18. ban Spamtrap
ban Spamtrap [email protected]
Adds this email address to the list of SpamTrap addresses.
9.19. remove SpamTrap
remove Spamtrap [email protected]
Removes this email address from the list of SpamTrap addresses.
9.20. ban server
ban server 126.96.36.199 188.8.131.52
Adds these two ip addresses to the spam-server list, and automatically places a date beside the ip address. The date is added so later on you can check with SpamCop, or other blacklisting service to see if these addresses are still being used by spammers or not. They can then be automatically removed from the spam-server list.
9.21. remove server
remove server 184.108.40.206
Removes the server 220.127.116.11 from the spam-server list
9.22. ban header
ban header nobody
Adds the word “nobody” to the banned header strings list
9.23. remove header
remove header nobody
Removes the word “nobody” from the banned header strings list
9.24. ban virus
ban virus "BugBear Virus" QogHR0l19+lj////kIsCg8IEiQeDxwSD6QR38QHP6Uz///9eife5fwUAAIoHRyzoPAF394A/DHXy
Adds “BugBear Virus” and it’s base64 encoded signature to the virusdefs list
10. Other Anti-Spam Measures
Spam often includes offensive images. Some email programs automatically display these images once a message has been selected. Cerebrus decouples the images so that they no longer display in any email it has classified as spam. If by accident, Cerebrus does this to a valid email, you can retrieve the message by replacing “src<>” with “src=” in the content of the mail. See the “Repair” command on how to use Cerebrus to do this for you.
11. Explanation of the Reasons for Mail Classified as Spam
Mail modified by Cerebrus will have one of the following inserted after the [Spam?] in the subject line.
- [bulk/forged?] – The message-id has been generated by your ISP, but the from: address is in another domain
- [forged Hotmail] – The message claims to be from a hotmail.com user but the message format is inconsistent with a hotmail email
- [header] – The header of the email contains one of the strings listed in the header list
- [subject] – The subject line matched one of the strings listed in the blacksubject list
- [SpamCop] – The sender’s mail server was identified as a spam source by Spamcop
- [Bayes] – The body of the email was analysed and thought to be spam based upon the probabilities of the words within the body.
- [banned content] – The body of the email contained one of the strings listed in the banned content list
- [banned from] – The sender’s from address is listed in the banned list
- [No To Address] – The email was not addressed to anyone
- [SpamServer] – The sender’s email server is already listed in the server list
- [DNS mismatch or none] – The sending email server’s IP address does not match that identified by your ISP’s mail server, or does not have a DNS record.
12. Virus Found
Note importantly that Cerebrus is not an anti-virus product, and in most instances you should be running a virus checker. When you do, then that virus checker will usually intercept the virus before Cerebrus.
If Cerebrus does find a virus, it does not attempt a repair of the attachment ( which is often a random document taken from the infected sending computer ) but replaces the email completely with a Cerebrus warning. The subject header becomes:
[virus=Klez Worm] rest of subject
where the virus was indentified in this instance as the Klez Worm.
At the time of writing, only two virus definitions are included with the standard distribution.
13. Trouble Shooting
A mail client such as Outlook Express does not normally timeout even when downloading large files as data are constantly being received. However, Cerebrus has to download the entire email first so that it can be examined, and your mail client is likely to complain and issue a timeout warning as it will not receive any data during that period. You will have to change the timeout period in your email client to avoid these messages, or just click on the “wait” alert when it pops up.
To change the timeout period in Outlook Express, go to Tools->Accounts->Mail->Properties->Advanced and change the server timeout period to 5 mins. Cerebrus’ own timeout period is set to 30 seconds.
14. Test Mode
Cerebrus has a built-in testmode where it will process a directory of stored email and process each mail as though it had come from your POP3 server. In this mode, the TOP command is not currently enabled.
Create a directory named “testmail” in the same directory that you have installed Cerebrus. You can place raw emails in this directory. A raw email looks like the text as seen in “message source” in Outlook Express. We will provide a utility to take email from your pop server and drop it into this directory. You may also find raw email in the cache directories ( their name will be the same as the user logon string ) unless it has been deleted by Cerebrus.
Now create an email account with the incoming POP3 server set to “localhost”, and account name set to [email protected] The password can be set to anything. When you do a “Send/receive” on this account, it will grab all email files from the testmail directory. It will not delete any of these files which can be received indefinitely unless your email client declines to receive them as it recognises them as being already read.
15. Windows Compatibility
Cerebrus has been tested with Windows 98, NT 4, XP Home and XP Professional.
16. Email Client Compatibility (Tested)
There is no way to alter the RPOP timeout period so email collection will fail on large emails ( over 500kb ) when CommunigatePro will timeout the connection to Cerebrus. But since the cache was implemented in version 1.0.4, CommunigatePro will collect these emails on the next connection without having to download them from POP server again.
16.2. Eudora 5.2
Does not support Change Password Function
16.3. The Bat! (v1.61)
16.4. Outlook Express V6
16.5. Yam 2.3 sp1 (Amiga)
16.6. Others …
May be supported. Please post to the
your experience with other mailers so that they can be added here.
We have a
where you may post support related questions. Currently you do have to register with the discussion board software.
18. Changes Log
1.4.2 16-Mar-2003 Support added for Hotmail and Yahoo web email accounts. Email manager provided to delete mail off pop and web accounts directly off the server.
1.2.1 13-Feb-2003 Added Changesubject flag. Relaxed testing of email where no dns record, or record does not match that claimed. Only flagged as spam if probability exceeds .01 whereas without this problem, probability has to exceed .9
1.0.9 9-Dec-2002 Added a listenPort setting. Resizing of the abuse report window is now fixed.
1.0.7 1-Dec-2002 Added abuse reporting module. Activate by setting ReportSpam? flag to true.
1.0.6 27-Nov-2002 Added SpamTrap list. Now error traps popups. Fixed bug with not decoding html mail where no boundary was given.
1.0.5 19-Nov-2002 Added invisible flag. When true, no popups or console will appear. You will have to kill Cerebrus by task manager, or via email “Quit” command. If email arrives with no “subject:” header, Cerebrus will insert one.
1.0.4 16-Nov-2002 Automatic differential updates. Caches the email locally to overcome problem where the email client is unable to increase the timeout period. A directory is created for each email account.
1.0.3 13-Nov-2002 Supports connection to POP proxies that require userid in email format. Support for Eudora’s CAPA command.
0.9.9 10-Nov-2002 implemented test-mode.
0.9.8 7-Nov-2002 implemented TOP command so that can scan headers for spam, and delete from server without having to download the whole message. This will not spot spam that has banned content. Delete from server applies to mail clients that can do this eg. Outlook Express. Spamcop is now a DNS lookup rather than http.
0.9.4 5-Nov-2002 changed the listen loop to keep the pop port open always. Checks for new version at start up.
0.9.1 3-Nov-2002 changed to accomodate SpamCop’s new report page.
0.9.0 3-Nov-2002 added “repair” command, and new email syntax.
0.8.9 2-Nov-2002 fixed bug with forged? method.
0.8.8 2-Nov-2002 now changes are saved automatically. No need to explicitly issue a “Save” command. Email from hotmail.com is now checked for consistency with Hotmail guidelines.
0.8.7 1-Nov-2002 fixed parsing of the config file