milter-7bit/0.16
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| text!/path/map.txt | R/O text file, memory hash |
| /path/map.db | Berkeley DB hash format |
| db!/path/map.db | Berkeley DB hash format |
| db!btree!/path/map.db | Berkeley DB btree format |
| sql!/path/database | An SQLite3 database |
| socketmap!host:port | Sendmail style socket-map |
| socketmap!/path/local/socket | Sendmail style socket-map |
| socketmap!123.45.67.89:port | Sendmail style socket-map |
| socketmap![2001:0DB8::1234]:port | Sendmail style socket-map |
If :port is omitted, the default is 7953.
The access-db contains key-value pairs. Lookups are performed from most to least specific, stopping on the first entry found. Keys are case-insensitive.
An IPv4 lookup is repeated several times reducing the IP address by one octet from right to left until a match is found.
tag:192.0.2.9 tag:192.0.2 tag:192.0 tag:192
An IPv6 lookup is repeated several times reducing the IP address by one 16-bit word from right to left until a match is found.
tag:2001:0DB8:0:0:0:0:1234:5678 tag:2001:0DB8:0:0:0:0:1234 tag:2001:0DB8:0:0:0:0 tag:2001:0DB8:0:0:0 tag:2001:0DB8:0:0 tag:2001:0DB8:0:0 tag:2001:0DB8:0 tag:2001:0DB8 tag:2001
A domain lookup is repeated several times reducing the domain by one label from left to right until a match is found.
tag:[ipv6:2001:0DB8::1234:5678] tag:[192.0.2.9] tag:sub.domain.tld tag:domain.tld tag:tld tag:
An email lookup is similar to a domain lookup, the exact address is first tried, then the address's domain, and finally the local part of the address.
tag:account@sub.domain.tld tag:sub.domain.tld tag:domain.tld tag:tld tag:account@ tag:
If a key is found and is a milter specific tag (ie. milter-7bit-Connect, milter-7bit-From, milter-7bit-Auth, milter-7bit-To), then the value is processed as a pattern list and the result returned. The Sendmail variants cannot have a pattern list. A pattern list is a whitespace separated list of pattern-action pairs followed by an optional default action. The supported patterns are:
[network/cidr]action Classless Inter-Domain Routing !pattern!action Simple fast text matching. /regex/action POSIX Extended Regular Expressions
The CIDR will only ever match for IP address related lookups.
A !pattern! uses an astrisk (*) for a wildcard, scanning over zero or more characters; a question-mark (?) matches any single character; a backslash followed by any character treats it as a literal (it loses any special meaning).
!abc! exact match for 'abc' !abc*! match 'abc' at start of string !*abc! match 'abc' at the end of string !abc*def! match 'abc' at the start and match 'def' at the end, maybe with stuff in between. !*abc*def*! find 'abc', then find 'def'
For black-white lookups, the following actions are recognised: OK or RELAY (white list), REJECT or ERROR (black list), DISCARD (accept & discard), SKIP or DUNNO (stop lookup, no result), and NEXT (opposite of SKIP, resume lookup). Its possible to specify an empty action after a pattern, which is treated like SKIP returning an undefined result. Other options may specify other actions.
Below is a list of supported tags. Other options may specify additional tags.
milter-7bit-Connect:client-ip value § Can be a pattern list. Connect:client-ip value client-ip value milter-7bit-Connect:[client-ip] value § Can be a pattern list. milter-7bit-Connect:client-domain value § Can be a pattern list. milter-7bit-Connect: value § Can be a pattern list. Connect:[client-ip] value Connect:client-domain value [client-ip] value client-domain value All mail sent by a connecting client-ip, unresolved client-ip address or IP addresses that resolve to a client-domain are black or white-listed. These allows you to white-list your network for mail sent internally and off-site, or connections from outside networks. Note that Sendmail also has special semantics for Connect: and untagged forms. milter-7bit-From:sender-address value § Can be a pattern list. milter-7bit-From:sender-domain value § Can be a pattern list. milter-7bit-From:sender@ value § Can be a pattern list. milter-7bit-From: value § Can be a pattern list. From:sender-address value From:sender-domain value From:sender@ value sender-address value sender-domain value sender@ value All mail from the sender-address, sender-domain, or that begins with sender is black or white-listed. In the case of a +detailed email address, the left hand side of the +detail is used for the sender@ lookup. Note that Sendmail also has special semantics for From: and untagged forms. milter-7bit-Auth:auth_authen value § Can be a pattern list. milter-7bit-Auth: value § Can be a pattern list. All mail from the authenticated sender, as given by sendmail's {auth_authen} macro, is black or white-listed. The string searched by the pattern list will be the sender-address. The empty form of milter-7bit-Auth: allows for a milter specific default only when {auth_authen} is defined.milter-7bit-To:recipient-address value § Can be a pattern list. milter-7bit-To:recipient-domain value § Can be a pattern list. milter-7bit-To:recipient@ value § Can be a pattern list. milter-7bit-To: value § Can be a pattern list. Spam:recipient-address value * (FRIEND or HATER are recognised) Spam:recipient-domain value * (FRIEND or HATER are recognised) Spam:recipient@ value * (FRIEND or HATER are recognised) To:recipient-address value To:recipient-domain value To:recipient@ value recipient-address value recipient-domain value recipient@ value All mail to the recipient-address, recipient-domain, or that begins with recipient is black or white-listed. In the case of a +detailed email address, the left hand side of the +detail is used for the recipient@ lookup. Note that Sendmail also has special semantics for Spam:, To:, and untagged forms.
The milter-7bit-Connect:, milter-7bit-From:, and milter-7bit-To: tags provide a milter specific means to override the Sendmail variants. For example, you normally white list your local network through any and all milters, but on the odd occasion you might want to actually scan mail from inside going out, without removing the Connect: tag that allows Sendmail to relay for your network or white listing for other milters. So for example if you have Sendmail tags like:
To:mx.example.com RELAY
You might have to add milter specific overrides in order to make sure the mail still gets filtered:
To:mx.example.com RELAY milter-7bit-To:mx.example.com SKIP
Some additional examples:
milter-7bit-Connect:80.94 [80.94.96.0/20]OK REJECT Accept connections from the netblock 80.94.96.0/20 (80.94.96.0 through to 80.94.111.255) and rejecting anything else in 80.94.0.0/16. milter-7bit-Connect:192.0.2 /^192\.0\.2\.8[0-9]/OK REJECT Accept connections from 192.0.2.80 through to 192.0.2.89, reject everything else in 192.0.2.0/24. milter-7bit-From:example.com /^john@.+/OK /^fred\+.*@.*/OK REJECT Accept mail from <john@example.com> and <fred@example.com> when fred's address contains a plus-detail in the address. Reject everything else from example.com. milter-7bit-To:example.net !*+*@*!REJECT !*.smith@*!REJECT /^[0-9].*/REJECT Reject mail to example.net using a plus-detail address or to any user who's last name is "smith" or addresses starting with a digit. No default given, so B/W processing would continue.
Normally when the access.db lookup matches a milter tag, then the value pattern list is processed and there are no further access.db lookups. The NEXT action allows the access.db lookups to resume and is effectively the opposite of SKIP. Consider the following examples:
milter-7bit-From:com
From:com/@com/REJECT NEXT
OKReject mail from places like compaq.com or com.com if the pattern matches, but resume the access.db lookups otherwise. milter-7bit-From:aol.com
From:fred@aol.com/^[a-zA-Z0-9!#$&'*+=?^_`{|}~.-]{3,16}@aol.com$/NEXT REJECT
OKAOL local parts are between 3 and 16 characters long and can contain dots and RFC 2822 atext characters except % and /. The NEXT used above allows one simple regex to validate the format of the address and proceed to lookup white listed and/or black listed addresses.
milter-7bit.
Typically a unix named socket or a host:port. This value must match the value specified for
the INPUT_MAIL_FILTER() macro in the sendmail.mc file. The accepted syntax is:
{unix|local}:/path/to/file- A named pipe. (default)
inet:port@{hostname|ip-address}- An IPV4 socket.
inet6:port@{hostname|ip-address}- An IPV6 socket.
none Do nothing. tag Tag the message subject. See subject-tag. quarantine Quarantine the message. See sendmail's queue management options -qQ and -Q. reject Reject the message. The Sendmail option EightBitMode=strict(see The Bat Book 3ed § 24.9.42) appears to be the equivalent of this milter option.discard Discard the message.
kill -QUIT `cat /var/run/milter/milter-7bit.pid`
§ all All messages § 0 Log nothing. § info General info messages. (default) § trace Trace progress through the milter. § parse Details from parsing addresses or special strings. § debug Lots of debug messages. dialog I/O from Communications dialog § state State transitions of message body scanner. dns Trace & debug of DNS operations cache Cache get/put/gc operations. § database Sendmail database lookups. socket-fd Socket open & close calls socket-all All socket operations & I/O § libmilter libmilter engine diagnostics
SMTP Responses
This is the list of possible SMTP responses.
- 550 5.7.1 invalid MIME header syntax; see grammar RFC 2045 et al.
- The message was rejected (see policy option) because of a syntax error in the MIME headers. See RFC 2045 et al.
- 550 5.7.1 invalid Content-Transfer-Encoding, octet [0-9A-F]+ at [0-9]+ not [^;]+; see RFC 2045 et al.
- The message was rejected (see policy option) for not adhering to the content transfer encoding rules as given by RFC 2045 et al.
Installation
Download:
milter-7bit/0.16 md5sum Change Log LibSnert md5sum Change Log Sendmail 8.14 http://www.sendmail.org/ Berkeley DB http://www.sleepycat.com/ -
If you have never built a milter for Sendmail, then please make sure that you build and install
libmilter, which is not built by default when you build Sendmail. Please read thelibmilterdocumentation. Briefly, it should be something like this:cd (path to)/sendmail-8.14.0/libmilter sh Build -c install
-
The build process for
libsnertandmilter-7bitis pretty straight forward once you havelibmilterinstalled:cd (path to)/com/snert/src/lib ./configure make build cd ../milter-7bit ./configure make build make install
Both configuration scripts have some options that allow you to override defaults. Those options are listed with:
./configure --help
-
An example
${prefix}/share/examples/milter-7bit/milter-7bit.mcis supplied. This file should be reviewed and the necessary elements inserted into your Sendmail.mcfile andsendmail.cfrebuilt. Please note the comments on the general milter flags.dnl ------------------------------------------------------------------- dnl milter-7bit.mc dnl ------------------------------------------------------------------- dnl Example configuration to be added to sendmail.mc. dnl dnl Copyright 2004, 2009 by Anthony Howe. All rights reserved. dnl dnl $OpenBSD$ dnl dnl ------------------------------------------------------------------- dnl Enable this for debug output from Sendmail. dnl define(`confLOG_LEVEL', `14')dnl dnl ------------------------------------------------------------------- dnl Enable this to see even more debug output. dnl Defaults to confLOG_LEVEL. dnl dnl If Milter.LogLevel is greater-than: dnl dnl 0 Communication errors dnl 8 Header & RCPT modification messages dnl 9 Connect to info dnl 10 Milter error return codes, abort messages dnl 12 More return code info, connection/open errors dnl 14 grey & rcpts info dnl 17 Show headers & body sent to a milter. dnl 18 Quit dnl 21 Time a milter dnl define(`confMILTER_LOG_LEVEL', 14)dnl dnl ------------------------------------------------------------------- dnl The S= by default specifies a unix domain socket to be used between dnl sendmail and the milter. It can also be an Internet domain socket. dnl The accepted forms are: dnl dnl {unix|local}:/path/to/file A named pipe. (default) dnl inet:port@{hostname|ip-address} An IPv4 socket. dnl inet6:port@{hostname|ip-address} An IPv6 socket. dnl dnl Note that the F= says what to do with the message if the milter dnl is not running. dnl dnl F=T Temporary fail connection if filter unavailable dnl F=R Reject connection if filter unavailable dnl dnl If no F= specified and there is a problem with the milter, then dnl the default is to continue normal handling, skipping the milter. dnl dnl Note that the T= specifies timeouts for communication. The dnl following fields are defined: dnl dnl C Timeout for connecting to a filter. If set to zero (0), dnl the system's connect() timeout will be used. Default: 5m dnl S Timeout for sending information from the MTA to a dnl filter. Default: 10s dnl R Timeout for reading reply from the filter. Default: 10s dnl E Overall timeout between sending end-of-message to filter dnl and waiting for the final acknowledgment. Default: 5m dnl dnl So the Sendmail default values are equivalent to: dnl dnl T=C:5m;S=10s;R=10s;E:5m dnl INPUT_MAIL_FILTER( `milter-7bit', `S=unix:/var/run/milter/milter-7bit.socket, T=C:1m;S:30s;R:2m;E:1m' )dnl dnl dnl CORRECT macro definitions that include the default values, plus any dnl additional values required by milter-sender or milter-greylist dnl dnl Defaults plus {client_resolve} for milter-sender. dnl define(`confMILTER_MACROS_CONNECT', `j, _, {daemon_name}, dnl {if_name}, {if_addr}, {client_resolve}') dnl Defaults plus {verify} for milter-sender, milter-greylist. dnl define(`confMILTER_MACROS_HELO', `{tls_version}, {cipher}, dnl {cipher_bits}, {cert_subject}, {cert_issuer}, {verify}') dnl Defaults dnl define(`confMILTER_MACROS_ENVFROM', `i, {auth_type}, {auth_authen}, dnl {auth_ssf}, {auth_author}, {mail_mailer}, {mail_host}, {mail_addr}') dnl Defaults plus {greylist} for milter-greylist. dnl define(`confMILTER_MACROS_ENVRCPT', `{rcpt_mailer}, {rcpt_host}, dnl {rcpt_addr}, {greylist}') dnl Defaults dnl define(`confMILTER_MACROS_EOM', `{msg_id}') dnl ------------------------------------------------------------------- dnl End milter-7bit.mc dnl ------------------------------------------------------------------- -
Once installed and configured, start
milter-7bitand then restart Sendmail. An example startup script is provided in${prefix}/share/examples/milter-7bit/milter-7bit.sh. The default options can be altered by specifying them on the command-line or within a/etc/mail/milter-7bit.cf. Themilter-7bit.cfis parsed first followed by the command-line options.
Notes
Currently tested platforms:
Cobalt Qube 1 with Linux RH 5.1 (mips 2.0.34 kernel);Linux RH 5.1 (Intel x386 2.2.25 kernel);FreeBSD 4.8, 4.9 (Intel x386);OpenBSD 3.6 (Intel x386)-
The minimum desired file ownership and permissions are as follows for a typical Linux system. For FreeBSD, NetBSD, and OpenBSD the binary and cache locations may differ, but have the same permissions.
Process user ``milter'' is primary member of group ``milter'' and secondary member of group ``smmsp''. Note that the milter should be started as root, so that it can create a .pid file and .socket file in /var/run; after which it will switch process ownership to milter:milter before starting the accept socket thread.
/etc/mail/ root:smmsp 0750 drwxr-x--- /etc/mail/access.db root:smmsp 0640 -rw-r----- /etc/mail/sendmail.cf root:smmsp 0640 -rw-r----- /etc/mail/milter-7bit.cf root:root 0644 -rw-r--r-- /var/run/milter/milter-7bit.pid milter:milter 0644 -rw-r--r-- /var/run/milter/milter-7bit.socket milter:milter 0644 srw-r--r-- /var/db/milter-7bit milter:milter 0644 -rw-r--r-- (*BSD) /var/cache/milter-7bit milter:milter 0644 -rw-r--r-- (linux) /usr/local/libexec/milter-7bit root:milter 0550 -r-xr-x--- I would like to express my thanks to Derek Balling for his support at http://www.milter.org/.
User Feedback
- Anthony Howe
- "If you're going to write a virus, damn it, make sure it conforms to standards."
- Chris from Xymox1
- Fun tools. You have some of the most interesting SPAM tools on the Internet! RFC Compliance or die I say! Its great !...
License Agreement 1.4
SNERTSOFT IS WILLING TO LICENSE THE SOFTWARE IDENTIFIED ABOVE TO YOU ONLY UPON THE CONDITION THAT YOU ACCEPT ALL OF THE TERMS CONTAINED IN THIS LICENSE AGREEMENT. PLEASE READ THE AGREEMENT CAREFULLY. BY DOWNLOADING OR INSTALLING THIS SOFTWARE, YOU ACCEPT THE TERMS OF THE AGREEMENT.
Definitions
``Package'' means the identified above in source and/or binary form, any other machine readable materials provided (including, but not limited to documentation, sample files, data files), any updates or error corrections, and its derivative works.
``Private Individual'' means an individual using the Package for personal, private, and non-commercial use only.
``Organisation'' means a legal entity or an individual that does not qualify as a Private Individual defined above.
``You'' (or ``Your'') means a Private Individual or Organisation exercising rights under, and complying with all of the terms of, this License or a future version of this License issued under Section 5.1. For legal entities, ``You'' includes any entity which controls, is controlled by, or is under common control with You. For purposes of this definition,``control'' means (a) the power, direct or indirect, to cause the direction or management of such entity, whether by contract or otherwise, or (b) ownership of more than fifty percent (50%) of the outstanding shares or beneficial ownership of such entity.
The Package is an original work written by Anthony C. Howe, hereto referred to as the ``Author''.
License To Use
If You are a Private Individual and so benefited from a reduced purchase price, then You may only compile, install, and use this Package, with or without private modifications, exclusively on a single machine You legally own or rent from a third party, provided You retain this notice, the Author's copyright notice, any and all license control methods (see below), and any links within the Package back to the most current online versions of this License and Disclaimer.
Otherwise if You have paid the full purchase price, then You may compile, install, and use this Package, with or without private modifications, exclusively on machines You legally own or rent from a third party, provided You retain this notice, the Author's copyright notice, any and all license control methods (see below), and any links within the Package back to the most current online versions of this License and Disclaimer.
You may copy, share, distribute, modify, and create derivative works from the user manuals and any related documentation solely for Your internal business purposes, such as in-house documentation, training manuals, or reference material.
Restrictions
Redistribution, including but not limited to books, CDROMS, download mirrors, floppy diskettes, hard disks, hardcopy print outs, online archives, solid state disks, streaming tapes, or other current or future forms of storage or communication media of the Package, with or without modifications, including any and all derivative works such as source patches, binaries, binary patches, or similar is expressly forbidden without prior written permission in hardcopy (letter or fax) signed and dated by the Author.
It is expressly forbidden for You to use the Package, in whole or in part, in any other software, except those designated by the Author.
It is expressly forbidden for You to use the Package to develop any software or other technology having the same primary function as the Package, including but not limited to using the Package in any development or test procedure that seeks to develop like software or other technology, or determine if such software or other technology performs in a similar manner as the Package.
You may not sell, rent, lease, or transfer the Package to third parties without prior written permission in hardcopy (letter or fax) signed and dated by the Author.
Termination
This Agreement is effective until terminated. You may terminate this Agreement at any time by destroying all copies of the Package. This Agreement will terminate immediately without notice from the Author if You fail to comply with any provision of this Agreement. Either party may terminate this Agreement immediately should any portion of the Package become, or in either party's opinion be likely to become, the subject of a claim of infringement of any intellectual property right. Upon Termination, You must destroy all copies of the Package.
Versions Of The License
New Versions. The Author may publish revised and/or new versions of the License from time to time. Each version will be given a distinguishing version number.
Effect of New Versions. Once a version of the Package has been published under a particular version of the License, You may always continue to use it under the terms of that License version. You may also choose to use such Package under the terms of any subsequent version of the License published by the Author. No one other than the Author has the right to modify the terms applicable to the Package created under this License.
Disclaimer
THIS SOFTWARE IS PROVIDED "AS IS" AND ANY EXPRESSED OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO WAY SHALL THE AUTHOR OR LICENSEE BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
License Control
The Package may use one or more license control methods including, but not limited to, license key activation, periodic reporting of Package details and IP address of installation to SnertSoft, remote license verification by SnertSoft, or other future technical means. Any information reported to or gathered by SnertSoft shall remain strictly confidential and the private property of SnertSoft. Under no circumstances will SnertSoft resell or release this information to third parties, unless demanded by court order.
Support
Support is only provided for the Author's original Package. Priority support can be purchased. Free support is limited, based on the Author's availability, though enhancements requests and problem reports are welcome. A community mailing list is available; please refer to SnertSoft web site Support area for details.
Gifts
Gifts from the author's Amazon US or Amazon UK wishlist (search by mail address <achowe at snert dot com>) are welcomed for the continued encouragement, moral support, and ego pumping needed to work in foreign non-english speaking lands.
14291 Eat-More bars since 24 January 2004