Inbound email filtering beyond Rules

Status
Not open for further replies.

Starbuck

Member
Outlook version
Outlook 2010 32 bit
Email Account
POP3
It looks like microsoft.public.outlook is largely inactive so I'm reposting this here. I used to post in the SlipStick forum but this is my first posting here. I apologize if this isn't the right place for this inquiry.

I'd like to understand how Outlook 2010 Rules have improved over v2003.

Several years ago I found limitations in Outlook 2003 Rules. Outlook would behave weirdly and crash if there were too many rules. It also doesn't deal well with rules for non-standard headers. My solution was to create a series of VBA scripts that processed inbound emails against an external file of rules. Each rule in the file identifies a header, a condition, a value to match the condition, and the target folder when a match is made. Examples:

SenderEmailAddress|includes|linkedin.com|\\Personal Folders\Inbox\Registered Sites\LinkedIn

List-Id|is|<foo.googlegroups.com>|\\Personal Folders\Inbox\Lists\Active\Foo

X-Server-From|includes|zzz.org|\\Personal Folders\Inbox\Lists\Active\ZZZ List

From|includes|zzzz.zzz|\\Personal Folders\Inbox\Company1\Clients\ZZZZ

To|includes|sales@company2.com|\\Personal Folders\Inbox\Company2\C2 Sales

Reply-To|includes|@yyy.com|\\Personal Folders\Inbox\Lists\Inactive\YYY


A form is available in my toolbar which allows easy creation of these filters with a mail item and folder selected.

Prior to that processing, if an email matches an existing Contact, I have a path to the folder where emails from that contact should go. Example:

=MOVETO:\\Personal Folders\Inbox\Company2\Clients\ZZZZ=

Further, once the disposition of an email is determined, all non-essential headers are removed to help keep the size of my PST down.

So all of this sophisticated handling (yes, and much much more) is in Outlook 2003 VBA because Rules just didn't cut it. I have bypassed v2007 and am installing a new system with Outlook 2010.

My questions are:

1) Do I need to continue using my scripts to get this level of

filtering in Outlook 2010?

2) Is there a commercial "uber filter" out there?

3) Should I convert my filters into addins and sell them? :D

4) Is there a better forum/venue for these questions?

Thanks!!!
 

Diane Poremsky

Senior Member
Outlook version
Outlook 2016 32 bit
Email Account
Office 365 Exchange
Microsoft shut down their nntp servers about a year ago. :( This is the slipstick forum- it just has its own domain now. :)




1. Yes i think you will need to keep using your scripts. While rules have improved, its mostly to add more actions or conditions.


2. There are very few commercial filters available and i don't think any are as detailed as your filter - i use Auto-Mate because it can apply rules to mail after a period of time. None of the commerical options can remove headers, that i know of.


3. YES!!!! If you do, let us know and we'll mention it in our newsletter and on our site. http://www.slipstick.com/new-or-updated-product-submission/


4. There are other forums but none are better - some are worse. Microsoft has a forum at answers.microsoft.com but its staffed by contractors who don't know outlook.
 

Starbuck

Member
Outlook version
Outlook 2010 32 bit
Email Account
POP3
Wow, thanks for the prompt response, Diane. Your enthusiastic response to #3 is particularly interesting. Searching this forum I see people asking about filters and thinking "hey, my macros do that". Auto-Mate seems to be one of just a very few options available, and while a competent offering it does have its limitations. With email filtering being so important I'm really surprised that this isn't a saturated market niche after so many years.

Indeed, as time permits I'll migrate this functionality into an addin which can be loaded by others. I've written a lot of addins for myself and clients but haven't undertaken anything for general market consumption, and nothing for v2010 yet. It's about time.

Based on what you see in my original post, please feel free to post here or PM with feature suggestions. Since I don't use Exchange Server yet my initial target audience would only be PST users. If the Exchange user base is huge enough to warrant a re-focus, please let me know. Other implementation suggestions are welcome.
 

xbliss

Member
Outlook version
Outlook 2010 32 bit
Email Account
What are the best or top extensions/ add-ins for Outlook that have BETTER filtering/ sorting rules than Outlook itself.

I'd hope for something that supports:

- Variety of Boolean combinations

- Regular Expressions

Or are there some user scripts / VBA ones created by someone in this direction?
 

Starbuck

Member
Outlook version
Outlook 2010 32 bit
Email Account
POP3
What are the best or top extensions/ add-ins for Outlook that have BETTER filtering/ sorting rules than Outlook itself.

I'd hope for something that supports:

- Variety of Boolean combinations

- Regular Expressions

Or are there some user scripts / VBA ones created by someone in this direction?

Based on this thread I did create an Outlook 2010 addin which does excellent filtering. I haven't published it because there seem to be issues when run over WinXP and we just haven't had the time to really beat it up for a production release.

For any mail item you can right click a folder and select a new context item "Advanced Rule Builder". That opens a form which displays significant headers and the current email's values. Select a header/value, and then select how a new rule/filter will select on this: Equals value, IsNot value, Starts With, Ends With, and Includes. The value can also be tweaked, for example, to change "FromAddress EndsWith @anydomain.tld", so a single filter can be set for an entire company.

From there the filter is added to a list, of rules that gets processed for each mail item. Sorting and moving the rules around is easy, so that you can quickly position the new rule to get executed higher up than others. For example you might want to put the above filter above a check for spam to ensure "spammy-looking" emails from a trusted partner still get through.

Of course this all works on the new item trigger, so new items get filtered, and grouping Unread Mail by folder shows all mail neatly organized.

All of that works much like the default Outlook rule builder but it's much more robust and user-friendly. You can right click any mail item and select Test Filter to see where it would go using the current set of rules, and then Filter to actually send it where it belongs. This is helpful if you revise filters and want to do a mass migration of items to their new home.

It does not yet include regular expressions but that can easily be added. I wanted to go forward with a v1.0 and then add regexps to a v1.1+.

In addition to a couple minor anomalies which prevent me from taking this public, I was concerned that Outlook 2013 was going to be a game changer for addins, so I stopped development. I've only recently realized that wasn't true, that O2013 wasn't bound hand-in-hand with Office365 and that my code "should" port without issues. Considering most people don't upgrade to a new release for some number of years I should have realized that doing a v2010-only cut would have a long life-cycle. Considering this should work with v2003 all the way through v2013 now, I know I should spend more time on this but I just haven't done it. As I think about this, I'd bet that just one corporate sale of a couple hundred low-cost licenses would justify the effort. But that also means I need to build an elegant licensing/activation model into this. That's just another tier of grief.

So ... All of this is within reach of any company that's interested, I just need the right "motivation" to complete the effort.

I hope that properly responds to your post ... and then some.
 

Diane Poremsky

Senior Member
Outlook version
Outlook 2016 32 bit
Email Account
Office 365 Exchange
What are the best or top extensions/ add-ins for Outlook that have BETTER filtering/ sorting rules than Outlook itself.

I'd hope for something that supports:

- Variety of Boolean combinations

- Regular Expressions

Or are there some user scripts / VBA ones created by someone in this direction?

There are very few. I use Auto-Mate because it supports moving mail after it arrived. VBA works ok (either run a script or itemadd), but it's really best for a limited number of rules.

processing-incoming-e-mails-with-macros
 

xbliss

Member
Outlook version
Outlook 2010 32 bit
Email Account
Based on this thread I did create an Outlook 2010 addin which does excellent filtering. I haven't published it because there seem to be issues when run over WinXP and we just haven't had the time to really beat it up for a production release.




For any mail item you can right click a folder and select a new context item "Advanced Rule Builder". That opens a form which displays significant headers and the current email's values. Select a header/value, and then select how a new rule/filter will select on this: Equals value, IsNot value, Starts With, Ends With, and Includes. The value can also be tweaked, for example, to change "FromAddress EndsWith @anydomain.tld", so a single filter can be set for an entire company.




From there the filter is added to a list, of rules that gets processed for each mail item. Sorting and moving the rules around is easy, so that you can quickly position the new rule to get executed higher up than others. For example you might want to put the above filter above a check for spam to ensure "spammy-looking" emails from a trusted partner still get through.




Of course this all works on the new item trigger, so new items get filtered, and grouping Unread Mail by folder shows all mail neatly organized.




All of that works much like the default Outlook rule builder but it's much more robust and user-friendly. You can right click any mail item and select Test Filter to see where it would go using the current set of rules, and then Filter to actually send it where it belongs. This is helpful if you revise filters and want to do a mass migration of items to their new home.




It does not yet include regular expressions but that can easily be added. I wanted to go forward with a v1.0 and then add regexps to a v1.1+.




In addition to a couple minor anomalies which prevent me from taking this public, I was concerned that Outlook 2013 was going to be a game changer for addins, so I stopped development. I've only recently realized that wasn't true, that O2013 wasn't bound hand-in-hand with Office365 and that my code "should" port without issues. Considering most people don't upgrade to a new release for some number of years I should have realized that doing a v2010-only cut would have a long life-cycle. Considering this should work with v2003 all the way through v2013 now, I know I should spend more time on this but I just haven't done it. As I think about this, I'd bet that just one corporate sale of a couple hundred low-cost licenses would justify the effort. But that also means I need to build an elegant licensing/activation model into this. That's just another tier of grief.




So ... All of this is within reach of any company that's interested, I just need the right "motivation" to complete the effort.




I hope that properly responds to your post ... and then some.





I would love to beta test and help you with this and maybe come up with more variations / variety on it. Let me know.




There are very few. I use Auto-Mate because it supports moving mail after it arrived. VBA works ok (either run a script or itemadd), but it's really best for a limited number of rules.




processing-incoming-e-mails-with-macros





Thank you for the insights. I just wish we had better ability to filter and sort emails based on rules and regular expressions.
 
Status
Not open for further replies.
Similar threads
Thread starter Title Forum Replies Date
J Edge + TMG 2010 No email inbound/outbound and cannot telnet to port 25 on TMG Exchange Server Administration 0
Steven 2007 New PC vs Old PC - Micro Font on Inbound Emails :( Using Outlook 4
S How can I create a rule to move inbound emails from any of my contacts out of Inbox? Using Outlook 1
Sarge USMC Outlook 13 not displaying POP inbound emails Using Outlook 12
S Hub transport ex2007 - monitoring inbound Exchange Server Administration 2
B Capture Inbound E-mail Subject with VBA Outlook VBA and Custom Forms 4
B Initiate VBA as a result of inbound e-mail? Outlook VBA and Custom Forms 1
Rupert Dragwater How to permanently remove an email address Using Outlook 9
K vba code to auto download email into a specific folder in local hard disk as and when any new email arrives in Inbox/subfolder Outlook VBA and Custom Forms 0
F Auto changing email subject line in bulk Using Outlook 2
F Want to add second email to Outlook for business use Using Outlook 3
kburrows Outlook Email Body Text Disappears/Overlaps, Folders Switch Around when You Hover, Excel Opens Randomly and Runs in the Background - Profile Corrupt? Using Outlook 0
J Outlook 365 Outlook Macro to Sort emails by column "Received" to view the latest email received Outlook VBA and Custom Forms 0
A Outlook 2019 Help with forwarding email without mentioning the previous email sender. Outlook VBA and Custom Forms 0
J Macro to send email as alias Outlook VBA and Custom Forms 0
M Shift Delete doesn't delete email from server Using Outlook 4
K Incorporate selection from combobox into body of email Outlook VBA and Custom Forms 0
L Why are some email automatically going to "archive" Using Outlook 2
M Outlook Macro to save as Email with a file name format : Date_Timestamp_Sender initial_Email subject Outlook VBA and Custom Forms 0
B Outlook 2019 Custom Email form - Edit default email form Outlook VBA and Custom Forms 6
F Add a category before "Send an Email When You Add an Appointment to Your Calendar" Outlook VBA and Custom Forms 0
T Problem when requesting to view an email in a browser Using Outlook 0
J Outlook 365 Forward Email Subject to my inbox when new email arrive in shared inbox Using Outlook 0
HarvMan Archive Email Manually Using Outlook 1
L Fetch, edit and forward an email with VBA outlook Outlook VBA and Custom Forms 2
S New Email "From" box stopped working Using Outlook 0
Rupert Dragwater Duplicate email in Folder Using Outlook 8
M "Attachment Detacher for Outlook" add in, does it update the server copy of the email? Using Outlook 1
W Outlook 365 I am getting the "Either there is no default mail client" error when I try to send an email on excel Office 365 Using Outlook 1
MattC Changing the font of an email with VBA Outlook VBA and Custom Forms 1
L Specific Incoming Email Address Immediately Deleted Using Outlook 2
Witzker Outlook 2019 Macro to send an Email Template from User Defined Contact Form Outlook VBA and Custom Forms 0
Witzker Outlook 2019 Edit contact from email does not open the user defined contactform Using Outlook 3
V Macro to mark email with a Category Outlook VBA and Custom Forms 4
R Roadrunner Email Settings | Contact Roadrunner Customer Support Outlook VBA and Custom Forms 1
D Gmail mail is being delivered to a different email inbox in Outlook App 2021 Using Outlook 2
Albert McCann Outlook 2021 Outlook Display of HTML Email from two senders is glitchy Using Outlook 0
A How Do I Setup My Optonline.Net Email Account? Outlook VBA and Custom Forms 1
H Preventing the 'email address fetch from Exchange' crashing email reading code Exchange Server Administration 0
D multiple email accounts - why do I have to choose the "from" account address?? Using Outlook 2
Wotme create email only data file Using Outlook 1
F Outlook 2016 Email with attachments not being received Using Outlook 3
J Outlook 2019 Regex email addresses from body Outlook VBA and Custom Forms 6
D Prompt to prefix subject line whenever sending an email Outlook VBA and Custom Forms 3
J Quick steps delete original email and move reply/sent email to folder Using Outlook 2
C Wishlist Extract or scan new email addresses from out of office replies. Leads from OOO replies Using Outlook 1
T External email warning banner Outlook VBA and Custom Forms 0
A Links in email getting error message about group policy Using Outlook 4
richardwing Auto forward email that is moves into a specific outlook folder Outlook VBA and Custom Forms 5
J Recommendations for Outlook Duplicate Email Remover Using Outlook 6

Similar threads

Top