Nov 30, 2019 06:12 PM
Hello, Who has achieved some (or all) of these 3 goals, and has a solution already in place? I’m looking for a way to achieve these goals. Thank you so much in advance for sharing your wisdom. I’m looking through the Intergromat integration list of all the email tools, and I bet some of you are familiar with some of the tools that will meet my vision. And, perhaps even a direct AirTable integration not involving Intergromat – that would be magical. Lol, currently lost in the sea of reviewing all these tools and would LOVE your advice on what tools match for my vision. Thank you SO much in advance. It’s a bit time sensitive.
Which of these pictured here do you like and also matches my goals/criteria outlined below? Or any others that integrate with Intergromat and/or AirTable directly, that you know of? ClickSend integrates as well. These are all tools that integrate with Intergromat.
Background Info:
Goals:
Goal #1) Send 1:1 emails one-at-a-time custom-written (not mass email with mail merge) (email addresses are in AirTable), and have info about if the email was opened/clicked/etc show up in AirTable. I will create a separate table for the communications and have it link to the contact records in the main table. What tools have you used or super familiar with that that match my goals and needs?
Goal #2) Send batch emails (email addresses are in AirTable) where can segment contacts based on a single-select field for example so half the contacts receive one email body and the other half receive a different email body while including the contact’s individual name in each email, and have info about if the email was opened/clicked/etc show up in AirTable, as well as scoring info (defined below). I will create a separate table for the communications and have it link to the contact records in the main table. What tools have you used or super familiar with that that match my goals and needs?
Goal #3) Have emails that I send and receive (in Outlook desktop not online 365, my provider is GoDaddy and then my emails appear in my desktop Outlook) have a copy automatically move to AirTable, with subject and body. I will create a separate table for the communications and have it link to the contact records in the main table. Specifically, only emails that are in a specific folder in my Outlook and/or match an email address that is in my AirTable CRM. Note: I am not looking to switch my main email to Gmail, as I love Outlook, but open to Outlook online if really needed. What tools have you used or super familiar with that that match my goals and needs?
Additional Requirements for goals #1-3:
Thanks so much for sharing tools that work well for you with that match these goals and criteria. Note: I’m looking for advice and not a custom development consulting proposal.
Nov 30, 2019 06:17 PM
(I moved this additional info up into the original post, so deleted it here)
Dec 01, 2019 07:56 PM
Hi @Brenda_Ginsberg,
It’s the weekend, I’m a bit under the weather right now, and what you want to accomplish is one of the most in-depth requests I’ve seen on here. That said, I’m going to try to give you some preliminary help since you said this was time-sensitive. Please bear in mind that I might not have retained everything I read in your message because I have a lot of medicine in me at the moment. :slightly_smiling_face: I will try to help more once I hear back from you and am, presumably, feeling better.
Here are some quick bullet points that’ll answer some questions:
Okay, I’m running out of steam here so that’s about all I’ve got for tonight. If this is truly time-sensitive, you might have an unrealistic expectation. This is actually a fairly simple thing to do whether you’re writing code or using a no-code service like Integromat and it’s the complexity of the setup that makes it so much work. You have to figure out how a bunch of moving parts and variables fit together. In my opinion, code is actually one of the easiest parts of software development. It’s the overall design and structure of the software that’s quite complicated in many cases. Code is just a syntax you can use to write solutions to problems. Integromat is a graphical user interface that replaces the need to learn a syntax.
Unfortunately, nothing can replace the structural design necessary to create custom software. There’s just a lot to figure out. That said, if you can take it one step at a time, and dedicate a enough time to working through each goal, you can make whatever you want. It just may be unrealistic to expect to do this quickly when you don’t know exactly how to put it together. If you’ve got a week or two, however, you should be able to pull it off (and you can have parts of it working as you go).
Anyway, I hope this is a helpful beginning. I realized, as I got into this, that what you want to do requires a pretty enormous amount of explanation. :slightly_smiling_face: I’m not really equipped to provide that right now but, regardless, I think it’s a good idea for you to think about this stuff and respond so I can help you figure out the best approach.
Dec 01, 2019 09:54 PM
thank you for your information.
Dec 01, 2019 10:55 PM
You are wonderful and I thank you so very much. I hope you feel well soon. I will re-read your advice when I am fresh during the daytime so I can understand it more fully.
One clarification to share is that for goal #3, I’m looking to (a) continue to send and receive my emails in Outlook (not switch all emails to only go to AirTable), and (b) have the email data from emails I send and recieve (such as the sender name & email / receiver name & email / subject / body) automatically go into fields in an AirTable table, likely matched by email address as the unique identifier. I receive boty important emails as well as many more emails that do not belong in my AirTable CRM (e.g., spam, newsletters, event lists, personal emails). So, my goal is for only the business emails to go into the AirTable CRM, which I think is best by having some process and/or tool (what process/tool is where I need advice, and how to implement) either: (a) check new emails sent and received to see if they match a contact in my AirTable CRM based on email ID, or (b) having it check a specific Outlook search folder where I tag the category ‘Add to AirTable’ since I already add a tag category to business emails so I can see them in one concise place away from the clutter of less important emails. Ideally, it can check this and add the email info to the AirTable fields as well as adding a contact if they are not already in my AirTable, after checking two email fields in case of a secondary email for the same contact.
Also, for the info re: clicks/opens, I was thinking of using a email marketing service that is one of the ones in the photo above, and asking which matches my goals. But I’m now intrigued about if this is possible without a 3rd party tool as well, as you mentioned may be possible.
When you are rested and feel well, I welcome your thoughts. Gratefully appreciative.
Dec 04, 2019 06:54 PM
Hi @Brenda_Ginsberg,
I understand that you still want to use your email outside of Airtable. Sorry if I wasn’t clear about that. That’s why I was suggesting that sync’d emails end up in a separate table. That said, if you want to limit which emails gets sync’d to Airtable based on the contact list you store in a separate table in your base you can definitely do that—it’s just a lot more involved than separating sync’d emails from the ones you send. But I suppose if this is a CRM you don’t really want messages in two places. :stuck_out_tongue:
So, let’s address that first because it’s one of those things that’s elementary in regards to the steps you need to take to implement but the sort of thing that will tie your brain in knots as you sort out which steps you need to take. Here’s an outline of how a scenario in Integromat (or zap in Zapier or any similar trigger/action integrations service) would work to sync emails you receive:
Trigger: Set up an Email trigger (that uses an IMAP connection to your email account—you’ll set this up similarly to any desktop or smartphone mail client) that watches for new messages as they come in. Make sure you set your connection up to look for mail in your inbox (or a folder that contains the messages you want Integromat to look for) and to limit messages per cycle to just one. By default, Integromat will pull two new messages at a time. That’s a nice feature but it you don’t want to use it in this situation. You can also use advanced settings to filter emails in advance, which can be useful if you know the emails you want to get into Airtable will always contain a specific word or phrase in them.
Action: Set up a search action that looks at the contacts table in your Airtable base. You’ll need to filter the records to only show a single recipient by using an Airtable formula. That setup will look something like this:
You’ll notice that the contact field has a blue ID tag in it instead of the usual read ones. The red ones refer back to the email message that was caught by Integromat and the blue ID comes from the contact record Airtable found. This is because I’m showing you the most reliable and manual setup.
You can ask Integromat to try and map fields for you and you can also request that it let you use the email address instead of the record ID as a means of linking one record to another. This is a really nice feature to simplify the process. Currently, Zapier doesn’t allow this so I’m trying to keep things more generic in case someone using Zapier wants to do this someday and finds this post. Also, you’re less likely to run into problems if you work with IDs because they’ll always be unique. (There are a lot of specific reasons why, but they’re not worth getting into right now.)
After that you should just send a test email to yourself (from an address in your contacts table) and run the scenario once to make sure it works. If it does, set it on a schedule and all email senders that match the addresses in your base’s contacts table will be logged to the messages table automatically.
I threw a very quick base together just to make sure I didn’t give you any bad information/miss anything important, so you can check that out below if you want to see how everything matches up with the Integromat screenshots.
Start out by getting that to work with your base and email account and then we can talk about sent messages. It’s a bit more complicated to sync those because you’re sending from within Airtable as well. I think the best approach would be to send messages in Airtable from a separate table so you can just sync sent messages freely. That would treat the messages table as more of a message log so that messages you send from within Airtable don’t need complex routing and logic to deal with duplicate detection and other really annoying problems. Code or no code, I promise that’s a headache you want to avoid. :slightly_smiling_face:
If you just sent up sync the simple way, you can basically just create an almost identical scenario that looks for sent mail instead. The easiest option would be to set up a separate connection to your email that monitors the sent folder instead of your inbox, duplicate the received email scenario, tell it to look at the recipient instead of the sender (because you’re the sender in this case), and then leave everything else the same. But we can worry about that once you have this first part up and running.
Oh, and just in case this wasn’t assumed, you can absolutely work with more fields than I did in this example. I just wanted to keep it simple for explanation purposes/to save time. There’s a TON of other metadata you can save from every email so you can add as much as you want.
Now, for the open/click tracking, the situation is like this: if you use a third party service or roll your own solution you’re still going to be dealing with tracking pixels. I’m not aware of any other way to track opened emails and a quick search suggests there isn’t any other method currently available. Pretty much every third-party email marketing tool/service will provide this kind of tracking but, like I said before, it’s not the most reliable and there are downsides to implementing this yourself and using a service to do it.
I’m not familiar enough with email marketing services to know which ones allow for specific API calls to grab tracking data from their platforms. After looking through many options on Integromat, however, they’re just not available as triggers you can use. There’s no way to sync this data without making an API call and that requires the service to support that type of API call in the first place. Beyond that, each service has a different set of requirements for sending messages and that can include having all recipients registered with that service. That would mean you’d also need to sync all your contacts in Airtable through a separate Integromat scenario. This isn’t hard to do but it requires Integromat to check and update a lot more which means the likelihood of additional costs. That said, I don’t think it’d take you over the $9/month plan—it’s just likely to make it impossible to use the free tier and it’s one more moving part in your setup. You want as few scenarios as possible because if something goes wrong you’ll have an easier time figuring out the source of the problem.
Anyway, if you want to go this route you’ll need to make an API call. I don’t know enough about the pros and cons of these services to recommend the most ideal candidate but I am familiar with Sendgrid and it does support the API call you need to make (I can’t link to it directly but you want to look in the email activity section). You can track all kinds of message-related events through Sendgrid but you will have to poll the API frequently, for every message, in order to do this. If you had 1,000 messages in your base you would hit the action cap of the $9/month tier on Integromat in a matter of hours. It’s just a really inefficient method.
Webhooks are used to avoid all this unnecessary polling. Basically, the service you choose would instead poll Integromat directly whenever a specific event occurred (an opened email or a clicked link). If you look at Sendgrid’s API documentation you’ll see they have a webhooks section and it also supports the events you want. So while I can’t recommend a service by comparison I can say that Sengrid can do what you want and it’s possible it can do it for free depending on your volume. If your volume is over 100 messages per month, however, you’d go from free to $15/month right away.
Also, this kind of webhook setup isn’t an easy one. You have to set up a webhook trigger scenario in Integromat, get the URL it generates, provide that URL to Sendgrid (or whatever other service you choose), send test data to the webhook through Sendgrid (or other service), see what you get in Integromat, create a conditional router to determine the event status, and then have that router lead to a series of actions very similar to the email sync setup—but for every possible route. It’s not a simple setup. It’s do-able, but it’s a lot of time and effort for one little thing. That’s why I suggested skipping this or just implementing it last because it’s the hardest part. At least, at the end, you’ll have more experience and it won’t feel as complicated to pull off.
But there’s also the DIY option. You can use Integromat’s webhooks to both create the webhook URL and generate the desired response. I haven’t tried this myself, but since you can set the headers of the response you technically should be able to make it provide data that’s considered an image and can be used as a tracking pixel. You’d just need to have a unique tracking URL per message, but that’s easy to generate in Airtable and I’m trying to avoid the specifics until you know how you want to do this (and have the easier stuff taken care of). Since you can set headers it’s also potentially possible that you can create an HTTP redirect this way, and that’ll be necessary for tracking clicks in your emails. That part should be a bit easier to sort out.
The DIY option will require less work to set up but slightly more effort to facilitate (most likely) when you want to track things. Getting it to happen automatically might be possible but it’ll depend on how you want to compose messages sent through Airtable. Right now you can’t officially use rich text in your base so you’d have to send naked URLs. That said, the rich text field is in beta right now (I think it has been since October) and it solves that problem. Regardless, you still have to assemble tracking URLs somewhat manually. I know some workarounds to make this really simple but we can cross that bridge if we come to it.
Anyway, make sure you can get your received messages sync’d to your base with the process I described earlier and we can tackle sent messages next. Also let me know if you come to a conclusion about how you want to deal with the tracking situation. If you want recommendations on a specific service to use, I’d consider posting about that explicitly on the forum. Just something like “what email marketing service would you recommend?” Then just say it needs to work with Integromat and have tracking features. I think you’ll get more responses with something short and straightforward like that. Also, you can probably get a good recommendation from Zapier. They’re very helpful. Everyone in the company handles customer support regardless of their position so they’re pretty active on that front. Ask them what they’d use in your situation. I’d be very surprised if they didn’t have some recommendation. They may have even written a blog post about it.
Dec 10, 2019 11:21 PM
Adam, Thank you so very much. I am appreciative. I am knee-deep in another project and will jump back to aiming to understand all you shared soon. Just a note of appreciation and to mention I will be in touch soon, hopefully this week before I head on vacation or while in Hawaii or when I return after 12/23. For now… some of the topics that pop into my mind when I go to embark on this… I don’t know how to solve. Curious if you may have a good idea: I do want my Outlook emails to also com into my Outlook desktop tool not only in AirTable… Will that work? Also, I have to figure something out first with my Outlook in how I organize business emails which I manually assign a category in Outlook desktop, as 90% of the email I receive now is non-important mailing lists and emails which I have to solve, so I manually tag each business email which should do daily but sometimes a month may fly by, but that ‘categorized folder’ is my best method yet (love it) of seeing all my business email in one place. I then look at those and add a 2nd category for things to follow-up on or reply to (which shows up in a 2nd categorized folder in my outlook), which I’d love to be able to sync with AirTable. Any chance possible? I have Outlook desktop currently which is not hosted is PC on device only at moment, and I understand I may need to go Outlook cloud somehow. I think if I knew the solution for these things and it’s comfortable, it would make my year by being ready to set up the full email solution we have been messaging about.
Dec 19, 2019 02:39 PM
Hi @Brenda_Ginsberg,
There’s no rush on my end, so just let me know when you’re ready to do more. In the meantime I can answer your questions.
The short answer: Yes. What you want to happen is the default behavior and the easier thing to accomplish. Any email that ends up in Airtable will simply be a copy of the message on the mail server and will not affect the way you normally receive email. If you’d like to know how and why it works that way, I’ll briefly explain below.
So, whenever you check email on a phone or desktop computer the app you use (Outlook, in your case) uses either the POP3 or IMAP protocol to interact with the mail server that stores your email when new messages come in and routes messages you send (among other things).
Just like a web browser uses HTTP (or, ideally, HTTPS) to request a web page, your mail app uses POP3 or IMAP to request information (e.g. your emails) from an email server. The main difference between POP3 and IMAP is pretty simple: POP3 typically removes messages from the server when your mail client requests them (it doesn’t have to but that’s the default behavior) and IMAP leaves everything on the server and just syncs copies with any apps you connect to it. IMAP won’t remove email from a server unless you explicitly delete it from an app you’ve connected to an account.
Integromat only uses IMAP to check email accounts. If it finds any messages, it will make copies and send those copies to an integration. In this case, Integromat sends those copies to Airtable and they’re stored in your base. While I think you can tell Integromat to send IMAP commands to accomplish things like deleting email messages, it will never do this without explicit instruction.
Yes, this is very simple. Instead of having Integromat look at emails in your inbox you can have it only look at emails in a specific folder. I actually included something about that in the setup instructions I posted so, when you start setting that part up, it should tell you when you can select that folder instead of the inbox.
That said, you don’t even really need to take that extra step. Because you said you only wanted emails to be sync’d if they were from contacts in your base, I gave you instructions that include a filtering step. Even if you tell Integromat to look at your inbox, Integromat will not sync any emails that aren’t in the contacts table in your base—that is presuming you follow the instructions I provided as that’s not a default behavior or anything like that.
If you wanted to, it’s possible to add a step to the Integromat scenario that also automatically tags emails from those contacts (in your Airtable base) and moves them into the correct (Outlook email) folder for you. It’s also possible to setup a separate scenario to look at email senders in that folder and add them as contacts in Airtable if they don’t exist in the contacts table already. We can go over how to do that later on if you’d like. Nowadays, you can automate pretty much anything you want as long as you have a consistent set of rules. :slightly_smiling_face:
You don’t have to move to Outlook webmail to do what you want to do. Webmail isn’t much different than a desktop application. It still has to interact with your mail server to get your messages using exactly the same protocols. Webmail only seems different because the messages always stay on the server, but that’s just because webmail applications use IMAP instead of POP3. (If you skipped the long explanation of the first answer and want to know the difference between these protocols, that’s where you’ll find it. :slightly_smiling_face: ).
Rather than switching to a webmail option, you can just switch your account setup in Outlook to check your email using IMAP instead of POP3—if you’re currently using POP3, of course. With POP3, there’s a chance that Outlook will download an email and remove it from the mail server before Integromat gets to it and copies it to Airtable. With IMAP, that won’t happen. Your email provider should have very specific instructions on how to use IMAP with Outlook instead of POP3 and the setup process is almost identical anyway so it should be very easy to switch (if you need to). It’s also possible you’re connecting to a Microsoft Exchange server, but those tend to support IMAP as well and I think they only don’t when the server administrator explicitly disables it. So you should be fine with IMAP in any case. :slightly_smiling_face:
Anyway, I think that’s everything you wanted to know. All the concerns you mentioned are very easy to address or completely unnecessary to address in the first place. You don’t have to worry about any of it.
You can start setting this up and you won’t cause any trouble with your current email system. What you build with Airtable and Integromat will act as a layer on top of your current setup. It won’t change anything in it unless you choose to make it do that. The problems you want to avoid can’t even happen unless you put in extra work to make them happen. :slightly_smiling_face:
Mar 10, 2020 10:27 AM
I have been trying to set up a similar scenario but I got to thinking if I could just click on the email and instead of opening a new email it recalled the last conversation it would solve all 3 goals. Or even set a different record up that recalled the conversation. Some background on my set up: I also mostly use outlook, our mail server is Network solutions but I have all of my incoming mail forwarded to a gmail account as well. We are not apposed to migrating our mail server to something easier to deal with for airtable. Is this a possibility?
Mar 17, 2020 12:42 PM
Is this topic dead? I would love to get something working on this subject. I am still having difficulty getting the email connected with the instructions provided.