Help

Re: Is there a limit of webhook triggered automation runs per minute/second

2801 1
cancel
Showing results for 
Search instead for 
Did you mean: 
Jaco
5 - Automation Enthusiast
5 - Automation Enthusiast

We have built an automation that syncs data from our CRM with Airtable. Each insert/update/delete in the CRM post a message to a webhook created from an Automation. This works perfectly fine for single transactions in the CRM but for a bulk update or an import in the CRM of e.g. 500 records it only processes a limited number of records (e.g. 168 out of 800).

Is there a limitation in the number of instances of a script that can run in parallel? And if so, is there a way in Airtable to work around this as I have no idea to buffer the webhooks coming in.

14 Replies 14

I’m not sure if there is a limit to how many times a webhook can be triggered per minute/second. You may want to email support@airtable.com about that, and post back here with what they say.

However, there are 2 other limitations:

  1. Each webhook request has a maximum payload size limit of 100kb per request. So if you’re sending 800 records at a time to your webhook, it’s possible that you’re going over the 100kb limit.

  2. Your billing plan for your workspace will give you a limited amount of automation runs that you can execute per month. Each triggered webhook counts as one automation run.

If you’re continuing to have problems with Airtable’s webhooks, I would highly recommend using the professional webhooks from Make, because they have no limits at all. No size limits, no run limits, and no limits on the number of times that you can trigger a webhook. They also offer custom webhook responses and custom mailhooks, too.

One webhook will not include 500 changed records from the CRM. Pretty sure this is not what’s happening.

So, I could run a trillion webhooks and there would be no phone call or consequences from Make?

Importing a big change into the CRM typically impacts any outbound webhooks one record at a time. But, this is likely to be very fast and will overload the available webworkers on the Airtable webhook receiver which I think is limited to five simultaneous workers at a time (I suspect records in excess are simply ignored by Airtable). I have a hunch the limit is identical to the API limit (5 per second I think).

The challenge is to throttle the CRM at times like this by ensuring that bulk injections include a status field of some type that either the CRM uses to avoid firing the web hooks or such field is used on the Airtable side to ignore such bulk entries. Then, use a more gated process to introduce these new uploaded entries into Airtable in a distributed fashion over time such as when that status flag is lifted, allow it to be posted to Airtable.

Adam_Minich
Airtable Employee
Airtable Employee

Hey @Jaco,

Adam here from the Airtable Support Content Ops team. Great question on the limit. Currently, the limit is 5 webhook requests per second along with the other 100kb size limit that Scott mentioned. I’ve gone ahead and updated our documentation to reflect that in the FAQs section. Hope this helps and thanks for tagging me in @ScottWorld

Hi @Adam_Minich,

Thanks! In your post above, you wrote 5 requests per minute, but in the FAQ on the support article, it says 5 requests per second. Is it 5 per second or 5 per minute?

Thanks,
Scott

The limit on automation runs is per workspace, not per base.

Oh wow, thanks for clarifying. That’s an even greater restriction than what I thought it was! I’ve edited my post above.

Jaco
5 - Automation Enthusiast
5 - Automation Enthusiast

I had some conversations with Airtable staff on the issue and they explained:

  • Each individual automation can run max. 5 per second – if you request more (like I did, they are simply ignored: e.g. processed 168 out of 800 during a batch update).
  • You can trigger max. 50.000 automation runs per month (Pro) and 500.000 per month (Enterprise) for each base.

@Adam_Minich of Airtable will need to clarify for us whether this is 5 per second or 5 per minute.

As @kuovonne mentioned above, this is (sadly) per workspace, not per base. @Adam_Minich It might be nice to clarify this on Airtable’s pricing page.

Whoops! Fixed that. It’s per second.

Thanks, @Adam_Minich! :grinning: Do you think that the pricing page could be updated to let people know that automation runs are per workspace instead of per base?

@ScottWorld Sure thing! Forgot to add that to my response. I requested that the pricing page be updated to mention the per workspace limit and/or link to the support article that discusses this limit in more detail.

Cheers!

That’s fantastic! Thanks so much, @Adam_Minich!!

@ScottWorld My (limited) understanding of Make is that it also uses webhooks to access Airtable. Wouldn't those webhooks also count against the limit of 10 per base?

I'm just starting to build out some automation scripts and Make scenarios, and I'm weighing this whole webhook thing carefully. Make isn't going to help if I need 20 scenarios that use webhooks.

ScottWorld
18 - Pluto
18 - Pluto

Hi @Jean_Thoensen,

No, you can create an unlimited number of webhooks and/or mailhooks in Make and use them with Airtable.

Airtable's limit only counts when you are using their own internal webhooks, and they are also extremely difficult to use, so it's best to use Make, where everything is extremely simple & straightforward.

I created a brief navigation video for Make here. And I also provide the links to a few other Make training resources there as well (some of which cover webhooks in more depth). For example, to instantly trigger your webhook scenarios from Airtable with a script instead of a button, check out this thread

p.s. If you have a budget for your project and you’d like to hire an expert Airtable consultant to help you with any of this, please feel free to contact me through my website: Airtable consulting — ScottWorld