OpenAI's API for GPT-4 constantly has an over 30sec delay in responding to larger token prompts.
This makes automation in AirTable rather useless unless you go to the trouble of building cloud functions.
I have multiple working automation steps to categories data, create short email replies etc. But if you want to do anything real with GPT-4 it's limited by the response time.
Question - how can I get around this? Any thoughts?
You are going to have to use a different service that isn’t limited by the 30 seconds of Airtable scripting automations.
One option is to use Scripting Extension in a “data” view, which is not limited to 30 seconds. However, you cannot access Scripting Extension from an interface. To do that, you would need to use a third party integration service that isn’t subject to the same time limits, such as Make.com.
For make OpenAI API Calls i usually use another service:
n8n ( ℹ️ affiliate link--> https://www.fillout.com?ref=yeswelab) that work very well for this purpose.
Making in the automation a script block with a fetch request to a n8n Webhook that make a trigger (giving the recordID as parameter).
Then in the n8n flow, i retrieve everything i need from airtable, make openAI calls and update back to Airtable.
I hope it helps.