Unable to create more than 100 records using batch processing

[Amit_Erandole]

I am subscribed to a Pro plan and am using Airtable to migrate our existing CMS which is just a MySQL table.

I need help adding 40000+ records from that mysql table. I am aware of the upper 100 limit for the api. So I wrote a custom node script that inserts 100 records at a time while reading them from my table.

I managed to import 200 records in a single shot successfully just an hour ago. But now when I try to add more (say 1000 at once) I start getting these errors:

{
error: 'SERVICE_UNAVAILABLE',
message:
'The service is temporarily unavailable. Please retry shortly.',
statusCode: 503 }

{ Error: connect EADDRNOTAVAIL [35.153.165.44:443](http://35.153.165.44:443/) - Local ([0.0.0.0:0](http://0.0.0.0:0/))
at internalConnect (net.js:884:16)
at defaultTriggerAsyncIdScope (internal/async_hooks.js:294:19)
at GetAddrInfoReqWrap.emitLookup [as callback] (net.js:1031:9)
at GetAddrInfoReqWrap.onlookup [as oncomplete] (dns.js:62:10)
errno: 'EADDRNOTAVAIL',
code: 'EADDRNOTAVAIL',
syscall: 'connect',
address: '35.153.165.44',
port: 443 }

What am I doing wrong? How Do I fix this?

[W_Vann_Hall]

Typically, a 503 means the server isn’t keeping up. That might be because of some abnormal server or network load that’s coincidentally hit — or it might be because your requests are hitting faster than 5/second. (I know it’s supposed to return a 429, but I’ve had instances where I got a 503 after I munged someone’s pacing code.) Try inserting a delay after every block of 5 requests, and see if that at least changes the symptoms. :winking_face: