Best approach to automate data pulls from unreliable government utility sites?

Sorry, I don’t really have an answer for you, but you might be able to use a web scraping service such as Simplescraper or Apify, and then automate the entire process of bringing that data into Airtable with Make’s automations & integrations. If the automation fails, you could have it pickup again later (on a schedule).

- ScottWorld, Expert Airtable Consultant

Hey ​@george_fang126 are you making API calls, or getting data our of the html directly?

Depending on whether you need login, captha, or others, this could be easily done using an Http Request module/node in Make or n8n. 
 

I’d love to help. Please feel free to reach out. 
 

Mike, Consultant @ Automatic Nation

I think you’ve already got the fetching logic in place, you just want to make it more reliable—without adding any extra tools.

The simplest way I can think of is to start by adding a single-select field called Fetch Status, with options like Pending, Success, and Failed.

Each time your logic runs, it should update the status based on the result—if it works, set it to Success, and if it fails, mark it as Failed.

Then set up a scheduled automation in Airtable to run every few hours. That automation should look for records marked Failed, rerun your logic on them, and update the status again afterward.

Over time, this means that even if the site is slow or unresponsive, Airtable will quietly keep retrying until it finally fetches the bill. This approach won’t require any third-party tools.

Taha, airtableadvisor