Oct 20, 2021 10:51 PM
is there any way to Web Scrape Data from Websites into Airtable? It’s actually just a single row I need.
Oct 21, 2021 02:13 AM
You may want to check out Airtable’s web clipper app for Chrome:
Oct 21, 2021 02:18 AM
Hi @Marcel_Tanbic and welcome to the Community !
Possible : yes BUT…
manually : WebClipper ;
programmaticaly by Scripting API(s):
Take a look at this thread (multiples answers including reflexions.)
A personal periscope shot on the subject brings me to this but it’s not a current priority in my own tech watch and development topics!
It’s just to show you in which direction I was looking to go in 2020, 2021.
Oct 21, 2021 03:29 AM
Thanks for the quick reply! I’ve already got the Webclipper, but I’m more likely looking for a Script because there are about 80 URLs on one Website I need to check. Already tried some stuff, but nothing worked or just with big effort…
Oct 21, 2021 05:43 AM
Here’s a tool that provides APIs for scraping:
Oct 21, 2021 07:44 AM
To add to what @ScottWorld suggested - Simplescraper has a tutorial for scraping into Airtable.
I’ve used Simplescraper multiple times and it’s awesome. I haven’t used it to scrape into Airtable…yet!
Oct 21, 2021 07:47 AM
Oh wow, I didn’t even know that they had direct integration with Airtable! Thanks, @Hannah_Wiginton!! :cowboy_hat_face: :raised_hands:
Oct 22, 2021 01:33 AM
Thats pretty much what I was looking for. Thanks a lot for all the replys guys :slightly_smiling_face:
Nov 10, 2021 04:26 AM
@Hannah_Wiginton @ScottWorld hello. when i go to the integrate area, i only have google sheet and webhook. Airtable is not in. any idea?
thanks for your reply
Nov 26, 2021 08:07 PM
Hey Remy, if you visit the dashboard at: Simplescraper — Scrape Websites and turn them into APIs you’ll find the Airtable integration.
Jan 24, 2022 12:32 AM
I’ve had this happen a lot=( I’ve been looking for a personal data protection app for a long time. I think it makes sense for any user to protect their traffic, especially if you have your own business directly related to the net and you need to analyze data. I use proxycrawl.com, it has lots of features - I like its API scanner and relatively low price in the market of similar programs. You can also retrieve complexly structured websites using their built-in parameters to precisely locate items. I don’t need to worry about IP blocking anymore. It offers IP proxies that automate IP addresses and leave invasive web sites undetected.
Jun 28, 2022 05:30 AM
There are actually much easier ways to scrape data from any website directly to Airtable.
We use Bardeen.ai for this.
Essentially, you first create a scraper template for a website (which takes a few minutes), and then map that data to Airtable.
I’ve been using it to scrape individual LinkedIn pages to Airtable.
Oct 25, 2022 02:56 AM