Far easier to utilize the Airtable SDK and script features. You don’t need Node (because Airtable has Node), and you don’t need an external process (because Airtable supports this type of stuff internally). Works with automation script, script extensions and custom apps, and the SDK makes it far easier to capture and store your scraped results into Airtable records/fields.
CAUTION: Scaping Google search results is a ToS violation, so I advise anyone doing this to do it right and above-board using a Google search API or any third party that can abstract your work away from a potential ToS violation.
Example…
output.markdown('# Google Search Example');
let url = "https://www.google.com/search?q=Airtable+is+Cool&rlz=1C5CHFA_enUS908US908&oq=Airtable+is+Cool&aqs=chrome..69i57j69i64.3994j0j7&sourceid=chrome&ie=UTF-8";
output.text(url);
let options = {
"method": "GET",
"headers": {
"Content-Type" : "application/json",
}
}
await remoteFetchAsync(url, options)
.then((resp) => resp.text())
.then(function(data) {
output.inspect(data);
})
.catch(function(e) {
output.markdown("ERROR!");
output.markdown(e.message);
});
