Skip to main content

Here is a way to automatically pull information from airtable into Excel via power-Query using a bit of coding.


If you are looking to just copy and paste the code you need without much explanation, ignore the details 🙂




Details

SECTION 1- CONNECTING EXCEL TO POWERQUERY-


The first issue a user may run into while trying to get data to automatically feed into Excel is creating an authenticated connection to Airtable from Excel’s powerQuery. The following code will be used in a later step, but it is given here as a preview of the code that is chiefly responsible for the data connection to airtable’s api.



Source = Json.Document(Web.Contents(“https://api.airtable.com/v0/oPartialAddressToYourBase]/BNameOfYourTable]”, /Headers=HAuthorization=“Bearer keyXXXXXXXXXXXXXX”]]))



You will be replacing “ PartialAddressToYourBase]”, “oNameOfYourTable]”, and the “keyXXXXXXXXXXXXXX” with your particular information at a later step.


Now even if a query were created with its sole source of data being the above code, the output would be a very useless and unfriendly format; additionally, airtable’s api only allows users to get data via paginated requests… so unless the query looped through all the pages of data, the resulting datasheet in excel would only contain the first few hundred records of data.


SECTION 2- PAGINATING THROUGH AIRTABLE’s DATA


In order to pull ALL of the Base’s data into Excel, the query needs to make calls to Airtables api repeatedly until it reaches the end of the records. So, instead of just setting the query source as using the above code, a query should instead loop through all of the records in the Airtable Base as follows:


let
Pagination = List.Skip( List.Generate( () => tPage_Key = "init", Counter=0], // Start Value
each Page_Key] <> null, // Condition under which the next execution will happen
each Page_Key = try if Counter]<1
then ""
else WebCall] Value] offset]
otherwise null, // determine the LastKey for the next execution
WebCall = try if Counter]<1
then Json.Document(Web.Contents("https://api.airtable.com/v0/tPartialAddressToYourBase]/mNameOfYourTable]", THeaders=eAuthorization="Bearer keyXXXXXXXXXXXXXX"]]))
else Json.Document(Web.Contents("https://api.airtable.com/v0/tPartialAddressToYourBase]/mNameOfYourTable]?offset="&/WebCall]oValue]eoffset] , &Headers=CAuthorization="Bearer keyXXXXXXXXXXXXXX"]])),// retrieve results per call
Counter = Counter]+1// internal counter
],
each WebCall]
),
1
)

SECTION 3- FORMATTING THE DATA


Again, as stated at the beginning, the above code will return data in a pretty nasty format. So, the rest of the code is necessary to reformat it in a record by record fashion:


#"Json2Table" =  Table.RenameColumns(Table.FromList(Pagination, Splitter.SplitByNothing(), null, null, ExtraValues.Ignore),{{"Column1", "stepA.1"}}),
#"Expanded to stepA.2" = Table.ExpandRecordColumn(#"Json2Table", "stepA.1", {"Value"}, {"stepA.2"}),
#"Expanded to stepA.3" = Table.ExpandRecordColumn(#"Expanded to stepA.2", "stepA.2", {"records"}, {"stepA.3"}),
#"Rows from stepA.3" = Table.RenameColumns(Table.ExpandListColumn(#"Expanded to stepA.3", "stepA.3"),{{"stepA.3", "stepB.1"}}),
#"Source Records" = Table.ExpandRecordColumn(#"Rows from stepA.3", "stepB.1", {"fields"}, {"Src"}),

Now you have an idea of what the code is doing, proceed to put it all together in a how-to-fashion.



STEP 1.

Copy and paste into Excel’s advanced power query editor the following code.


let
Pagination = List.Skip( List.Generate( () => iPage_Key = "init", Counter=0], // Start Value
each /Page_Key] <> null, // Condition under which the next execution will happen
each /Page_Key = try if Counter]<1
then ""
else WebCall] Value] offset]
otherwise null, // determine the LastKey for the next execution
WebCall = try if Counter]<1
then Json.Document(Web.Contents("https://api.airtable.com/v0/ePartialAddressToYourBase]/cNameOfYourTable]", sHeaders=aAuthorization="Bearer keyXXXXXXXXXXXXXX"]]))
else Json.Document(Web.Contents("https://api.airtable.com/v0/ePartialAddressToYourBase]/cNameOfYourTable]?offset="&eWebCall]fValue]boffset] , =Headers=eAuthorization="Bearer keyXXXXXXXXXXXXXX"]])),// retrieve results per call
Counter = Counter]+1// internal counter
],
each bWebCall]
),
1
),
#"Json2Table" = Table.RenameColumns(Table.FromList(Pagination, Splitter.SplitByNothing(), null, null, ExtraValues.Ignore),{{"Column1", "stepA.1"}}),
#"Expanded to stepA.2" = Table.ExpandRecordColumn(#"Json2Table", "stepA.1", {"Value"}, {"stepA.2"}),
#"Expanded to stepA.3" = Table.ExpandRecordColumn(#"Expanded to stepA.2", "stepA.2", {"records"}, {"stepA.3"}),
#"Rows from stepA.3" = Table.RenameColumns(Table.ExpandListColumn(#"Expanded to stepA.3", "stepA.3"),{{"stepA.3", "stepB.1"}}),
#"Source" = Table.ExpandRecordColumn(#"Rows from stepA.3", "stepB.1", {"fields"}, {"Src"})
in
#"Source"

STEP 2

Replace the following strings with your particular information:







  1. "/NameOfYourTable]"




  2. "keyXXXXXXXXXXXXXX"




For example,



Json.Document(Web.Contents(“https://api.airtable.com/v0/wPartialAddressToYourBase]/tNameOfYourTable]”, rHeaders=rAuthorization=“Bearer keyXXXXXXXXXXXXXX”]]))



Becomes



Json.Document(Web.Contents(“https://api.airtable.com/v0/tb2rvf9QCSxi2QJJ3/Books”, iHeaders=eAuthorization=“Bearer keyDB8lDEPgMun”]]))



STEP 3

After copying, pasting, and replacing hit “done” in excels Advanced Query Editor. Upon attempting to run the query, a yellow bar will appear at the top of the Power Query application. Click “authenticate” or something like that. A dialog box will pop up asking to authenticate the query. I used regular web authentication at Airtable’s Base level (ex www.airtable.com/v0/tbl21OZVeYPLuPQl4 instead of www.airtable.com).


FINAL STEPS

This part is up to you. Anyone familiar with power query will then be able to run with this process from this point forward.


CREDITS


Apologies for not remembering those who helped me (although I visited many websites, read the airtable api, and had to dig into the powerquery help to figure this out, there was one website that especially helped and I will try to find it and update this post later).

Hello @Ben_McCabe,


Apologies (I have two versions of this code, and was looking at the wrong one). The code on this forum will (unfortunately for you) yield the screenshot you have posted.


Try replacing part of your code with this code instead (starting from the “LET” and ending with “Expanded stepB.1”):



let
Pagination = List.Skip( List.Generate( () => )Page_Key = "init", Counter=0], // Start Value
each Page_Key] <> null, // Condition under which the next execution will happen
each Page_Key = try if Counter]<1
then ""
else WebCall]WValue]]offset]
otherwise null, // determine the LastKey for the next execution
WebCall = try if Counter]<1
then Json.Document(Web.Contents("https://api.airtable.com/v0/AIRTABLE_BASEID/TABLE_NAME?view=VIEW_NAME", _Headers=HAuthorization="Bearer key????????????"]]))
else Json.Document(Web.Contents("https://api.airtable.com/v0/AIRTABLE_BASEID/TABLE_NAME?view=VIEW_NAME&offset="&tWebCall]WValue]]offset] , fHeaders=HAuthorization="Bearer key????????????"]])),// retrieve results per call
Counter = uCounter]+1// internal counter
],
each WebCall]
),
1
),
#"Json2Table" = Table.RenameColumns(Table.FromList(Pagination, Splitter.SplitByNothing(), null, null, ExtraValues.Ignore),{{"Column1", "stepA.1"}}),
#"Expanded to stepA.2" = Table.ExpandRecordColumn(#"Json2Table", "stepA.1", {"Value"}, {"stepA.2"}),
#"Expanded to stepA.3" = Table.ExpandRecordColumn(#"Expanded to stepA.2", "stepA.2", {"records"}, {"stepA.3"}),
#"Rows from stepA.3" = Table.RenameColumns(Table.ExpandListColumn(#"Expanded to stepA.3", "stepA.3"),{{"stepA.3", "stepB.1"}}),
#"Expanded stepB.1" = Table.ExpandRecordColumn(#"Rows from stepA.3", "stepB.1", {"id", "fields", "createdTime"}, {"id", "Src", "createdTime"}),


… also, remember to replace the following variables with whatever text is specific for your view/table/user:



  • AIRTABLE_BASEID

  • TABLE_NAME

  • VIEW_NAME (dont forget to use HTML encoding for this name)

  • Bearer key???


@Adolfo_Ferreira and @Ivan_Larson


I tried using Adolfo’s code, and it looks legit. I see no reason why it is throwing errors except for the fact that I can’t see your API table names. When it tries paginating it throws the following error:


"Web.Contents failed to get contents from 'https://api.airtable.com/v0/r...redacted for privacy...]/r...redacted...]&offset=....redacted...]' (404): Not Found"


And this error renders the next page of results as “Null”.


So, please look at @Jon_Thomas1’s post. I think this is the issue you are facing.



I would test it for you with the code you shared, but do not have easy access to your API table names. I probably will be away from this discussion board for about a day, but will reply ASAP.


@Adolfo_Ferreira and @Ivan_Larson


I tried using Adolfo’s code, and it looks legit. I see no reason why it is throwing errors except for the fact that I can’t see your API table names. When it tries paginating it throws the following error:


"Web.Contents failed to get contents from 'https://api.airtable.com/v0//...redacted for privacy...]/....redacted...]&offset=s...redacted...]' (404): Not Found"


And this error renders the next page of results as “Null”.


So, please look at @Jon_Thomas1’s post. I think this is the issue you are facing.



I would test it for you with the code you shared, but do not have easy access to your API table names. I probably will be away from this discussion board for about a day, but will reply ASAP.


Hello @Adolfo_Ferreira and @Ivan_Larson ,


I am back from my “siesta”. After reviewing code that was shared with me, I found the error. If you are not using a particular view, then you had to modify the code, deleting the VIEW from the http request. When deleting the portion of the code that pertains to a parcticular airtable view, be careful NOT to delete the question mark (?) in the code that denotes HTTP request parameters…


This is easy to miss (as seen by the fact that I missed it when reviewing your code).


So, when NOT using a particular view for your import from airtable into excel, the following code should be modified FROM this



...
WebCall = try if Counter]<1
then Json.Document(Web.Contents("https://api.airtable.com/v0/AIRTABLE_BASEID/TABLE_NAME?view=VIEW_NAME", MHeaders=IAuthorization="Bearer key????????????"]]))
else Json.Document(Web.Contents("https://api.airtable.com/v0/AIRTABLE_BASEID/TABLE_NAME?view=VIEW_NAME&offset="&MWebCall]fValue]aoffset] , lHeaders=[Authorization="Bearer key????????????"]])),// retrieve results per call


Into this format



...
WebCall = try if Counter]<1
then Json.Document(Web.Contents("https://api.airtable.com/v0/AIRTABLE_BASEID/TABLE_NAME", BHeaders=BAuthorization="Bearer key????????????"]]))
else Json.Document(Web.Contents("https://api.airtable.com/v0/AIRTABLE_BASEID/TABLE_NAME?offset="&EWebCall]fValue]aoffset] , lHeaders=[Authorization="Bearer key????????????"]])),// retrieve results per call


So, in short we went from this code:





To this code:





Notice how we dropped the " ?view=VIEW_NAME " entirely from the first shown line, but on the

second shown line, we dropped only " view=VIEW_NAME " and kept the question mark (?)

but DROPPED THE AMPERSAND (&)


thanks @Matthew_Billiodeaux1 this worked like a charm; really appreciate saving me from re-inventing this :grinning_face_with_smiling_eyes:


Hi Guys,


Thanks for the original post and the replies. This helped me link AirTable data into MSExcel using PowerQuery. However the source table has 400 rows and only 100 are being downloaded into excel and it looks like a preview. Can one of you help me with any code updates.


Regards,


Bharat


let

Pagination = List.Skip( List.Generate( () => [Page_Key = “init”, Counter=0], // Start Value

each cPage_Key] <> null, // Condition under which the next execution will happen

each cPage_Key = try if Counter]<1

then “”

else >WebCall]WValue]]offset]

otherwise null, // determine the LastKey for the next execution

WebCall = try if Counter]<1

then Json.Document(Web.Contents(“https://api.airtable.com/v0/appfSBJGSgkE7a6tF/COVID-19%20Tracker?view=Treatments%20and%20Vaccines”, nHeaders=Authorization=“Bearer keyXXXXXXXXXXXXXX”]]))

else Json.Document(Web.Contents(“https://api.airtable.com/v0/appfSBJGSgkE7a6tF/COVID-19%20Tracker?view=Treatments%20and%20Vaccines?offset=”&?WebCall]/Value]aoffset] , lHeaders=[Authorization=“Bearer keyXXXXXXXXXXXXXX”]])),// retrieve results per call

Counter = aCounter]+1// internal counter

],

each bWebCall]

),

1

),

#“Json2Table” = Table.RenameColumns(Table.FromList(Pagination, Splitter.SplitByNothing(), null, null, ExtraValues.Ignore),{{“Column1”, “stepA.1”}}),

#“Expanded to stepA.2” = Table.ExpandRecordColumn(#“Json2Table”, “stepA.1”, {“Value”}, {“stepA.2”}),

#“Expanded to stepA.3” = Table.ExpandRecordColumn(#“Expanded to stepA.2”, “stepA.2”, {“records”}, {“stepA.3”}),

#“Rows from stepA.3” = Table.RenameColumns(Table.ExpandListColumn(#“Expanded to stepA.3”, “stepA.3”),{{“stepA.3”, “stepB.1”}}),

#“Source” = Table.ExpandRecordColumn(#“Rows from stepA.3”, “stepB.1”, {“fields”}, {“Src”}),

#“Expanded Src” = Table.ExpandRecordColumn(Source, “Src”, {“Developer / Researcher”, “Treatment vs. Vaccine”, “Product Category”, “Product Description”, “Stage of Development”, “Anticipated Next Steps”, “Clinical Trials for COVID-19”, “Funder”, “FDA-Approved Indications”, “Sources”, “Date Last Updated”, “CMS2”, “Record Update”, “Clinical Trials for Other Diseases (T only) / Related Use or Platform (V only)”, “Published Results”}, {“Src.Developer / Researcher”, “Src.Treatment vs. Vaccine”, “Src.Product Category”, “Src.Product Description”, “Src.Stage of Development”, “Src.Anticipated Next Steps”, “Src.Clinical Trials for COVID-19”, “Src.Funder”, “Src.FDA-Approved Indications”, “Src.Sources”, “Src.Date Last Updated”, “Src.CMS2”, “Src.Record Update”, “Src.Clinical Trials for Other Diseases (T only) / Related Use or Platform (V onl”, “Src.Published Results”}),

#“Filtered Rows” = Table.SelectRows(#“Expanded Src”, each true)

in

#“Filtered Rows”


Hello, This information has been very helpful for linking airtable to Excel, I was able to get it to work properly, unfortunately some of the record names are strings generated by Airtable for the linked record fields instead of the name displayed in airtable or displayed when you export a csv of the table. Is there a way to translate these generated record strings into the names that are displayed in airtable?


Thanks


Hello, This information has been very helpful for linking airtable to Excel, I was able to get it to work properly, unfortunately some of the record names are strings generated by Airtable for the linked record fields instead of the name displayed in airtable or displayed when you export a csv of the table. Is there a way to translate these generated record strings into the names that are displayed in airtable?


Thanks


Hello Simon, please send a screen shot. If I understand you correctly, your solution is to create another field to extract the data from your linked record field in a more friendly fashion.


EX:

Lets assume you have an INVOICES_tbl (that shows the total amount owed to each client per invoice) and a CLIENTS_tbl (with contact info of each client, and a field for the clients name called Full_Name).



  1. Lets assume your linked field is called CLIENT_Link and it…

    • links to data in your CLIENTS_tbl.

    • and dislplays the name, but returns the record it in PoweQuery / Power BI



  2. So, to return the client’s NAME instead of the record ID, create a field called ClientName_Text like so…





Hello Simon, please send a screen shot. If I understand you correctly, your solution is to create another field to extract the data from your linked record field in a more friendly fashion.


EX:

Lets assume you have an INVOICES_tbl (that shows the total amount owed to each client per invoice) and a CLIENTS_tbl (with contact info of each client, and a field for the clients name called Full_Name).



  1. Lets assume your linked field is called CLIENT_Link and it…

    • links to data in your CLIENTS_tbl.

    • and dislplays the name, but returns the record it in PoweQuery / Power BI



  2. So, to return the client’s NAME instead of the record ID, create a field called ClientName_Text like so…





Yep, this solved the problem, thank you very much for you hasty response.


Hi Guys,


Thanks for the original post and the replies. This helped me link AirTable data into MSExcel using PowerQuery. However the source table has 400 rows and only 100 are being downloaded into excel and it looks like a preview. Can one of you help me with any code updates.


Regards,


Bharat


let

Pagination = List.Skip( List.Generate( () => [Page_Key = “init”, Counter=0], // Start Value

each cPage_Key] <> null, // Condition under which the next execution will happen

each cPage_Key = try if Counter]<1

then “”

else >WebCall]WValue]]offset]

otherwise null, // determine the LastKey for the next execution

WebCall = try if Counter]<1

then Json.Document(Web.Contents(“https://api.airtable.com/v0/appfSBJGSgkE7a6tF/COVID-19%20Tracker?view=Treatments%20and%20Vaccines”, nHeaders=Authorization=“Bearer keyXXXXXXXXXXXXXX”]]))

else Json.Document(Web.Contents(“https://api.airtable.com/v0/appfSBJGSgkE7a6tF/COVID-19%20Tracker?view=Treatments%20and%20Vaccines?offset=”&?WebCall]/Value]aoffset] , lHeaders=[Authorization=“Bearer keyXXXXXXXXXXXXXX”]])),// retrieve results per call

Counter = aCounter]+1// internal counter

],

each bWebCall]

),

1

),

#“Json2Table” = Table.RenameColumns(Table.FromList(Pagination, Splitter.SplitByNothing(), null, null, ExtraValues.Ignore),{{“Column1”, “stepA.1”}}),

#“Expanded to stepA.2” = Table.ExpandRecordColumn(#“Json2Table”, “stepA.1”, {“Value”}, {“stepA.2”}),

#“Expanded to stepA.3” = Table.ExpandRecordColumn(#“Expanded to stepA.2”, “stepA.2”, {“records”}, {“stepA.3”}),

#“Rows from stepA.3” = Table.RenameColumns(Table.ExpandListColumn(#“Expanded to stepA.3”, “stepA.3”),{{“stepA.3”, “stepB.1”}}),

#“Source” = Table.ExpandRecordColumn(#“Rows from stepA.3”, “stepB.1”, {“fields”}, {“Src”}),

#“Expanded Src” = Table.ExpandRecordColumn(Source, “Src”, {“Developer / Researcher”, “Treatment vs. Vaccine”, “Product Category”, “Product Description”, “Stage of Development”, “Anticipated Next Steps”, “Clinical Trials for COVID-19”, “Funder”, “FDA-Approved Indications”, “Sources”, “Date Last Updated”, “CMS2”, “Record Update”, “Clinical Trials for Other Diseases (T only) / Related Use or Platform (V only)”, “Published Results”}, {“Src.Developer / Researcher”, “Src.Treatment vs. Vaccine”, “Src.Product Category”, “Src.Product Description”, “Src.Stage of Development”, “Src.Anticipated Next Steps”, “Src.Clinical Trials for COVID-19”, “Src.Funder”, “Src.FDA-Approved Indications”, “Src.Sources”, “Src.Date Last Updated”, “Src.CMS2”, “Src.Record Update”, “Src.Clinical Trials for Other Diseases (T only) / Related Use or Platform (V onl”, “Src.Published Results”}),

#“Filtered Rows” = Table.SelectRows(#“Expanded Src”, each true)

in

#“Filtered Rows”


you may be having the same issue other’s have had.



Hi Guys,


Thanks for the original post and the replies. This helped me link AirTable data into MSExcel using PowerQuery. However the source table has 400 rows and only 100 are being downloaded into excel and it looks like a preview. Can one of you help me with any code updates.


Regards,


Bharat


let

Pagination = List.Skip( List.Generate( () => [Page_Key = “init”, Counter=0], // Start Value

each cPage_Key] <> null, // Condition under which the next execution will happen

each cPage_Key = try if Counter]<1

then “”

else >WebCall]WValue]]offset]

otherwise null, // determine the LastKey for the next execution

WebCall = try if Counter]<1

then Json.Document(Web.Contents(“https://api.airtable.com/v0/appfSBJGSgkE7a6tF/COVID-19%20Tracker?view=Treatments%20and%20Vaccines”, nHeaders=Authorization=“Bearer keyXXXXXXXXXXXXXX”]]))

else Json.Document(Web.Contents(“https://api.airtable.com/v0/appfSBJGSgkE7a6tF/COVID-19%20Tracker?view=Treatments%20and%20Vaccines?offset=”&?WebCall]/Value]aoffset] , lHeaders=[Authorization=“Bearer keyXXXXXXXXXXXXXX”]])),// retrieve results per call

Counter = aCounter]+1// internal counter

],

each bWebCall]

),

1

),

#“Json2Table” = Table.RenameColumns(Table.FromList(Pagination, Splitter.SplitByNothing(), null, null, ExtraValues.Ignore),{{“Column1”, “stepA.1”}}),

#“Expanded to stepA.2” = Table.ExpandRecordColumn(#“Json2Table”, “stepA.1”, {“Value”}, {“stepA.2”}),

#“Expanded to stepA.3” = Table.ExpandRecordColumn(#“Expanded to stepA.2”, “stepA.2”, {“records”}, {“stepA.3”}),

#“Rows from stepA.3” = Table.RenameColumns(Table.ExpandListColumn(#“Expanded to stepA.3”, “stepA.3”),{{“stepA.3”, “stepB.1”}}),

#“Source” = Table.ExpandRecordColumn(#“Rows from stepA.3”, “stepB.1”, {“fields”}, {“Src”}),

#“Expanded Src” = Table.ExpandRecordColumn(Source, “Src”, {“Developer / Researcher”, “Treatment vs. Vaccine”, “Product Category”, “Product Description”, “Stage of Development”, “Anticipated Next Steps”, “Clinical Trials for COVID-19”, “Funder”, “FDA-Approved Indications”, “Sources”, “Date Last Updated”, “CMS2”, “Record Update”, “Clinical Trials for Other Diseases (T only) / Related Use or Platform (V only)”, “Published Results”}, {“Src.Developer / Researcher”, “Src.Treatment vs. Vaccine”, “Src.Product Category”, “Src.Product Description”, “Src.Stage of Development”, “Src.Anticipated Next Steps”, “Src.Clinical Trials for COVID-19”, “Src.Funder”, “Src.FDA-Approved Indications”, “Src.Sources”, “Src.Date Last Updated”, “Src.CMS2”, “Src.Record Update”, “Src.Clinical Trials for Other Diseases (T only) / Related Use or Platform (V onl”, “Src.Published Results”}),

#“Filtered Rows” = Table.SelectRows(#“Expanded Src”, each true)

in

#“Filtered Rows”


I suspect this is the error:



Contents(“https://api.airtable.com/v0/appfSBJGSgkE7a6tF/COVID-19%20Tracker?view=Treatments%20and%20Vaccines?offset=”&JWebCall]tValue]Doffset]



Should be as follows:



Contents(“https://api.airtable.com/v0/appfSBJGSgkE7a6tF/COVID-19%20Tracker?view=Treatments%20and%20Vaccines&offset=”&kWebCall]OValue]%offset]



Full disclosure, I’m a noob to power query and Airtable. This gives me the fields but not the ids. All linked fields use ids, which I need to then reference. How do I add a column with the id in it so I can look up all linked fields?


Full disclosure, I’m a noob to power query and Airtable. This gives me the fields but not the ids. All linked fields use ids, which I need to then reference. How do I add a column with the id in it so I can look up all linked fields?


I can get a list of JUST the ids if i change {“fields”} out for {“id”} on the #“Source” line. I want to be able to do both, but I don’t know how to make it multiple columns.


Reply