Get around import row limits?

I’m trying to use Airtable to build a search tool using the Pro plan. I have 25,000 records in table A and 65,000 in table B. B has a many to one relationship with A.

When I attempt to import the larger file (B) I either get the size limit warning (2MB) if I use the regular CSV import and the row number warning (15,000 rows) if I use the CSV import block.

Has anyone solved this problem? Google sheets and Excel can handle far more data than this and I may have to go back to them if I can’t fix it. Thank you!