Hey there, you’re correct.
Currently if you’re fetching any amount of data from a table (even records from a specific view), all of the data in the table has to be loaded into the browser in order to let an app function.
This contributes to slower performance as your base gets bigger. We’re aware of this issue and, while we don’t have a specific timeline for a fix, we’re are actively working on a solution.