Is it possible to only download a group of records and not the entire record table?
Absolutely! The CSV download is restricted to the records visible in the active view. Use filters to control the displayed records, then the download will match.
Follow on question - Is it possible to switch off the download feature for certain users or user levels?