When doing a new CSV import, you can add records, modify existing ones, but you can’t delete records from your old table that aren’t in the new dataset.
It would be good to have this as an option, or at least highlight the records that are from a previous import which weren’t present in a new csv import.