So I got a reply from staff to a query I made on support:

…at this time any base collaborator, of any permission level, can download the files stored in the attachment field if they have access to the base.

If you’d like to restrict who can download an attachment within a certain view we recommend creating a view share link with the “Allow viewers to copy data out of this view” option left toggled off.

It was not exactly what I wanted though. So it’s still an open issue for me.

need this feature!