Security Groups: Allow delete relationship without allowing deleting Group Data set

Hi,

How can I allow a user group to unlink e.g. a Lead from a certain security group without allowing the user to delete any entire security group?

It seems I need to allow the “Delete” action in order for a user to be able to unlink anything from a certain security group…