how to remove oppty team member without owning the opportunity/neither being the manager?

Hello Community

Can we somehow create custom permission set, that specific user can remove oppty team members without being the oppty owner and also not being higher in the hierarchy of oppty owner(so not being direct manager of oppty owner) ?

Thanks for any suggestions :)