Use of Permission in action visibility in lightning page record(dynamic form)

I want to hide/unhide an action button depending on whether user has a particular permission set or not. I have selected the permission set from advanced filter and set the condition 'Equals True'. Action button is visible irrespective of whether user has permission set or not. Can anyone has experience such behaviour before?

Thanks