Highlight action is causing chart to drill out. Can set actions and highlight actions work together?

I have a bar chart that uses set actions to drill down to subcategories. I want to be able to use this same chart to highlight points on a second chart. Namely, I want to be able to apply a highlight action so that if the user selects a category or subcategory then the relevant data points on the dotplot are highlighted.

I have this set up in a dashboard (dummy workbook attached) and it's working well. But I am running into a problem when I want to un-highlight. When I re-select a subcategory to un-highlight, it also drills out and my subcategories disappear. Any workaround to prevent this from happening? I know I could use hover instead of select for my highlight action, but for users who might want to print the dashboard I need to have the labels showing.