We are looking into enhancing our content assignment experience very soon. Having the ability to 'exclude' certain categories/groups/users from the assignment matrix is going to have a clearly significant impact, and it is on our radar!