Remove unnecessary grants, instead inherit from user roles