To gateway user group users, only show the groups which they are either member of or Admin of

Currently, any user (even before they are in a user group) can view all the available user groups.
This should be changed into only displaying groups they are either member of or admin of.
For groups they are admin of, they should be able to edit the group user roles, add new users.
Groups that they are only member of they shold be able to view the group in the group list.