Requesting for a Feature Request for IPAM. It seems when it comes to groups, the IPAM Custom Roles which is set to Hide, does not actually hide the said group. It is disabled as it is grayed out, but definitely not hidden.
Have you tried logging in with an account without admin access to see how it looks then?
That is how it looks. I just took a screenshot.