I had no idea that was even possible. Interesting!

A list of these might be problematic for security reasons (though maybe even the current system is)? You normally don't know which Custom Groups you are on and shouldn't be able to determine when you are removed from one group, in my opinion. But something else than a 404 error would be very good.