I don't think people who aren't members of the community have the ability to remove tags. I've had it happen once or twice that I added a tag, and then realised some other tag was better, and been unable to remove the first tag once it's been saved with the entry, so I don't think you have to worry about it with anyone who's not a member of the comm.