Edit: Because people are confused, remove them while they are defederated.
Once they've got stuff under control and refederate, then add them back.