Text this: Annealing dynamics of regular rotor networks: Universality and its breakdown