Text this: Signatures of ballistic and diffusive transport in the time-dependent Kerr-response of magnetic materials