Text this: A Remedy for Heterogeneous Data: Clustered Federated Learning with Gradient Trajectory