Text this: Architectural Synergies in Bi-Modal and Bi-Contrastive Learning