Text this: The Role of Model Selection in Preference Learning