What is probably the best option is to present users with a selection of loss functions. "Here's the top three things squared error loss suggests for you, then the top three things cross-entropy without softmax averaging suggests, here's the top three things InfoNCE suggests, etc..."