I think group dynamics comes with a turn taking ambiguity. unlike in one-on-one dialogue that's structurally clean since there's a clear prompt, a clear response, and a clear feedback signal for RLHF.

Could argue it is the opposite. The more people in a conversation the more you can play social games instead of thinking.