Saw similar behavior before, especially under longer contexts, but couldn’t pin it down. This is a solid write-up—nice example of how serving bugs can surface as “model quality” issues.

[dead]

[dead]

[dead]

[dead]

[dead]