Hacker News
new
top
best
ask
show
job
Stop using JSON for LLM structured output
(
nehmeailabs.com
)
2 points
by
44za12
5 hours ago
1 comment
44za12
5 hours ago
For simple extraction tasks, a delimiter-separated string uses 11 tokens vs 35 for JSON. Output tokens are the latency bottleneck.