Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Structured output is trivial: just select the output tokens from the given list of probability values filtered for the allowed next tokens in the schema.

Other LLM vendors figured this out many months ago.



they did not . anthropic often sends broken json




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: