Structured outputs are hard... but they claimed to have solved this a year ago. ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		jappgar on Aug 6, 2024 \| parent \| context \| favorite \| on: Structured Outputs in the API Structured outputs are hard... but they claimed to have solved this a year ago. They were lying, of course, and meanwhile charged output tokens for malformed JSON.

jiggawatts on Aug 7, 2024 [–]

Structured output is trivial: just select the output tokens from the given list of probability values filtered for the allowed next tokens in the schema.

Other LLM vendors figured this out many months ago.

retinaros on Aug 7, 2024 | [–]

they did not . anthropic often sends broken json

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact