Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

We've had this for over 1 year in Lamini - https://lamini-ai.github.io/inference/json_output/

Works with any open LLM, including Llama 3.1



Also the outlines library: https://github.com/outlines-dev/outlines


Also note llama.cpp with grammar support:

https://github.com/ggerganov/llama.cpp/tree/master/grammars

Supports an EBNF-like syntax, as well as JSON-Schema.


Yeah! - outlines, guidance, jsonformer were inspiring for this line of work


Why not JSON Schema?


We did some user studies and found that people found it less intuitive.


Looks useful!




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: