Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Having played around with this sort of thing in the llama.cpp ecosystem when they added it a few weeks ago, I will say that it also helps if your models a) are tuned to output json and b) you prompt them to do so. Anything you can do to help the output fit the grammar helps.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: