Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

It's limited to 300 logit biases at a time. Knowing GPT4's vocabulary is ~100k tokens it's not nearly enough to get reliable guided generation. Although it could work in some cases, and another advantage of this work is that we can determine that before generating.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: