Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

This model is small enough that it might be sensible to try the same prompts against all of the quant sizes to try and spot any differences.


This inspired me to give that a go: https://simonw.github.io/granite-4.1-3b-gguf-pelicans/


That was interesting almost like a weird little modern art gallery. I’m surprised that the BF16 one looks so bad…




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: