Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Yeah I was thinking more about q6_0 or so. The q4_K_M is 404GB so you can still push it a bit higher than that. Obviously the 1.52 bit doesn't make sense.

I'm never going to pay 10k for that though. Hopefully cheaper hardware options are coming soon.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: