Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Local LLMs


Be sure to bring an extra power strip for all your plugs and adaptors.

https://www.tomshardware.com/pc-components/gpus/tiny-corp-su...


My laptop runs gpt-oss 120B with none of that. Don't know how long though. I suspect a couple of hours continuous.


Which laptop?


ROG Flow Z13 with maxxed out RAM.


Nice laptop. I love my current laptop in general, but it is lagging in performance.


how is anyone going to be able to take a test with all of the noise from that fan as it cranks through tokens?


Offer to make everyone espresso and macchiato with you GPU cooling module. They won't be able to hear the fan over the grinder and pump and milk foamer!


You can make it as slow as you want. At half TDP it is silent.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: