The point of the blog is that even at "supposed" deterministic generative sampli... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		mynameismon 7 months ago \| parent \| context \| favorite \| on: Defeating Nondeterminism in LLM Inference The point of the blog is that even at "supposed" deterministic generative sampling, non-determinism creeps in. This in turn has disastrous effects in very real experiments.

cubefox 7 months ago [–]

My point is that greedy sampling is not just not sufficient but also not necessary for deterministic inference.

Consider applying for YC's Summer 2026 batch! Applications are open till May 4
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact