Gemini last models: temperature, top_p, and top_k are deprecated and ignored
43 points
4 hours ago
| 6 comments
| ai.google.dev
| HN
aesthesia
2 hours ago
[-]
My guess is that RL training being done with particular generation parameters makes models much more brittle to changes in these parameters, and that's why we're seeing changes like this across model providers. But I don't really know.
reply
pixelmelt
2 hours ago
[-]
I'm inclined to agree given how unstable Gemma 4 is when not using the "official" sampler settings
reply
tolugenius
3 hours ago
[-]
> To improve determinism, define a system instruction with explicit rules for your specific use case.

Is this guaranteed to work any better than top_k or top_p? This just sounds like making a smaller version of a Agent.md doc.

reply
janalsncm
52 minutes ago
[-]
It is guaranteed to work worse than top_k=1, that’s for sure.
reply
kouteiheika
1 hour ago
[-]
Obligatory "The Conspiracy Against High Temperature Sampling":

https://gist.github.com/Hellisotherpeople/71ba712f9f899adcb0...

reply
NooneAtAll3
56 minutes ago
[-]
where can one learn what top_k and top_p mean?
reply
krapht
28 minutes ago
[-]
ironically, any frontier LLM will easily generate a tutorial at any detail you like explaining what these are.

if don't have time for that, just know that these are technical parameters that affect how likely it is an llm will produce the same result after being asked the same question.

reply
cratermoon
31 minutes ago
[-]
reply
tough
3 hours ago
[-]
fwiw sonnet-5 also drops temperature (sonne-4 had it)
reply
impulser_
2 hours ago
[-]
Good. These have been basically useless for the past few generations of models, and most of the time made the model perform worst.
reply
greatgib
4 hours ago
[-]
1. Sampling parameter deprecation (temperature, top_p, top_k)

temperature, top_p, and top_k are deprecated and ignored. In future model generations, supplying these parameters returns an HTTP 400 error. Remove these parameters from all requests.

reply