this post was submitted on 24 May 2024
323 points (87.0% liked)

shitposting

1547 readers
225 users here now

Rules •1. No Doxxing •2. No TikTok reposts •3. No Harassing •4. Post Gore at your own discretion, Depends if its funny or just gore to be an edgelord.

founded 3 years ago
MODERATORS
 

cross-posted from: https://hexbear.net/post/2609634

Hmmmm… I don’t remember that Beatles song

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 5 points 3 months ago* (last edited 3 months ago) (1 children)

Depends on the temperature in the LLM/context, which I'm assuming google will have set quite low for this.

[–] [email protected] 2 points 3 months ago (1 children)
[–] [email protected] 5 points 3 months ago

Yeah, it's kind of a measure of randomness for LLM responses. A low temperature makes the LLM more consistent and more reliable, a higher temperature makes it more "creative". Same prompt on low temperature is more likely to be repeatable, high temperature introduces a higher risk of hallucinations, etc.

Presumably Google's "search suggestions" are done on a very low temperature, but that doesn't prevent hallucinations, just makes it less likely.