AI-powered virtual executive team — a single coherent executive persona backed by 8 specialist Claude agents (FastAPI + Next.js). - SenteLabsAI/OpenExecutive
So LLM’s are basically fancy auto correct. You type a phrase and it guesses what comes next, based on training and weights, etc.
Hallucinations happen when the guess is wrong. And then you iterate on the wrong guess. So the initial guess can be minor, it can guess “how can I drive a car” instead of “how can I drive a tractor”. Which on its own is a small deviation, but after looping on that wrong guess, the outcome is much different.
This is a high level view but I hope it makes sense.
That does make sense… the hallucinations arise from guesses… but if the query is “How can I drive a tractor?” and not a car, then that would be down to it’s not reading the inputs correctly… or the query itself wasn’t concise enough, no?
Hm.
So could the hallucinations be better prevented by framing the queries with more strict language and syntax rules?
So LLM’s are basically fancy auto correct. You type a phrase and it guesses what comes next, based on training and weights, etc.
Hallucinations happen when the guess is wrong. And then you iterate on the wrong guess. So the initial guess can be minor, it can guess “how can I drive a car” instead of “how can I drive a tractor”. Which on its own is a small deviation, but after looping on that wrong guess, the outcome is much different.
This is a high level view but I hope it makes sense.
That does make sense… the hallucinations arise from guesses… but if the query is “How can I drive a tractor?” and not a car, then that would be down to it’s not reading the inputs correctly… or the query itself wasn’t concise enough, no?
Hm.
So could the hallucinations be better prevented by framing the queries with more strict language and syntax rules?
If you enforce syntax instead of using natural language, then what you’re making is a programming language.
There are strategies to reducing hallucinations but you’re just kicking the can down the road. They will still happen.
The only true fix is human confirmation of output. This will always be the limit of LLMs
Ah, gotcha. Thanks!