Because a machine that “forgets” stuff it reads seems rather useless… considering it was a multiple choice style exam and, as a machine, Chat GPT had the book entirely memorized, it should have scored perfect almost all the time.
Chat GPT had the book entirely memorized, it should have scored perfect almost all the time.
The types of multiple choice questions aren’t simple recall of learned facts. It requires application of abstract concepts to new facts, with a lot of red herrings. Here’s a real question:
A father lived with his son, who was an alcoholic. When drunk, the son often became violent and physically abused his father. As a result, the father always lived in fear. One night, the father heard his son on the front stoop making loud obscene remarks. The father was certain that his son was drunk and was terrified that he would be physically beaten again. In his fear, he bolted the front door and took out a revolver. When the son discovered that the door was bolted, he kicked it down. As the son burst through the front door, his father shot him four times in the chest, killing him. In fact, the son was not under the influence of alcohol or any drug and did not intend to harm his father.
At trial, the father presented the above facts and asked the judge to instruct the jury on self-defense.
How should the judge instruct the jury with respect to self-defense?
(A) Give the self-defense instruction, because it expresses the defense’s theory of the case.
(B) Give the self-defense instruction, because the evidence is sufficient to raise the defense.
They’re auto complete machines. All they fundamentally do is match words together. If it was trained on the answers and still couldn’t reproduce the correct word matches, it failed.
They aren’t auto complete machines, they are neural networks. Why are you trying to explain it when you clearly don’t have the first idea of how thigs work?
the very funny thing is, all of the garden variety free text autocomplete systems I’ve worked with have been implemented using neural nets. it’s not like it’s a particularly new or novel approach. but surely the AI bros coming into this thread know that and they’re not just regurgitating buzzwords, right?
Because a machine that “forgets” stuff it reads seems rather useless… considering it was a multiple choice style exam and, as a machine, Chat GPT had the book entirely memorized, it should have scored perfect almost all the time.
The types of multiple choice questions aren’t simple recall of learned facts. It requires application of abstract concepts to new facts, with a lot of red herrings. Here’s a real question:
Studying for the bar exam starts with memorizing a bunch of rules, but actually getting out and applying them is a separate skill.
I feel like this exposes a fundamental misunderstanding of how LLMs are trained.
They’re auto complete machines. All they fundamentally do is match words together. If it was trained on the answers and still couldn’t reproduce the correct word matches, it failed.
You have the energy to spread misinformation and spam downvotes, how about an intelligent responses instead?
how about fuck off
How about I ban you for being obnoxious instead?
I like them rules you got here
“don’t come into our loungeroom and piss on the floor” should be simple and obvious, and yet
@dgerard @TachyonTele that rug really tied the room together, man
They aren’t auto complete machines, they are neural networks. Why are you trying to explain it when you clearly don’t have the first idea of how thigs work?
the very funny thing is, all of the garden variety free text autocomplete systems I’ve worked with have been implemented using neural nets. it’s not like it’s a particularly new or novel approach. but surely the AI bros coming into this thread know that and they’re not just regurgitating buzzwords, right?
Don’t worry friend, you are correct.