I don’t know why you’re getting down voted. That is how it works to my understanding (as a layperson). It was fed training data and is very good at predictive text. I don’t think it can take concepts it’s learned and apply them in novel ways.
This is hilarious but I don’t think fully answers the question. This is a good example of something novel that GPT can do, ie manipulating language according to new rules to create rhythm and rhymes.
However, to give a more over the top example: if you removed all mention of planes from its corpus, leaving only information on air resistance and materials science, and then asked it for the best way to cross the Atlantic, it would never invent a plane for you.
I don’t know why you’re getting down voted. That is how it works to my understanding (as a layperson). It was fed training data and is very good at predictive text. I don’t think it can take concepts it’s learned and apply them in novel ways.
Sure it can: https://chat.openai.com/share/6e0ab777-a9c4-4b70-8636-ccac19a78136
This is hilarious but I don’t think fully answers the question. This is a good example of something novel that GPT can do, ie manipulating language according to new rules to create rhythm and rhymes.
However, to give a more over the top example: if you removed all mention of planes from its corpus, leaving only information on air resistance and materials science, and then asked it for the best way to cross the Atlantic, it would never invent a plane for you.