Based on their behaviour, I’m not so sure. It seemed to me to be a way of saying “that’s maybe not true, but it’s fun to think about”. At least, that’s how I’d use the phrase “that’s an interesting idea”. If I just found it interesting, I’d say “how interesting!”

But yes, it is indeed fascinating how LLMs work.