I’ve recently been working with some niche tool that has very little documentation on the web but is open source and has a ton of discussions on public email groups. Chatgpt is sometimes able to figure out what param I need to send for specific stuff in that tool even if there are zero Google matches for the param name, but more often than not it just hallucinates stuff or mention things that no longer exists. I’ve created the habit of always asking things like “is that right?” or “is that answer up to date?” before even reading the first response from it and it often replies with things like: “no, that param only exists in some other similar tool” or “no that API has been deprecated” and shit like that.
If it were up to me I wouldn’t even be using chatgpt at all due to all the time it wasted with random stuff it makes up, but whatever training data openAI used, it surely had more information about the niche stuff I’m working with than the web does at this point - so sometimes it can still save me time too.
i use it exclusively to condense 1000 word text blocks down to 100 words, and it’s good enough at that that the time it saves me is worth the (sometimes) slightly lower quality than i could have done myself
I’ve recently been working with some niche tool that has very little documentation on the web but is open source and has a ton of discussions on public email groups. Chatgpt is sometimes able to figure out what param I need to send for specific stuff in that tool even if there are zero Google matches for the param name, but more often than not it just hallucinates stuff or mention things that no longer exists. I’ve created the habit of always asking things like “is that right?” or “is that answer up to date?” before even reading the first response from it and it often replies with things like: “no, that param only exists in some other similar tool” or “no that API has been deprecated” and shit like that.
If it were up to me I wouldn’t even be using chatgpt at all due to all the time it wasted with random stuff it makes up, but whatever training data openAI used, it surely had more information about the niche stuff I’m working with than the web does at this point - so sometimes it can still save me time too.
i use it exclusively to condense 1000 word text blocks down to 100 words, and it’s good enough at that that the time it saves me is worth the (sometimes) slightly lower quality than i could have done myself