Lots of negativity in here. I find ChatGPT to be pretty cool and unlike the internet-based AI attempts last decade it seems people haven’t managed to immediately turn it into a racist fascist.
It’s a hell of a lot better at answering complicated questions than Siri is.
"It's a hell of a lot better at providing
an answer to complicated questions
(but often an inaccurate one)"
There you go. Fixed!
See attached screenshot. I just asked it to do some basic math. Its answer was off by 100. It's fine if you ask it "what's 5 + 10", because the odds of it coming across that particular combination of numbers in its training data is pretty good. But it can't actually do the math itself. It's just looking things up in a "what words and numbers are likely to follow this combination of words and numbers" statistics table.
Then, when it comes to information it actually
has been trained on, there are two issues:
1. ChatGPT has no idea whether the information it was trained on is
true or not, and
2. There is a degree of randomness that ChatGPT injects into its answers to be "creative". This means it knowingly skews the results it provides.
Here's another good example:
https://mastodon.social/@L_howes/109879173479929748
ChatGPT made up an article in response to a search query and attributed it to an author who never wrote it.
Or this example, wherein a company wondered why they had a sudden influx of people sign up to test their service, then stop using it almost immediately. Turned out that ChatGPT invented a new service that the company did not offer, and even provided developers with
sample code for the imaginary service.
TL;DR ChatGPT claims we offer an API to turn a mobile phone number into the location of the phone. We do not.
blog.opencagedata.com
Don't get me wrong, ChatGPT is pretty cool. But it is not a search engine and shouldn't be treated as such. At least not for anything requiring accuracy. Definitely fun to play around with and certainly an interesting tool for generating realistic-sounding-but-not-necessarily-true content.