It’s not even a lack of critical thinking skills, necessarily. Companies don’t exactly highlight the fact that their AIs are prone to hallucinating. I’d be willing to bet actual money that a lot of users aren’t even aware that that’s a possibility.
Comment on All this bad AI is wrecking a whole generation of gadgets
Showroom7561@lemmy.ca 5 weeks agoI think what’s feeding all this hubris around AI is that it’s essentially tricking us into thinking it’s intelligent. It’s an incredible tool for compressing and organizing information, but it isn’t really smart.
My son has Apple assistant (Siri), and I have Google Gemini. For shits and giggles, we had them talk to each other… literally have a conversation… and it got stale very quickly. There’s no “person” behind artificial “intelligence”, so you can see just how limited it gets.
I’ve always said that if you know a lot about a topic, you can very quickly see how AI is really stupid for the most part. The problem is that if you ask it a question that you don’t know the answer to, then it for sure seems correct, even when it completely hallucinates the response.
The danger is that not everyone has enough critical thinking skills to question the correctness of an answer, so they hear what Siri or Gemini told them as fact… and then pass that knowledge onto other actual human beings. Like a virus of misinformation.
ahornsirup@feddit.org 5 weeks ago
Showroom7561@lemmy.ca 5 weeks ago
Companies don’t exactly highlight the fact that their AIs are prone to hallucinating.
Funny enough, if you question Gemini enough, it will eventually cave and admit that it’s answers aren’t always right and that it’s still improving. LOL
The problem is, as I suggested, you already need to know what the correct answer is in order to effectively cross-examine what it told you.
ch00f@lemmy.world 5 weeks ago
I brought this up to my mom who responded with “yeah, but there’s a lot of incorrect information online anyway.” This is true, but AI strips away 100% of the context for that information, and if the AI people have their way, there will be no other portal online with which to get a second opinion.
Showroom7561@lemmy.ca 5 weeks ago
Here’s the thing: before AI, most information came from an author or organization, who had to stake their reputation on the content they create. If the information they provided was false, low quality, misleading, etc… they paid a penalty for it in a loss of credibility (and even income).
But with AI, that doesn’t happen. You can generate 1000 articles at the click of a button, post it everywhere, and there’s no backlash because the author doesn’t exist.
I think in the near future, you’ll start to see certification for human-generated content. I know that movies have started to disclose whether AI generated content was used or not, so the trend is that people want to know.