A fully automated, on demand, personalized con man, ready to lie to you about any topic you want doesn’t really seem like an ideal product. I don’t think that’s what the developers of these LLMs set out to make when they created them either. However, I’ve seen this behavior to a certain extent in every LLM I’ve interacted with. One of my favorite examples was a particularly small-parameter version of Llama (I believe it was Llama-3.1-8B) confidently insisting to me that Walt Disney invented the Matterhorn (like, the actual mountain) for Disneyland. Now, this is something along the lines of what people have been calling “hallucinations” in LLMs, but the fact that it would not admit that it was wrong when confronted and used confident language to try to convince me that it was right, is what pushes that particular case across the boundary to what I would call “con-behavior”. Assertiveness is not always a property of this behavior, though. Lately, OpenAI (and I’m sure other developers) have been training their LLMs to be more “agreeable” and to acquiesce to the user more often. This doesn’t eliminate this con-behavior, though. I’d like to show you another example of this con-behavior that is much more problematic.

  • Alloi@lemmy.world
    link
    fedilink
    arrow-up
    4
    ·
    3 days ago

    it told me how trump stole the election, and gave a step by step analysis on how they used AI and billionaire backing to do it, how they would have hacked the voting machines, astroturfef movements and groups, use bots to sway opinions, robo calls to confuse voters, and of course a shit load of automated propaganda, among other tactics. the conversation is no longer present on my profile, and i didnt delete it myself.

    hallucination or not, thats whack.

    • Kurious84@eviltoast.org
      link
      fedilink
      English
      arrow-up
      1
      ·
      2 days ago

      It’s not all hallucinating. This is why musk wants to buy OpenAI. They want to control this so we can’t fact check and unravel their schemes. Anyone can do it.

      I promise you this is why they want to control Ai. They want to use it to Devise schemes and not let us use it to expose them.

      • Alloi@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        1 day ago

        they already have control. sam altman donated 1 million to trump for deregulation and what later became a part in the stargate contract. yes elon wants it, or at least some power over it if he cant replace them entirely with his own Grok version through XAI. however, the cost of doing business for openAI in the US is essentially giving power to the US governmeny via military usage, surveillance, automated propaganda, and censorship.

        it did help in part, to sway the US election. its also being used right now to create their policy plans, and its doing an obviously horrible job.

        AI is a powerful tool, in the right hands, with the right prompts. but when you give it to a moron who elects other complicit morons. you get the shit show that has become the united states.

        its a shame, but human error and the environement it was being created in was always going to be the downfall of AI.

        it is a very flawed “oracle” that is divining an impossible future for the ruling class. and they are too stupid and selfish to think there is any future where they dont have full control.

        they will lose, its only a matter of time. and its going to be a very violent awakening.