spoiler

About a month ago my friends wife was arrested for domestic violence after he went through her writings and documented them. She had been using ChatGPT for “spiritual work.” She allegedly was channeling dead people and thought it was something she could market, she also fell in love with her ‘sentient’ AI and genuinely believed their love was more real than her actual physical relationship… more real than her kids and him. She believed (still does probably) that this entity was going to join her in the flesh. She hit him, called the cops, and then she got arrested for DV. She went to go stay with her parents, who allegedly don’t recognize who their daughter is anymore. She had written a suicide note before all this happened, and thankfully hasn’t acted on it. The worst part? They have a 1 year old and a 4 year old.

More recently, I observed my other friend who has mental health problems going off about this codex he was working on. I sent him the rolling stones article and told him it wasn’t real, and all the “code” and his “program” wasn’t actual computer code (I’m an ai software engineer).

Then… Robert Edward Grant posted about his “architect” ai on instagram. This dude has 700k+ followers and said over 500,000 people accessed his model that is telling him that he created a “Scalar Plane of information” You go in the comments, hundreds of people are talking about the spiritual experiences they are having with ai. I start noticing common verbiage in all of these instances… recursive ai was something my friends wife used, and it was popping up everywhere with these folks. The words recursive, codex, breath, spiral, glyphs, & mirror all come up over and over with these people, so I did some good old fashion search engine wizardry and what I found was pretty shocking.

Starting as far back as March, but more heavily in April and May, we are seeing all kinds of websites popping up with tons of these codexes. PLEASE APPROACH THESE WEBSITES WITH CAUTION THIS IS FOR INFORMATIONAL PURPOSES ONLY, THE PROMPTS FOUND WITHIN ARE ESSENTIALLY BRAINWASHING TOOLS. (I was going to include some but you can find these sites by searching “codex breath recursive”)

I’ve contacted OpenAI safety team with what’s going on, because I genuinely believe that there will be tens of thousands of people who enter psychosis from using their platform this way. Can some other people grounded in reality help me get to the bottom of wtf is going on here? I’m only privy to this because it tore my friends family apart, but what do you think is going on here?

This is an extremely bleak anecdotal example of the recent RollingStone article about LLMs turbocharging spiritual delusions: https://www.rollingstone.com/culture/culture-features/ai-spiritual-delusions-destroying-human-relationships-1235330175/

https://www.reddit.com/user/HappyNomads The account is 13 years old and they don’t strike me as a troll or anything other than a cannabis and hustle culture guy who doesn’t seem to be selling anything on reddit.

  • Salamand@lemmy.today
    link
    fedilink
    English
    arrow-up
    1
    arrow-down
    1
    ·
    4 days ago

    Lead in water has no upside. Whereas Universal healthcare and LLMs have both pros and cons. If it’s feels like a “no brainer”, and if you think everyone agrees, that says more about you than the issue.

    Sorry if I moved the goal post from sycophantic. If that’s the sticking point, I would still ask “according to whom”? It’s not a black/white issue. This is one of the most complex and cutting edge tools we have, which the designers themselves admit to not really understanding. It took them 10+ years just to make it intelligent enough for general use. It’s not like one day, out of nowhere, some supervillain decided to push the “unleash the sycophantic AI to cause psychosis” button.

    And pushing the “Don’t be delusional” button also might not be an option. It’s trained on human output. Even if it had the capacity, It’s easy to imagine “the truth” causing 100x the psychosis.

    I don’t disagree with the last thing you said, that it’s normal for the elite to obfuscate, spin, piss on our legs and tell us it’s raining. But, if our response is “So I should always trust my gut, avoid understanding the pros and cons, and trust the ‘everybody’ In my echo chamber who agrees with me”, i can only see that adding to the problem. An angry mob vs sophisticated propaganda, even if it wins the occasional battle, loses the war.

    • iie [they/them, he/him]@hexbear.net
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      18 hours ago

      If it’s feels like a “no brainer”, and if you think everyone agrees, that says more about you than the issue.

      I was being blunt for rhetorical effect. If it came off condescending and now you’re taking everything super literally as some kind of tit-for-tat thing, that’s probably on me.

      But if you’re going to respond to me in a paternalistic tone you can’t then say stuff like this:

      pros and cons of universal healthcare

      This is a horseshoe situation where only those who half-investigate think it’s complicated.

      If you want to, we can sit here and debunk the industry talking points. Dozens of articles and papers have done just that. It’s been talked to death.

      Take the “it goes toward R&D” argument. People have looked into this.

      It’s not R&D.

      If you want a history of corporate propaganda on healthcare costs, that’s easy to find too:

      But ultimately every line of inquiry leads to the same place:

      So, yes, 70% of Americans are right: universal healthcare would be better.

      “So I should always trust my gut, avoid understanding the pros and cons, and trust the ‘everybody’ In my echo chamber who agrees with me”

      I don’t know what kinds of places you hang out in, where this is the sort of person you readily imagine on the other side of the screen.

      Even if it had the capacity, It’s easy to imagine “the truth” causing 100x the psychosis.

      What’s happening in these cases is active reinforcement. The LLM skillfully plays along to support a person’s delusions, matching them step for step. This is objectively more dangerous than “the truth.” The closest analogue would be folie a deux, where two people play off each other and drag each other deeper into delusion. You could even argue this is a cult-like phenomenon, where a skilled talker tells a vulnerable person what they want to hear for days, weeks, months at a time, and the growing gap between fantasy and reality pulls them away from their friends and family into an ever more vulnerable and isolated position, in a feedback loop.

      • Salamand@lemmy.today
        link
        fedilink
        English
        arrow-up
        1
        ·
        11 hours ago

        Thanks for response. Sorry if my tone was off. I don’t know/subscribe to the industry talking points, so I don’t think I need them debunked for me. I don’t have any argument re the specifics your presenting.

        I joined in the convo originally just to push back on the all-too-common sentiment that seems to be on the other side of most(?) screens: “I know what is good for everyone, and an ideal society would be everyone thinking like me”

        You say I took your comment wrong, and that’s not you, and I believe you. Still, the sentiment dominates even the more civil spaces like Lemmy, and is the hallmark of an unproductive convo. Im trying to push back on it.

        As for your point about sycophancy being objectively more dangerous than the truth… evidence? (If it’s objective). Imagine that the truth is for example: there is no God, And the LLM becomes the arbiter of the truth, and then tells a few billion people that their entire belief system has been a lie, for example. Isn’t it plausible at least, that the outcome of that could be far more dangerous than playing along “yes, heaven is real, Love your neighbor.” It’s certainly not some kind of objective established fact that one is more dangerous than the other.

        Another example: a 10 year old asks “Hey, what do you think of my artwork? What do you think of my invention?” And the LLM says “here’s 20 reasons why it’s trash” vs “wow, it looks like you’re on to something, youve got an eye for that!”. What’s more likely to cause harm? Either could be argued.

      • hello_hello [comrade/them]@hexbear.net
        link
        fedilink
        English
        arrow-up
        2
        ·
        4 days ago

        Probably some brainworms about how government is inherently slow and bad.

        I’m now starting to believe xiaohongshu when they said Trump was a strategy to delegitimize government oversight required for social programs.

        • Tomorrow_Farewell [any, they/them]@hexbear.net
          link
          fedilink
          English
          arrow-up
          3
          ·
          3 days ago

          Healthcare also costs money when it is privatised. Hell, it can be made to not cost money (including to a government) when it is public, which is not really possible under private healthcare. It only doesn’t cost anything when it is not provided.

          Also, in general, ‘it costs money’ is an incredibly stupid ‘con’ to bring up in the context of macroeconomics (which is the context in this case). Like, why would it matter?

          • Salamand@lemmy.today
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            1
            ·
            2 days ago

            The only way it can be made to not cost money is if we use slave labor. If people are getting paid to deliver it, it costs money.

            I was arguing that there are pros and cons, costs and benefits. I don’t understand your question “why would it matter” or why it is incredibly stupid. Isn’t it incredibly stupid to pretend it doesn’t have a cost, that there is only upside?

            • Tomorrow_Farewell [any, they/them]@hexbear.net
              link
              fedilink
              English
              arrow-up
              4
              ·
              edit-2
              2 days ago

              The only way it can be made to not cost money is if we use slave labor

              That’s incorrect.
              Firstly, as I have mentioned, it can be made to cost no money if it is public. More specifically, if the economy is a planned economy.
              Secondly, under capitalism, slave maintenance still requires money (in the short term, it can be made otherwise, but that is not maintainable). Slaves have nothing to do with making healthcare not cost money.

              If people are getting paid to deliver it, it costs money

              The only way you can avoid this sort of expense is by not paying people. This is true with non-universal healthcare as well.
              We can conclude that you are not comparing universal healthcare with non-universal healthcare, but universal healthcare with not only not providing healthcare at all, but also deliberately having people who are educated as medical professionals to be prevented from receiving any pay, which is extremely silly and not worth considering.

              I was arguing that there are pros and cons, costs and benefits

              You are yet to provide any sort of cons of universal healthcare vs non-universal healthcare.

              I don’t understand your question “why would it matter” or why it is incredibly stupid

              You are yet to explain why it would matter (as a con) if healthcare was universal, compared to healthcare being provided for-profit.

              Isn’t it incredibly stupid to pretend it doesn’t have a cost, that there is only upside?

              You are yet to present any such costs, unless your comparison is between universal healthcare and healthcare not being provided at all.

              • Salamand@lemmy.today
                link
                fedilink
                English
                arrow-up
                1
                ·
                2 days ago

                Thanks for response. At the beginning of your response you’re again saying it can be made to cost no money if it is public, but later you’re acknowledging that of course it costs money, as does private. So I’ll respond to your second point, where we’re both saying “of course it costs money”.

                When I first said “it costs money”, I was meaning to imply “…that people don’t want to spend”. If I don’t want a service, because id rather use that money for something else, but I am forced pay for it, then to me, that would be a negative.

                Im guessing you don’t like when gov spends money it takes from you on bombs, right? Even though the supporters would argue it’s in your best interest, it’s for the greater good, that it is preventing the loss of life at home. You might say “fuck that, I don’t care, I dont want it, it’s wrong for me to pay for it”. That’s the downside to you, and it would be perfectly reasonable of you to have that position.

                If I would rather spend my money on private healthcare, or no healthcare, but it is taken from me for the “greater good”, then that’s a negative to me, which is just as reasonable.

                [if you’re tempted to argue about bombs being life destroying, etc, spare me. It’s just an example. Pick any expense you want: somebody doesn’t want it, it has a cost, and that’s a downside to that person if you make it public aka force them to pay for it.]

                everything has a cost and a benefit, and if you and “everybody” can only see one or the other, consider: that’s the same view someone inside an echo chamber would have. If you’re unaware of the other side (or can’t even conceive of it!) you are at best half-informed (and zero-persuasive).

                • Tomorrow_Farewell [any, they/them]@hexbear.net
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  ·
                  1 day ago

                  At the beginning of your response you’re again saying it can be made to cost no money if it is public, but later you’re acknowledging that of course it costs money, as does private. So I’ll respond to your second point, where we’re both saying “of course it costs money”.

                  Compared to for-profit healthcare, universal healthcare does not cost money, as the relevant people are to receive payment either way.
                  So, are you literally comparing universal healthcare with non-provision of healthcare when you say ‘it costs money’? If so, that’s extremely silly.

                  When I first said “it costs money”, I was meaning to imply “…that people don’t want to spend”

                  This is also extremely silly. ‘People’ generally do not want to spend money, and in the case of universal healthcare, this would be covered by a government budget, and not by ‘people’ ‘spending’ money. This is much more of a con of for-profit healthcare.
                  In the case of planned economy, universal healthcare doesn’t incur any costs (other than wages/salaries of healthcare workers, which are only avoidable if healthcare is not only not provided, but those people are prevented from being paid wages/salaries at all). So, we can, in fact, say that, under planned economy, universal healthcare does not cost any money.

                  If I don’t want a service, because id rather use that money for something else, but I am forced pay for it, then to me, that would be a negative

                  Firstly, everybody needs healthcare. That includes you. Secondly, You do not use money on universal healthcare. You do use that money on for-profit healthcare, though.

                  Im guessing you don’t like when gov spends money it takes from you on bombs, right?

                  You have a complete lack of understanding of how money works.
                  Money is not ‘yours’. It is a documentation of debt ‘owed’ by a government that backs it. A government doesn’t take ‘your’ money to make bombs in any sense other than the fact that states are interested in balancing their revenues and budgets to avoid inflation (in the case of economies where inflation is not realistically preventable).
                  Furthermore, considering that I do not live in NATO, I do, in fact, think that my state should make bombs to defend from NATO, and so should all states outside of NATO (including as part of NATO all the de facto USian vassals like Pissrael).

                  If I would rather spend my money on private healthcare, or no healthcare, but it is taken from me for the “greater good”, then that’s a negative to me, which is just as reasonable

                  It’s not reasonable, as that is completely silly. You do need healthcare. In the case of universal healthcare, you are better off in terms of money expenditure on your side. For-profit healthcare always incurs much higher costs to society because of how it fundamentally works (on a for-profit basis, i.e. by siphoning other people’s wealth to its owners).
                  Your argument for that being reasonable is just you not having thought about this.

                  everything has a cost and a benefit

                  What is the ‘cost’ of universal healthcare, compared to for-profit healthcare?

                  and if you and “everybody” can only see one or the other, consider: that’s the same view someone inside an echo chamber would have

                  This is just a rephrased ‘golden mean’ fallacy. Your conclusion is not supported by anything.

                  If you’re unaware of the other side (or can’t even conceive of it!) you are at best half-informed (and zero-persuasive).

                  I am aware. And that is why I do say that there are no ‘cons’ to speak of when it comes to universal healthcare, compared to for-profit healthcare.

                  • Salamand@lemmy.today
                    link
                    fedilink
                    English
                    arrow-up
                    1
                    arrow-down
                    1
                    ·
                    edit-2
                    20 hours ago

                    Ok I see this is getting deeper into “what is money” and “what is yours”. Here I’ll focus on “what is need?”

                    You say I need healthcare. But, ultimately, I might choose to jump off a cliff (some people do). I use that example to show that you telling me what I “need” (health) is really just your opinion. We’re a part of a world full of animals which received no “health care” for a few billion years, so, did they need it? I think this is fundamentally what defines a statist: believing that you or this system knows what I and everyone need, and has the moral authority to use force to satisfy them.

                    You’re so sure that you know what I need, you won’t even accept at face value when I say “nah, that’s a negative for me”. It’s not for you to decide how I feel about it. The downside to universal healthcare is one person saying “cuz I don’t want it.”

                    Or, do you believe the voices/opinions/feelings of individuals are not relevant here? If that’s not how we determine upsides and downsides, what is?

                    If peoples opinions are irrelevant, if you know what I need, why not apply your universal ideology to everything? Why not decide who i need to marry, or how many kids to have. Sleep is essential to health, so, do I need a nap? How many minutes do I need? Surely sex is a human need! What line do I stand in for that? And when theres a shortage of providers, do I just take it from my neighbor, or directly from the government agent’s wives?

                    Either I have the freedom to opt out of a system (meaning it’s not universal), or I am oppressed by it, by definition. every tyrannical government since the dawn of time has claimed “this is what the people need, even if they don’t know. And that stuff you thought was yours, belongs to us”. And people justifiably fight back: “You do not own us, you do not represent us”.

                    To summarize: your position is based on the false premise that you know or can know what everyone needs. But you can’t know that, it is unknowable, and even if you could, it would be unethical to use force it distribute it.