• PointyFluff@lemmy.mlBanned
    link
    fedilink
    English
    arrow-up
    7
    ·
    29 days ago

    First of all. BULLSHIT. Second. why would you give a bot write-access to your filesystem.

    • rumba@lemmy.zip
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      1
      ·
      29 days ago

      The idea is you give it shell access. Say use super coder agent bob johnson to write a thing that does x using this [framework], separate files by best practice for x y and z features, ask security agent OSO to look over the code and suggest changes, ask agent U.N.I.T to make unit tests, when the code looks good, run through the unit tests. If anything fails keep fixing and iterating until every thing passes. Create a README.MD for everything that was done, Create a TODO.MD for any future suggestions.

      I’m simplifying, but this actually works to an extent. Each of the agents keep the context windows small, the whole thing stays sane and eventually nets some project that works. The downside is you end up giving it quite a bit of leeway to get the job done or you sit over it watching and authorizing it’s every move.

      Kinda strange to see a safety director do that…

      • BJW@lemmus.org
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        1
        ·
        28 days ago

        You should avoid the FuckAI community - they hate hearing that this application of the technology is wholly viable. To them, it’s only capable of creating crap, and to suggest otherwise is to be buried in a mountain of down votes. I was actually surprised you had a positive reaction, until I realized this is the Technology community.

        • rumba@lemmy.zip
          link
          fedilink
          English
          arrow-up
          1
          ·
          28 days ago

          Ohh yeah, best to stay out of echo chambers when you aren’t of the same voice.

          To be fair, They’re not entirely wrong. It will straight up make a horror show if you don’t keep an eye on it and even if it succeeds, it’s nothing to really cheer about because it will eventually fuck over a LOT of people.

          You can’t just tell it to make you a browser, insert $20k in tokens and walk away, but you absolutely can get it to make a multi player online party game or make a websocket client/server/admin to manage a dozen pc’s hooked into a video wall.

    • BanMe@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      29 days ago

      Two years ago: “They expect us to rely on this for code that actually compiles?”

      So yeah in another year or two what you describe will be common, sure.

      OpenClaw is like the insane libertarian cousin of all the AI products tho, it’s bizarre that people are using this in production scenarios considering how it behaves.

  • panda_abyss@lemmy.ca
    link
    fedilink
    English
    arrow-up
    6
    ·
    1 month ago

    If I was the director of AI safety, and I used AI to own and delete my inbox, I sure as shit would never tell a soul.

    This is pure unbridled incompetence.

    • XLE@piefed.social
      link
      fedilink
      English
      arrow-up
      3
      ·
      edit-2
      1 month ago

      The whole “AI safety” field is this incompetent. These people that will tell you AI is on the verge of creating a bioweapon, and then run random code in a command line. Completely and totally unserious.

      • Eufalconimorph@discuss.tchncs.de
        link
        fedilink
        English
        arrow-up
        2
        ·
        29 days ago

        The “AI safety” field is about two things: marketing AIs as so powerful that they’re risky to use but riskier to get left behind by competitors using, and keeping AIs from doing so much brand damage that stock price suffers. This story is about marketing an AI as powerful.

      • panda_abyss@lemmy.ca
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 month ago

        I don’t know what the hell has happened, but some of these people are basically human jellyfish. Big tech is full of them now.

        No thought enters their mind, but they dodge the layoffs and the PIPs and get promoted like this.

        I don’t fucking get it.

        • GreenBeard@lemmy.ca
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 month ago

          It’s just the natural progression of a disease that spreads outwards from Management. The bosses want yes-men, not people capable of independent thought.

          • SkyeStarfall@lemmy.blahaj.zone
            link
            fedilink
            English
            arrow-up
            1
            ·
            1 month ago

            In other words, it’s why authoritarianism always fail

            And capitalism is very specifically not a democratic economic system. There’s a hierarchy. The owners are the ones in power

    • criss_cross@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      1 month ago

      If I was a director of AI safety I wouldn’t let openclaw within 100feet of anything. Let alone my work machine.

      • LiveLM@lemmy.zip
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 month ago

        If the Director of AI Safety is plugging code with extensive security flaws documented and reported into their real life inbox, imagine the Average Joe.

    • Wispy2891@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      30 days ago

      Especially your work mailbox, that is a prime target for hackers and scammers, where a hidden prompt for prompt injection isn’t that impossibile.

      This IMHO is a fireable offense, not a funny anecdote

    • Zwuzelmaus@feddit.org
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 month ago

      If I was the director of AI safety, […] would never tell a soul.

      As a director of something, you are kinda public person. No way to just not tell.

  • LastYearsIrritant@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    5
    ·
    1 month ago

    I love how these models apologize like they mean it. It doesn’t mean it. It doesn’t feel bad, and it will do it again.

    Apologies mean “I made a mistake and I learned from it so it won’t repeat.”

    Sure it claims it added more notes to it’s config, but if it ignored the rules before, what makes you think that new rules are going to change anything?

    • atopi@piefed.blahaj.zone
      link
      fedilink
      English
      arrow-up
      1
      ·
      30 days ago

      it is made to copy how humans write and speak

      the AI had been scored for how good it learned from humans to sound sorry

    • panda_abyss@lemmy.ca
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 month ago

      But it’s adding it to a text file that eats up a ton of tokens and routinely gets ignored!

    • Clent@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 month ago

      They behave exactly a child does when a parent forces an apology.

      They have the words they’re expect to say so they do say them but they don’t undersranr why, they definitely don’t mean it and they lack the restrain to not doing whatever they apologized for over and over.

    • 🌞 Alexander Daychilde 🌞@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 month ago

      Apologies mean “I made a mistake and I learned from it so it won’t repeat.”

      At best it might not make the same mistake again if that memory is in the current context. But more likely: It will not remember.

      Although latest Gemini in particular has much more room for “remembering” things, still.

      But “I made a mistake”? It is not self-aware in any way shape or form to the degree where “I made a mistake” carries any real meaning.

      • sp3ctr4l@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        1
        ·
        30 days ago

        But… but… it generates text that seems like a human wrote it!

        Therefore it must be a human!

        … A whole lot of humans are failing a reverse turing test, just, fundamentally.

    • bleistift2@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 month ago

      Apologies mean “I made a mistake and I learned from it so it won’t repeat.”

      I beg to differ. An apology means that you feel bad about harm inflicted upon others. To prove the point: You apologize when you’re late due to circumstances that are outside of your control. Or when you accidentally bump into someone on the bus when the driver slams the break.

      • sp3ctr4l@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 month ago

        There are two kinds of apologies.

        Customary, and Genuine.

        They’re describing a genuine apology.

        You’re describing a customary apology.

  • lemmydividebyzero@reddthat.com
    link
    fedilink
    English
    arrow-up
    5
    ·
    30 days ago

    They released a version recently that fixed over 60 security vulnerabilities. All of them were high or critical.

    How many more are there to find? Thousands?

    Whoever uses this on a PC with anything useful on it, is absolutely insane.

  • Echo Dot@feddit.uk
    link
    fedilink
    English
    arrow-up
    2
    ·
    30 days ago

    Yep that’s about the level of intelligence I would expect from Meta’s AI safety director.

    Doing the one thing that you’re never supposed to do, letting an AI loose on anything sensitive.

    For her next trick she’s going to run while holding scissors in one hand and a bottle of boiling acid in the other. What could go wrong.

  • LittleBorat3@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    30 days ago

    The I’m sorry part is always great, I always wanted an apology by an LLM not that it works as specified 😆

    It can be like your least competent colleague on roids

    • SaraTonin@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      30 days ago

      “I promise it won’t happen again”

      Really? Because you promised it wouldn’t happen in the first place. Now here we are…

  • XLE@piefed.social
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 month ago

    If all the qualifications I need to be a security engineer for Facebook are

    • buy a Mac Mini
    • don’t configure remote access
    • install untrusted software
    • leave

    Then Facebook should hire me. I’ll buy so many Mac Minis on their dime. I will run so many crazy things.

  • Phoenixz@lemmy.ca
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 month ago

    How come some 25yo person is a director at Facebook?

    I mean, even if she is a child prodigy genius, which she obviously is not as she is face first fist deep into AI, how the frack do you have even enough life experience to become a director of any large organization at that age unless you somehow cheated your way in?

    Then reading the hat she’s doing and how she resolved it tells me she doesn’t know shit about computers, she just know how to type commands into AI systems

    Is this the future? Am I going to end up being one of those long bearded magicians that still know the old technology, that still can still save the day by using shell commands?

    • Rimu@piefed.social
      link
      fedilink
      English
      arrow-up
      3
      ·
      30 days ago

      They need to have some kind of AI safety team, as a fig leaf. But they don’t don’t want it to slow them down so they make sure it’s incompetent and ineffective.

      Just a theory.

    • LiveLM@lemmy.zip
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      1 month ago

      Am I going to end up being one of those long bearded magicians that still know the old technology, that still can still save the day by using shell commands?

      More like the long bearded homeless guy because you aren’t sycophantic enough to get hired by these fuck ass companies

    • boonhet@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 month ago

      Don’t American companies give a loooot of people director or executive director titles just because it sounds impressive? In roles where you gotta talk to corporate customers at least

    • Chulk@lemmy.ml
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 month ago

      Yeah, I personally wouldn’t be announcing this failure to the world if I were in her position. I don’t think you could torture it out of me lmao

      • CmdrShepard49@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 month ago

        Maybe they want to get this out there as cover if/when some regulator somewhere decides to subpoena records from the AI safety director.

  • borth@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 month ago

    Nothing humbles you like telling your OpenClaw “confirm before acting” and watching it speedrun deleting your inbox. I couldn’t stop it from my phone. I had to RUN to my Mac mini like I was defusing a bomb

    Nothing humbles you like that?

    • sp3ctr4l@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 month ago

      I’ve got a suggestion for her:

      Burn all your money and ids and property, become homeless.

      That will humble you.

  • yogurtwrong@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 month ago

    I hate how Apple users feel the need to call their computer by the brand. It really makes me cringe.

    It is called “a computer”

    Maybe “PC”

    “box” if you really have to flex that UNIX

    They should treat their computers less like a sports car and more like a van

    • Art3mis@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      1 month ago

      I mean, isnt that the entire point of Apple? Brand recognition and percieved status attributed to said brand. Its like rappers and gucci belts or country artists and ford pickups

      • AlphaOmega@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        30 days ago

        Every time someone organically refers to their computer as an Apple or Mac, an Apple marketing executive creams their pants.

    • Rai@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 month ago

      Ehhhh as an owner of five or six windows computers, four Linux machines, and a couple Apple computers, I always specify which machine I’m referring to if I’m talking about something I did/something that happened on one of them in case it could be pertinent.

  • BrianTheeBiscuiteer@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 month ago

    AI: I’m so sorry. You’re correct I violated protocol. I’ll make a note of this so it won’t happen again.

    Nurse: You gave my 5 year old patient 5000cc of morphine!