Hey, chatbot entrepreneurs, let’s prey on the grieving! Project December will “simulate the dead” for just $10 a session. You select from a list of personality traits, add names of relatives and pe…

with early “grieftech” entepreneur Helena Blavatsky

  • FermiEstimate@lemmy.dbzer0.comEnglish
    13·
    1 year ago

    Addressing the “in hell” response that made headlines at Sundance, Rohrer said the statement came after 85 back-and-forth exchanges in which Angel and the AI discussed long hours working in the “treatment center,” working with “mostly addicts.”

    We know 85 is the upper bound, but I wonder what Rohrer would consider the minimum number of “exchanges” acceptable for telling someone their loved one is in hell? Like, is 20 in “Hey, not cool” territory, but it’s all good once you get to 50? 40?

    Rohrer says that when Angel asked if Cameroun was working or haunting the treatment center in heaven, the AI responded, “Nope, in hell.”

    “They had already fully established that he wasn’t in heaven,” Rohrer said.

    Always a good sign when your best defense of the horrible thing your chatbot says is that it’s in context.

    • self@awful.systemsEnglish
      18·
      1 year ago

      it’s very telling that 85 messages is considered a lot. your grief better resolve quick before the model loses coherency and starts digging quotes out of a plagiarized horror movie script

      fuck it’s gross how one of the common use cases for LLMs is targeting vulnerable people with the hope they’ll develop a parasocial relationship with your service, so you can keep charging them forever