• s@piefed.world
    link
    fedilink
    English
    arrow-up
    23
    ·
    2 days ago

    What is the difference between an AI chatbot and a non-AI chatbot in this context?

    • SpicyTaint@lemmy.world
      link
      fedilink
      English
      arrow-up
      46
      ·
      2 days ago

      “AI” = Stuff like ChatGPT that use Large Language Models (LLM)

      “Non-AI” = Bots that don’t use LLMs.

          • s@piefed.world
            link
            fedilink
            English
            arrow-up
            7
            arrow-down
            1
            ·
            2 days ago

            I’m not super familiar with ELIZA but this section of the text

            ELIZA starts its process of responding to an input by a user by first examining the text input for a “keyword”. A “keyword” is a word designated as important by the acting ELIZA script,…”

            makes it sound like an LLM with only a small pool of language data? An LM, if you will.

            • sp3ctr4l@lemmy.dbzer0.com
              link
              fedilink
              English
              arrow-up
              12
              ·
              2 days ago

              No, its much, much more primitive than an LLM.

              It scans your last message for keywords, potentially multiple keywords, keywords in some order, etc, fairly simple patterns you can use something like regex to parse.

              Then, based on what it detects, it picks from something like a tree of responses, maybe reinserting the specific keyword you used.

              Basically, imagine plotting out the entire dialogue tree from some video game.

              … It really is not too much more complex than that.

              An LLM, on the other hand, has been trained on something like trillions of pages of text, which then gets processed through multiple billions of layers of per word/character comparative analysis, producing a very complex set of relationships between characters and words, that it then uses to evaluate responses.

              And when I say ‘very complex’ I mean that the results of parsing all the training data are not human readable, even by experts, its a gibberish mass of relationships between billions of matrices, something like that… its not even really code that you could read and then say ‘oh! that part is causing this problem!’

              So tldr:

              I could probably teach you how to write a simple oldschool chatbot that works in a terminal or on IRC, in like, a week or two, even if you have literally 0 prior coding experience. You could easily make a simple chatbot fit in under a megabyte of code, even under a tenth or hundredth of a megabyte, for the actual chat parts of it.

              … I absolutely could not teach you how to make an LLM from scratch, and even if I could, we’d have to rent some server clusters to process even a tiny training data set, for a very primitive version of al LLM. And it would take up gigabytes of local space, and thats with the finished, condensed, ‘trained’ model. Could easily be thousands of times more data that would go into the training.

              • dave@feddit.uk
                link
                fedilink
                English
                arrow-up
                7
                ·
                2 days ago

                That tldr needs a tldr…

                But also you absolutely can learn & build small versions of LLMs on a regular laptop. I did it on my old 2017 Dell XPS, and trained it on the complete works of Shakespeare. It learnt to write almost passable Shakespeare hallucination in a couple of hours. There’s a good tutorial online if you search for it.

                • sp3ctr4l@lemmy.dbzer0.com
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  ·
                  2 days ago

                  Well shit.

                  I’ve only figured out how to just run one locally on a Steam Deck, not build and train one.

                  Still though, even for this more primitive one you built, I’m guessing the overall file footprint size of it was orders of magnitude greater than what you could fit into a megabyte of more simpler chatbot that runs in a local terminal, right?

            • ZombiFrancis@sh.itjust.works
              link
              fedilink
              arrow-up
              4
              ·
              2 days ago

              Sure, but in this cases the responses are directly programmed to the keywords and not scrawling through datasets for patterns to replicate.

    • TheTechnician27@lemmy.world
      link
      fedilink
      English
      arrow-up
      9
      arrow-down
      2
      ·
      edit-2
      2 days ago

      In this case, a simple chatbot like she interacted with falls under AI. AI companies have marketed AI as synonymous with genAI and especially transformer models like GPTs. However, AI as a field is split into two types: machine learning and non-machine-learning (traditional algorithms).

      Where the latter starts gets kind of fuzzy, but think algorithms with hard-coded rules like traditional chess engines, video game NPCs, and simple rules-based chatbots. There’s no training data; a human is sitting down and manually programming the AI’s response to every input.

      By an AI chatbot, she’d be referring to something like a large language model (LLM) – usually a GPT. That’s specifically a generative pretrained transformer – a type of transformer which is a deep learning model which is a subset of machine learning which is a type of AI (you don’t really need to know exactly what that means right now). By not needing hard-coded rules and instead being a highly parallelized and massive model trained on a gargantuan corpus of text data, it’ll be vastly better at its job of mimicking human behavior than a simple chatbot in 99.9% of cases.

      TL;DR: What she’s seeing here technically is AI, just a very primitive form of an entirely different type that’s apparently super shitty at its job.

  • brotato@slrpnk.net
    link
    fedilink
    arrow-up
    3
    ·
    2 days ago

    Slack does have AI features now, mostly focused around summarization. I found the features pretty useless and turned them off (as much as they allow you to, at least). It’s not very often that I don’t care to know the whole context of messages I receive at work. And I do have channels that I usually just skim or ignore that the summaries weren’t super helpful for. It strips out way too much of the conversation.

    Similarly, I really dislike the Apple Intelligence summarization features. It drove me to finally turn off Apple Intelligence on all my devices. Do people find summarization useful? Genuinely curious for use cases.

  • bus_factor@lemmy.world
    link
    fedilink
    arrow-up
    10
    ·
    2 days ago

    Funny enough, Slackbot (or at least the current incarnation of it) is definitely based on an LLM. Although I suspect this screenshot is older, because when the current Slackbot gives bad responses it does so a lot more verbosely.

    I’ve found it to usually work better than most AI, actually, at least if you ask it stuff like “which slack threads do I need to follow up on?” or other stuff it can work out based on your slack activity.

  • MountingSuspicion@reddthat.com
    link
    fedilink
    arrow-up
    9
    arrow-down
    3
    ·
    2 days ago

    Presumably she works in tech, but it’s very strange to see that kind of interaction. I don’t know why anyone would type in all caps or use multiple question marks regardless of if they’re talking to AI, a simple bot, or a real person. Maybe a “help” or “options” but I can’t imagine thinking an all caps hello would help in this situation.

    • Ledivin@lemmy.world
      link
      fedilink
      arrow-up
      16
      ·
      2 days ago

      Remember that half of tech is in sales/management/etc. and half of them are complete idiots

      • titanicx@lemmy.zip
        link
        fedilink
        arrow-up
        1
        arrow-down
        3
        ·
        2 days ago

        And many of us get absolutely pissed off when we have to talk to an idiotic but they can’t answer a simple question. Hell I get pissed off when I have to talk to somebody in Indonesia the Philippines or India that can’t answer a simple question.

    • xkbx@startrek.website
      link
      fedilink
      arrow-up
      15
      ·
      2 days ago

      That’s AlbertaTech. She does comedy skits on youtube/tiktok related to the tech world. She’s really bright and funny, I would assume she’s doing that for the bit.

  • halvar@lemy.lol
    link
    fedilink
    arrow-up
    1
    arrow-down
    1
    ·
    2 days ago

    It would be worse if it was an AI, then it would just straight up mislead you

    • NeatNit@discuss.tchncs.de
      cake
      link
      fedilink
      arrow-up
      7
      arrow-down
      2
      ·
      2 days ago

      Your pedantry is acknowledged and appreciated, but everyone knows exactly what they meant including you. Languages evolve and words’ meanings change and evolve over time.

      Merriam-Webster: https://www.merriam-webster.com/dictionary/ai

      Quote, some emphasis mine:

      artificial intelligence

      […]

      specifically : a program or set of programs developed using tools (such as machine learning and neural networks) and used to generate content, analyze complex patterns (as in speech or digital images), or automate complex tasks

      see also generative AI

    • Eiri@lemmy.ca
      link
      fedilink
      arrow-up
      2
      arrow-down
      1
      ·
      2 days ago

      Technically you can call a chain of three if/else conditions an AI but come on, you KNOW that’s not what we mean.