Controversial AI art piece from 2022 lacks human authorship required for registration.

  • cole@lemdro.id
    link
    fedilink
    English
    arrow-up
    5
    arrow-down
    4
    ·
    1 year ago

    This is incorrect actually. The models these AIs run from by definition have imperfect recall otherwise they would be ENORMOUS. No, that’s actually exactly the opposite of how these work.

    They train a statistically weighted model to predict outputs based on inputs. It has no actual image data stored internally, it can’t.

    • drewdarko@kbin.social
      link
      fedilink
      arrow-up
      6
      arrow-down
      2
      ·
      1 year ago

      This is incorrect actually. The models these AIs run from by definition have perfect recall and that is why they require ENORMOUS resources to run and why ChatGPT became less effective when the resources it was allocated were reduced.

      -ChatGPT

      • cole@lemdro.id
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        2
        ·
        1 year ago

        No, they take exponentially increasing resources as a consequence of having imperfect recall. Smaller models have “worse” recall. They’ve been trained with smaller datasets (or pruned more).

        As you increase the size of the model (number of “neurons” that can be weighted) you increase the ability of that model to retain and use information. But that information isn’t retained in the same form as it was input. A model trained on the English language (an LLM, like ChatGPT) does not know every possible word, nor does it actually know ANY words.

        All ChatGPT knows is what characters are statistically likely to go after another in a long sequence. With enough neurons and layers combined with large amounts of processing power and time for training, this results in a weighted model which is many orders of magnitude smaller than the dataset it was trained on.

        Since the model weighting itself is smaller than the input dataset, it is literally impossible for the model to have perfect recall of the input dataset. So by definition, these models have imperfect recall.

        • drewdarko@kbin.social
          link
          fedilink
          arrow-up
          2
          arrow-down
          1
          ·
          1 year ago

          In other words they require exponentially more input because the AI doesn’t know what it is looking at.

          It uses its perfect recollection of that input to create a ‘model’ of what a face should look like and stores that model like a collage of all the samples and then uses that to reproduce a face.

          It’s perfect recollection with an extra step.

          • cole@lemdro.id
            link
            fedilink
            English
            arrow-up
            2
            arrow-down
            1
            ·
            1 year ago

            Well, what you described is simply not a perfect recollection. It is many small tidbits of information that combined together can make a larger output.

            That’s exactly how our brains work too

            • drewdarko@kbin.social
              link
              fedilink
              arrow-up
              2
              ·
              1 year ago

              If our brains worked exactly the same as AI programming then AI wouldn’t be needed because it would be no different than how we are doing things without AI.

              • cole@lemdro.id
                link
                fedilink
                English
                arrow-up
                2
                arrow-down
                1
                ·
                1 year ago

                I feel like you keep misrepresenting what I’m saying. Nowhere did I say that our brains work completely and exactly the same as AI. However, we do learn in much the same way. By amortizing small amounts of information and drawing connections between them