• pycorax@lemmy.world
    link
    fedilink
    English
    arrow-up
    20
    arrow-down
    9
    ·
    6 months ago

    Android phone makers are shipping on device LLMs?

    Do people actually want these?

    • GregorGizeh@lemmy.zip
      link
      fedilink
      English
      arrow-up
      30
      arrow-down
      4
      ·
      edit-2
      6 months ago

      Yes, in fact that is the only kind of ai i would ever use and entrust my data to. Not the apple one, but an open source model that is running only on my device and answering only to me; using the data I provide only for my interests? That one I would use.

      • Shawdow194@kbin.run
        link
        fedilink
        arrow-up
        6
        arrow-down
        4
        ·
        6 months ago

        I bet these LLM models wont be 100% locally hosted. I imagine some form of data will be piped back to a cloud server

          • Glytch@lemmy.world
            link
            fedilink
            English
            arrow-up
            4
            arrow-down
            2
            ·
            6 months ago

            Is that why there are so many celebrity iCloud leaks floating around the internet?

            • lepinkainen@lemmy.world
              link
              fedilink
              English
              arrow-up
              2
              ·
              6 months ago

              It wasn’t a software issue, but a human issue. People got scammed and gave their logins away.

              This system is built so that nobody can access it and they’ve went to extreme lengths to make it so. It’s also available for auditing, it hardware and software.

            • lepinkainen@lemmy.world
              link
              fedilink
              English
              arrow-up
              2
              arrow-down
              1
              ·
              6 months ago

              “It’s a very thoughtful design. Indeed, if you gave an excellent team a huge pile of money and told them to build the best “private” cloud in the world, it would probably look like this.”

              • Matthew D Green, cryptography teacher at Josh Hopkins

              You can go argue with him if you disagree.

    • Imprudent3449@lemm.ee
      link
      fedilink
      English
      arrow-up
      17
      arrow-down
      2
      ·
      6 months ago

      LLM is AI correct? If my phone is going to do AI at all, I prefer it be done on device for sure. For privacy reasons if nothing else. But it’s not anything I’ve really looked into. I have the S24 and the only AI feature I use is the Circle to search… which I don’t consider to be AI.

      • Eiim@lemmy.blahaj.zone
        link
        fedilink
        English
        arrow-up
        1
        ·
        6 months ago

        LLM is a form of AI, specifically the text AIs like ChatGPT that have suddenly made “AI” a dinner table term. AI in some form or another is almost definitely being used in your device - even for things like filling in gaps in low-quality voice calls, and probably has been for a while. But the problem is that unlike those “old” AIs, LLMs require some significant power to run, so running them on phones will probably require meaningful trade-offs. But the increased security is also a meaningful benefit.

      • Jakeroxs@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        1
        ·
        6 months ago

        They add a kinda nifty “copy subject” option that is supposedly local AI stuff to the samsung gallery, fun to mess with