Yep, clueless. I stopped reading at that point. For the audience, large language models come in all sizes and you can run some small but useful ones fairly quickly even without a GPU. They keep getting more capable for the size as well. Remember the uproar about Deepseek R1? Well, progress hasn’t stopped.
It’s not even that. It’s like trying to run an AAA game on a 10 year old laptop and complaining the game is garbage because your frame rates are too low.
Yep, clueless. I stopped reading at that point. For the audience, large language models come in all sizes and you can run some small but useful ones fairly quickly even without a GPU. They keep getting more capable for the size as well. Remember the uproar about Deepseek R1? Well, progress hasn’t stopped.
It’s not even that. It’s like trying to run an AAA game on a 10 year old laptop and complaining the game is garbage because your frame rates are too low.