Linux server admin, MySQL/TSQL database admin, Python programmer, Linux gaming enthusiast and a forever GM.

  • 3 Posts
  • 248 Comments
Joined 3 years ago
cake
Cake day: June 8th, 2023

help-circle














  • You can’t run an LLM on a crappy PC, that’s true. You need at least a decent CPU. If you’re running an LLM locally, there’s no calls to the outside world. I have a very mid computer, it isn’t great, and unfortunately I need to work with LLMs due to my job. A call to my local LLM might take ~2 minutes where using an online platform it might take ~30 seconds, but I think that’s a reasonable trade.

    If you have a gaming PC, you have a platform that can run a local LLM.