25 | he/him | Wiradjuri | Junior Vice President of generallyrubbish dot net

  • 0 Posts
  • 1 Comment
Joined 2Y ago
cake
Cake day: Jul 07, 2022

help-circle
rss

They’re Ryzen processors with “AI” accelerators, so an LLM can definitely run on hardware on one of those. Other options are available, like lower powered ARM chipsets (RK3588-based boards) with accelerators that might have half the performance but are far cheaper to run, should be enough for a basic LLM.