Quit letting politics ruin our collective ability to drive by suggesting to people that Volkswagen is now an evil company. They support Hitler because they think his business policies will benefit their company. True or false as that may be their company is still great at making cars and we shouldn’t be infighting about that.
This isn’t really true — a lot of the newer MoE models run just fine on a CPU coupled with gobs of RAM. Yes, they won’t be quite as fast as a GPU, but getting 128GB+ of VRAM is out of reach of most people.
You can even run Deepseek R1 671b (Q8) on a Xeon or Epyc with 768GB+ of RAM, at 4-8 tokens/sec depending on configuration. A system supporting this would be at least an order of magnitude cheaper than a GPU setup to run the same thing.