• 0 Posts
  • 6 Comments
Joined 10 months ago
cake
Cake day: April 28th, 2024

help-circle
  • This isn’t really true — a lot of the newer MoE models run just fine on a CPU coupled with gobs of RAM. Yes, they won’t be quite as fast as a GPU, but getting 128GB+ of VRAM is out of reach of most people.

    You can even run Deepseek R1 671b (Q8) on a Xeon or Epyc with 768GB+ of RAM, at 4-8 tokens/sec depending on configuration. A system supporting this would be at least an order of magnitude cheaper than a GPU setup to run the same thing.


  • Quit letting politics ruin our collective ability to drive by suggesting to people that Volkswagen is now an evil company. They support Hitler because they think his business policies will benefit their company. True or false as that may be their company is still great at making cars and we shouldn’t be infighting about that.


  • So do you think that’s an OK comment to our discussion?

    I’m not passing any judgement on whether anything is an “OK comment.” In fact, on the topic being discussed, I think I agree with you more than the person you’re replying to. As I said though, I only stopped by to comment on your fallacious claim that the person committed an ad hominem, because it’s super fucking annoying to me when people throw that term around when they don’t know what they’re doing.

    you must understand you are wrong, because “obvious fact”

    THIS PART IS THE PERSON’S ARGUMENT, no matter how good or bad as it might be, and no matter how much it is surrounded by words that you view as insulting. In fact, if anyone is resorting to an ad hominem here, it’s you, by attacking their character and dancing around the actual meat of their argument (again, as good or bad as it might be). Therefore I hope you agree with me that the other commenter did not commit an ad hominem fallacy. Or did you not read the link I posted yet?