minus-squareRandomlyRight@sh.itjust.workstoSelfhosted@lemmy.world•Using Mac M2 Ultra 192GB to Self-Host LLMs?linkfedilinkEnglisharrow-up2·2 days agoTake a look at NVIDIA Project Digits. It’s supposed to release in May for 3k usd and will be kind of the only sensible way to host LLMs then: https://www.nvidia.com/en-us/project-digits/ linkfedilink
Take a look at NVIDIA Project Digits. It’s supposed to release in May for 3k usd and will be kind of the only sensible way to host LLMs then:
https://www.nvidia.com/en-us/project-digits/