• Valmond@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    12 hours ago

    Any pointers on how to do that?

    Also, what hardware do you need for this kind of stuff?

    • vivendi@programming.dev
      link
      fedilink
      English
      arrow-up
      1
      ·
      10 hours ago

      First, please answer, do you want everything FOSS or are you OK with a little bit of proprietary code because we can do both

      • Valmond@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        7 hours ago

        I love FOSS but I’m in the check out stage so at the moment the easiest is the best I guess.

        • vivendi@programming.dev
          link
          fedilink
          English
          arrow-up
          1
          ·
          7 hours ago

          download “LM Studio” and you can download models and run them through it

          I recommend something like an older Mistral model (FOSS model) for beginners, then move on to Mistral Small 24B, QwQ 32B and the likes