• MyNamesNotRobert
      link
      fedilink
      English
      arrow-up
      4
      ·
      1 year ago

      llamacpp. Remember to modify the launch script to use multiple cores. Go to hugging face io and look for GGUF compatible models.