• @MyNamesNotRobert
    link
    English
    43 months ago

    llamacpp. Remember to modify the launch script to use multiple cores. Go to hugging face io and look for GGUF compatible models.