@[email protected] to Free Open-Source Artificial [email protected]English • 1 year agoMeet Mistral 7B, Mistral’s first LLM that beats Llama 2dataconomy.commessage-square7fedilinkarrow-up129
arrow-up128external-linkMeet Mistral 7B, Mistral’s first LLM that beats Llama 2dataconomy.com@[email protected] to Free Open-Source Artificial [email protected]English • 1 year agomessage-square7fedilink
minus-square@[email protected]OPlinkfedilinkEnglish6•edit-21 year agoNot true. See — or actually nothing to be seen here, since “it just works”: https://github.com/ggerganov/llama.cpp/discussions/3368 and https://huggingface.co/TheBloke/Mistral-7B-v0.1-GGUF https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GGUF And here is someone describing how to do the quantization yourself: https://advanced-stack.com/resources/running-inference-using-mistral-ai-first-released-model-with-llama-cpp.html
Not true. See — or actually nothing to be seen here, since “it just works”: https://github.com/ggerganov/llama.cpp/discussions/3368 and https://huggingface.co/TheBloke/Mistral-7B-v0.1-GGUF https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GGUF
And here is someone describing how to do the quantization yourself: https://advanced-stack.com/resources/running-inference-using-mistral-ai-first-released-model-with-llama-cpp.html
Ooh, thanks. 🤗