-
@xsphi Meanwhile I'm using local LLMs only for conversational AI, with thousands of lines of black magic around it to make it do cool things. Mixtral even quantized runs like trash for me. Something about using a P40 from 2016?On twitter.com
❤️ 1 Favorite
Mood +3 🙂