AI Everyday - #20 - Llama2, GPTQ Quantization, and Text-Generation-Webui
Aug 24, 2023
Matthew Wallace
Matt discusses Llama2 with GPTQ quantization, which is much more powerful than previous methods of quantizing model weights, and demos text-generation-webui.
Matt discusses Llama2 with GPTQ quantization, which is much more powerful than previous methods of quantizing model weights, and demos text-generation-webui.