‹ All episodes

AI Everyday

AI Everyday - #20 - Llama2, GPTQ Quantization, and Text-Generation-Webui

August 24, 2023 Matthew Wallace
AI Everyday - #20 - Llama2, GPTQ Quantization, and Text-Generation-Webui
AI Everyday
More Info
AI Everyday
AI Everyday - #20 - Llama2, GPTQ Quantization, and Text-Generation-Webui
Aug 24, 2023
Matthew Wallace

Matt discusses Llama2 with GPTQ quantization, which is much more powerful than previous methods of quantizing model weights, and demos text-generation-webui.

Apple Podcasts Spotify Amazon Music Podcast Index Overcast iHeartRadio +
Show Notes

Matt discusses Llama2 with GPTQ quantization, which is much more powerful than previous methods of quantizing model weights, and demos text-generation-webui.