AI Everyday
Matt Wallace, Tech CTO, covers innovation in AI with an eye on interesting takes for executives, entrepreneurs, and software engineers.
AI Everyday
AI Everyday - #20 - Llama2, GPTQ Quantization, and Text-Generation-Webui
•
Matthew Wallace
Use Left/Right to seek, Home/End to jump to start or end. Hold shift to jump forward or backward.
Matt discusses Llama2 with GPTQ quantization, which is much more powerful than previous methods of quantizing model weights, and demos text-generation-webui.
