AI Everyday

AI Everyday - #20 - Llama2, GPTQ Quantization, and Text-Generation-Webui

Matthew Wallace

Matt discusses Llama2 with GPTQ quantization, which is much more powerful than previous methods of quantizing model weights, and demos text-generation-webui.

People on this episode