A few months back I reviewed FauxPilot, a self hosted AI coding assistant that ran on docker. Overall it was an okay experience but it’s been some time and the AI llm scene has changed drastically. What’s Changed One of the biggest changes to llm’s is better quantizing methods. Quantizing allows models to be shrunk down…