Self-Hosting an AI Server: PVE GPU Passthrough, Drivers, CUDA and cuDNN for Running Local LLMs
With open source LLMs and the tools the community keeps shipping, AI is finally within everyone's reach. Plenty of people can now run large models on a local laptop — but laptops are underpowered, and they have other work to do; you can't keep a model running on them around the clock. I prefer PVE, so here's my deployment walkthrough, a guide for my future re-deploys.









