CUDA gets into an area that I wouldn't use it for. My local LLM machine is running Void linux.