Check out exo if you haven’t already https://github.com/exo-explore/exo
replyThank you! Looks cool
reply| exo provides multiple API-compatible interfaces for maximum compatibility with existing tools: | | OpenAI Chat Completions API - Compatible with OpenAI clients | Claude Messages API - Compatible with Anthropic's Claude format | OpenAI Responses API - Compatible with OpenAI's Responses format | Ollama API - Compatible with Ollama and tools like OpenWebUI
So a bit higher-level than a virtual device, but yes still pretty neat.
Same, I thought it was about some cool network tunneling that made the GPU look like native hardware on the Linux host.
reply