Want to run Qwen3.8 27B? Download the quantized model from HF, git clone tinygrad, then run `DEV=METAL python3 -m tinygrad.llm --max_context 8192 -m <GGUF File>`. Read the code and experiment - takes 1 minute.
Compare that with PyTorch (great, but almost impossible to comprehend and modify, IMO) or Mojo/MAX (complex and not even fully open source, not to mention that the Modular folks aren’t particularly nice). Tinygrad is a breath of fresh air.
i ran 7MW and 20,000 gpus in containers in WA for mining eth for many years. it is a bad idea that he's trying to do. but george is george and the hype is real...
sorry, no writeup other than what i've posted already.