> What secret sauce do they have?

Quant company usually squeezing every penny.

limited resources, no modern GPUs, no $10 billion dev budgets.

pair it with codewhale, 50 agents, 200 MB of ram.

No secrets—all published. Very efficient attention. Excellent kernels. Great caching subsystem. Small and well trained model.