Show HN: TurboGPT: train 22KiB transformer in 13s

(github.com)

19 points

[-]

At that scale it seems like you could just solve the KKT conditions directly. Exaggerating but only a little