Hold on.. the routed experts are in FP8 now? Previously they were in BF16. Nice, this shall cut my download time by half!
replyThis time they just made FP8 "default", accompanied by "-BF16" model/page (previously "-FP8" was released alongside).
reply