upvote

points

by nl13 hours ago |
comments
upvoteby bigyabai7 hours ago|
[-]
Not even a cluster of Mac Pros could run a dense 5T parameter model with RDMA, to my knowledge.
reply
upvoteby zozbot2346 hours ago|
parent|
[-]
SOTA models are reportedly MoE, not dense.
reply