upvote

points

by toasty22810 hours ago |
comments
upvoteby andsoitis9 hours ago|
[-]
A hosted instance serves multiple customers at a time. A local model only one.
reply
upvoteby toasty2287 hours ago|
parent|
[-]
How many though? At 1m context you quickly fill a full gb300's 280gb of memory
reply