upvote
Is there hardware you would suggest that you can actually buy today? Pricing is out of control right now, if you can even find stock.
reply
An RTX4090 or a 128gb macbook can generate a pretty reasonable number of tok/sec. Those are not cheap, but within the realm of serious hobbyist. I really hope the AI bubble deflates a bit so consumers can get more powerful hardware at the low thousand $ range.
reply