LiteLLM doesn't quite live up to its name. With all those features, there is nothing "lite" about it. It is essential for a project to live up to its name.
replyImagine Sqlite adding heavy features from Postgresql, e.g. row-level security.
LiteLLM's problem isn't really features, it's how bloated all the features are, and specifically how AI maximalist and janky their dev practices are.
replythanks for the feedback. genuinely curious what you think we could be doing better, especially around our dev practices. Would love to hear specifics.
replyDidn't yall have a release of a package that stole user keys or such?
replyBut imagine Sqlite not supporting joins or window functions... sure they are useful but look how many LOC it adds! Who is the arbiter of what Lite actually means?
replyWe run it at my org and it's never been a noticeable resource hog. It's actually the best performer between it, our AI observability stack and the front end.
reply