upvote
I don't have specifics since it's been months, but LiteLLM on a hetzner server, deployed through Coolify was using 1-4 GB (cannot exactly, and dont know why either).

Bifrost feels very light, though.

Will try LiteLLM if it's in Rust.

Would also appreciate a slicker aesthetic. I got used to Bifrost shadcn with 0 border radius.

reply
- We recently migrated to shadcn, which also comes with dark mode support. - You can subscribe to the issue or email me at yujong at berri.ai

I’m happy to provide any support if you’re willing to try out the initial version.

reply
deleted
reply