Hacker News
new
past
comments
ask
show
jobs
points
by
freakynit
8 hours ago
|
comments
by
freakynit
7 hours ago
|
[-]
To the author: why is this taking 4.56GB ? I was expecting this to be under 1GB for 4B model.
https://ibb.co/CprTGZ1c
And this is when Im serving zero prompts.. just loaded the model (using llama-server).
reply