Hacker News
new
past
comments
ask
show
jobs
points
by
adoltech
1 hours ago
|
comments
by
tosh
1 hours ago
|
[-]
I will look into it more to see if I have configured it wrong but I think the token efficiency hurts cache use as caching only starts at 1024 tokens so for tasks where smol is under or close to 1024 tokens most of them are uncached
reply