Thank you!
replyafaik ollama relies on llama.cpp and mmap. mmap loads pages on demand and doesn't use the same explicit cache or parallel reads like my engine. Most likely ollama/llama.cpp will be way slower in this case
Please don’t use Ollama.
replyDoesn't Ollama use llama.cpp so their point stands even if they used it directly?
replyIt wouldn't be the first time ollama's llama.cpp fork reintroduced bugs and was missing important optimizations.
reply[dead]
reply