Yes, but make sure you grab the latest llama.cpp release
replyNew model archs usually involve code changes.
Awesome! It looks like the llama.cpp-hip AUR was updated today to b8179, and it works.
replyYou would need the Dynamic 2.0 GGUF as discussed in the article.
replyBut mmmmmm, Q8_K_XL looks mighty nice.