Have you tried the 27B dense version? It’s way better for coding.
replyUnfortunately on Strix Halo or any similar unified memory set up, dense models are gonna be dirt slow due to the tiny memory bandwidth... But I agree, 27B is superior.
replyExactly. That's why I'm disappointed there wasn't a 122B version, it's 27B but for Strix Halo users.
reply