The emphasis on the fans kicking off also had a bit of a turn-off.
replyCan't believe they led with that in the promo video. They potentially have whats finally a competitor to an apple silicon MBP, and they lead with fans?? I love my macbooks precisely because they are silent (among other things, obviously).
replyWhen I clicked, I thought that it was going to smash the turbine blades from the animation to suggest something like "all the performance without the thermals," but nope, they just became laptop fans. And seconds later, it started blowing heat/steam out of them!
replyThat's the most uncanny marketing for an ARM laptop I've ever seen.
Yes the MBP is very quiet when doing easy stuff but run games and heavy duty software and those fans are required to get work done.
replyThey are. But the experience of using a MacBook Pro for pretty much any purpose other than gaming is that they’re entirely silent. To the point that it’s an exceptional circumstance when a build job is so intense and so long running that fans kick in.
replyAs such, when you’re marketing your competing product, maybe don’t lead with the fans.
Understandable. But if you were attempting to do the same thing as the RTX Spark on a MacBook (i.e. run local models), you would also definitely be hearing those fans. Perhaps not the best marketing play, but it is true to the real experience of using the product for this use case.
replydeleted
replyfwiw, I have a snapdragon X laptop running with windows. It basically never runs the fans (at least at audible levels), and I sometimes sit with it on a blanket in bed
replySome of us like our hardware to last, we don't go out and buy the latest and greatest unrepairable MBP for the sole reason of flexing on our friends and peers while making a big deal about how its silent and can run large local llms at 0.5 tok/sec.
replythey had competitor also in the Snapdragon X. however the OS is ruined beyond recognition, so no matter what they do, the combo will be bad.
replydeleted
replyYa, i dont know of anyone wanting to run very large AI models in a windows environment. Or, frankly, on a laptop. Why not just VPN into a dedicated server?
replyWith BUILD happening tomorrow, I suspect Microsoft is going to have some stuff about local AI there with MS Foundry on Windows/Foundry Local. The timing of this announcement a day before BUILD is obviously intentional.
replySuddenly all the Windows K2 stuff makes sense, but I doubt it'll be enough. Its too little too late for Microsoft.
They've spent more than a decade cratering their OS. I doubt they will be able to turn it around with one code-named project.
replyI do. I can take my laptop anywhere I want, for example to a coffee shop and run a coding model while eating a croissant without worrying about an internet connection, as the term local model implies.
replyAnd you can warm up the croissant by just placing it on the trackpad while you wait for the LLM to finish
replyThe coffee shop doesn't have wifi?
replyIt's not very good and SSH is blocked.
replyI always use a VPN (to my own home server) for this reason (and other reasons) when connecting to public WiFi.
replyHow much does a dedicated server with 128GB vram cost a month.
replyHow well will the local LLM run when your laptop is in your bag while you're walking around?
replyYou can get an H200 (141GB) here for $2,700/mo: https://deploybase.ai/articles/h200-price
replyI could be wrong but my understanding is that 24/7 dedicated servers are wildly economically unviable. The reason cloud tends to cost less than local today (other than the subsidization) is because you aren't running models 24/7. So like 6 hours of cloud per weekday might beat the yearly cost of building local machines, but it's not in the same universe if you're running 24/7, as evidenced by two months of H200 rental costing more than the DGX Spark this Laptop is built out of.
I mean not that much? You buy the hardware once and then it’s just running for many years
replyLess than this laptop.
replyNo one is doing serious work on Windows anymore, those who are have yet to realise the clownshow they are collectively a part of.
reply