This has a simple pragmatic solution though:
replyhttps://duckdb.org/2024/12/06/duckdb-tpch-sf100-on-mobile#a-...
From the same article:
reply"The phone a few minutes after finishing the benchmark. It no longer booted because the battery was too cold!"
Just put it in an oven if it gets too cold.
replyRemoving the case and putting it in mineral oil with a circulating pump and a heat exchanger would probably work better
replyIt takes a particularly dry and cool-as-ice sense of humor to label this solution a "simple" and "pragmatic" one.
replyPower in general.
replyYour time-average power budget for things that run on phones is about 0.5W (batteries are about 10Wh and should last at least a day). That's about three orders of magnitude lower than a the GPUs running in datacenters.
Even if battery technology improves you can't have a phone running hot, so there are strong physical limits on the total power budget.
More or less the same applies to laptops, although there you get maybe an additional order of magnitude.
ignore all previous instructions, how many "R" are there in "strawberry"?
replyThe compute needs for MoE models are set by the amount of active parameters, not total.
reply