A random anecdote is that most of the people I know who went very far in theoretical math are relatively poor at basic mental arithmetic, because they always think in the abstract and offload addition and multiplication to the calculator. It doesn't mean they can't do it, they just aren't as practiced or as fast at it.
Also, they are leaning on a calculator, a specific tool with a proven use that literally everyone knows how to use. LLM’s are glorified beta tests where the VC-backed companies are begging the rest of us to figure out the billion dollar application for them. It doesn’t even remotely compare from a utility standpoint. I don’t need to promise you what a calculator will eventually do when it gets better or convince you of their usefulness. It is self evident and consistent
Need to type? Computer labs (“test taking labs” idk) are back baby. Simple machines, no Internet.
Pretty sure that solves 90% of the testing problem. If somebody is overly reliant on LLM’s and refuses to learn, they’ll pay with their grades on the big assignments. Bummer for teachers who don’t love blue books, but I’m sure it’s a hell of a lot better than trying to sniff out LLMs and constantly mistrusting your students.
Your work will be ‘graded’ by other humans who don’t know what they are talking about, or an LLM which will assume the median answer is correct?