Literally nothing about it is either, either.
replyYes for a moment I thought clear room might mean something else for LLMs.
replyEssentially they can't do clean room anything!
You might as well hire the entire former mid level of a businesses programming team and claim it's clean room work
Windows NT is not VMS! Trust me!
replyHad to Google this but I do love a deep cut reference!
replyhttps://www.itprotoday.com/server-virtualization/windows-nt-...
At first I thought it was brain slip in the HN title, then I saw TFA also said "clear", so thought it was perhaps a sarcastic jab at the original "clean" room story it is commenting on, but maybe in the end just an error ?
replyIn any case, an interesting experiment.
It would also be interesting to see how well the best open weights models such as Kimi K2.5 can do on a task like this with the same prompting to first gather specs, etc, etc.
replyIn fact this would make for an interesting benchmark - writing entire non-trivial apps based on the same prompt. Each model might be expected to write and use it's own test cases, but then all could be judged based on a common set of test cases provided as part of the benchmark suite.