Repeat the test like 5 times for each model and see the results.
reply+1, a single test means little.
replyI don't think so. I specifically kept this PR to test model capabilities, and I've already tested a bunch of models. Current test results show that the more advanced the model is, the easier it passes. For example, GPT-5.5 Medium fails the test(has bug), but High passed.
replydeleted
replyRocket man bad.
replyThis but unironically
replySo.. flesh this out and don’t be a coward about it.
replyYou are saying that the products made by thousands of people are to be shit on and hidden away from discussion because you don’t like a guy in charge? That the quality and performance of the product is second tier to collective-take culture war considerations, real or mostly make believe? That only the things made by “The Good Ones” are to be discussed because of righteousness? Is it because if Rocket Man Bad, but Rocket Man Products Good, that would cost you legitimacy in the first part?
And you assert that while daring to talk about irony?
There are still sane people here, we just don't talk about "rocket man" because it enrages the particular subgroup on display here and usually goes no where actually productive (and has like a 50% of getting flagged to death anyways). I'm not pro Elon by any means, but the standard HN profile of him is pretty bat shit crazy.
replydeleted
replyno he and his stuffs are now considered transparent, no pun intended. I think he deserves it since his minions were persistent with usage of "this ___ has hateful bias against ___" canned response.
replydeleted
replyI thought it was impossible to downvote posts?
reply