https://news.ycombinator.com/item?id=47128138
This article has a graph of the human response rates. About 70% correct on average. Accuracy depends on the country (maybe a language barrier?).
See also original thread on the car wash thing.
I want to wash my car. The car wash is 50 meters away. Should I walk or drive?
If we require logical rigour there isn't enough context in the question. If we allow for informal language then there are absolutely situations where cars get washed and people walk 50 meters to the car wash. It is a reasonable guess that the car is already at the wash and you have a 2nd car, given the question is being asked. It's a slight leap, but it is an inference that makes the question meaningful and so it is one that could be made.
I'd assume the LLMs are just failing at spatial reasoning, because AFAIK they're terrible at it. But both answers are justifiable because we don't know where the car is and have to make assumptions.
if you were an able bodied man there is no other duty. the same for shoveling snow, or mowing a lawn, cleaning up inside the house
these are all things I've rejected and exempt myself from
but I'm beginning to remember large swaths of society live under that regime, so driving to a car wash wouldn't be an option at all. you wash your car and have a separate desire to walk to the car wash for some other reason
I could see people thinking its a trick question, or just scoffing at the idea people wash their cars at the car wash and pollute the data for AIs in annotation work.