There is such a thing as lack of bias in statistical outcomes, right? E.g. fair dice? Measuring it may be probabilistic, but it exists.
replyWhat I'd like to see is if the LLM would exhibit the same behavior wrt other types of predictive selections. For example, rather than choosing people from four tribes, choosing flower seeds from four packets, or choosing lottery tickets from four machines.
No. It's a shorthand for contextual bias. The context is the tiny window of the statistic. When it's applied to a real world situation, ppl promote the 'unbiasedness' into a real situation that isn't constrained by it.
replyBias cannot be avoided in any information, because it's always a position of what is relevant and in what presented order. The only unbiased thing is nature itself in its immediate instantaneous totality.
Are you sure? I mean, yes of course tiny sample windows have this effect. But it seems at least possible that LLM is more prone to this effect when making estimates of human performance or behavior than when doing it for other topics.
replyIn any case I feel the paper is interesting but almost begging to be misinterpreted.