In practice this already happens, unfortunately.
replyWhy is it unfortunate? We should absolutely use AI reviewers to help catch errors and fact check papers
replyBecause the exact opposite will happen. The idea that allowing AI reviewers will increase accuracy is probably foolhardy. People being people will get lazy and review less by hand if at all. And the LLMs will miss plenty of things. Then those papers will get into the training sets for the next LLMs. I think you can see where this goes overtime.
replyThe issue is generally not accuracy in my experience (humans are even lazier about this). The issue is that LLMs do not understand what is interesting and what is procedural.
reply> Why is it unfortunate?
replyIf you only knew.
deleted
reply