With the new /review route, the community is presented with a queue of posts they have to work through. One of these is Close Votes:
It enforces a very strict pattern – you basically choose to either close a question or not, with the ultimate goal that the number next to the queue eventually reaches zero (am I correct assuming that goal?).
So, my options are:
Now, the team should already have enough data to estimate how people use this queue. A few questions I would be very interested in:
Are people more likely to close questions now? You could probably test this by looking at the fraction of questions voted to close vs. total viewed questions, or the number of close votes used per day.
Do the right kind of questions become closed? While we are missing the ground truth on whether a question really should have been closed, do you believe that the system is working as intended, or does the missing feature of users being able to counter-vote just increase the likelihood of any question to become closed, even if it might have been a borderline case or not closeworthy at all? Which brings me to …
Do borderline questions just stick around in the queue or are they closed more quickly? If people are not sure, are they actually pressing do not close, or not sure? If they only pass the question along to others, are chances bigger that borderline questions are now much more likely to be closed, simply because the votes are adding up?
If the queue goes down to a small number, are new questions being closed faster? Once the queue is at 0 "votes" (might wanna change the word here), wouldn't that mean that any new question with a close vote is much more likely to become closed right away?
Finally, I was wondering if including a queue for questions to be reopened made sense. Feel free to leave a comment about that – but don't take this as a feature-request.