Motivation for the SIGCSE Reviewing Study


Natural Questions Regarding Ratings by Reviewers

  1. To what extent do some reviewers give consistently high or consistently low ratings?
  2. Are ratings affected by such factors as referee gender, nationality, or expertise, or by the paper's format?
  3. Do authors of one paper give consistently high or low ratings to other papers?
  4. How does an overall rating correlate with subscores in areas of technical content, writing quality, originality, and significance?
  5. How does a joint review by a large committee working collaboratively affect the ratings given by that committee?

Some Hoped-for Insights

created September 2, 2003
last revised October 22, 2003
Valid HTML 4.01! previous   next