Anastasia Ailamaki
Amol Deshpande
Abstract
While organizing the submission evaluation process for the SIGMOD 2019 research track, we aim at maximizing the value of the reviews while minimizing the probability of misunderstandings due to factual errors, thereby valorizing impactful ideas. The objective is an educating and rewarding experience for both the authors and the reviewers. The actionable goals are: 1. Maximize review depth and breadth. For depth, optimizing the assignment of papers to reviewers is of key importance; "low confidence" reviews should be few to none, in order for reviewers to provide extensive and useful comments to the authors. To cover the breadth and to address controversial issues, recruit as many reviewers as needed to converge to a unanimous set of comments. 2. Ensure that all submissions are treated equally fairly by experts in the respective domains. 3. Obtain as much input from the authors as possible during the process. Enabling author feedback is the key step in the process. 4. Allow re-evaluation of papers with non-critical flaws through revisions.
- Aminer. https://aminer.org/.Google Scholar
- D. M. Blei, A. Y. Ng, and M. I. Jordan. Latent dirichlet allocation. Journal of machine Learning research, 3(Jan):993--1022, 2003.Google ScholarDigital Library
- L. Charlin and R. Zemel. The toronto paper matching system: an automated paper-reviewer assignment system. Proceedings of the 30th International Conference on Machine Learning, 2013.Google Scholar
- Conference management toolkit. https://cmt3.research.microsoft.com.Google Scholar
- M. Grant and S. Boyd. Cvx: Matlab software for disciplined convex programming, 2014.Google Scholar
- M. Stonebraker. My top ten fears about the DBMS field. In 34th IEEE International Conference on Data Engineering, 2018.Google ScholarCross Ref
- C. J. Taylor. On the optimal assignment of conference papers to reviewers. Technical Report, 2008.Google Scholar
Recommendations
Impact of double-blind reviewing on SIGMOD publication rates
Starting with the 2001 SIGMOD conference, the SIGMOD Chair, in consultation with the SIGMOD Advisory Committee, imposed a double blind rule on all future SIGMOD conferences. While there are many reasons why double-blind reviewing might be a good idea, ...
Comments