Improving peer review with CARMA
Abstract:We propose to test and improve the quality of peer review through CARMA (Community-based Assessment of Review Materials): an online repository of review materials that will include all intermediate versions of published manuscripts, associated reviews, and author replies to reviewer comments. CARMA would add the content of reviews to the public scientific record without compromising the anonymity of reviewers. The benefits to the relevant stakeholders are as follows:
• For readers, CARMA would reveal the actual impact of peer review on scholarly manuscripts;
• CARMA would encourage reviewers to provide thorough evaluations without jeopardizing their candor;
• Editors could utilize CARMA for quality assurance by soliciting ratings of reviews from their readership;
• For publishers, implementing CARMA would incur minimal costs, and could increase revenues.
Whatever the present quality of peer review, making this process more transparent would be in the best interest of meritocratic scholars and society at large.
Document Type: Research Article
Publication date: 2007-07-01
Learned Publishing is the journal of the Association of Learned and Professional Society Publishers, published in collaboration with the Society for Scholarly Publishing. The journal is published quarterly in January/April/July/October.
Learned Publishing articles are available free online to members of ALPSP and SSP.
ALPSP members: log in to www.alpsp.org. If you do not have a password contact firstname.lastname@example.org
SSP members: log in to the Member Center using your membership username and password. Further information email@example.com
Learned Publishing will be moving to Wiley-Blackwell as of January 1, 2016. Please contact the publisher at firstname.lastname@example.org for information on how to continue access to this title.