Peer Review Process

Overview

Peer review is the quality control mechanism of academic publishing. As a reviewer, your job is to improve the manuscript and advise the editor. As an author, your job is to engage with feedback constructively and demonstrate that every concern has been addressed.

This skill covers both sides: writing constructive, thorough reviews and crafting effective responses to reviewer comments. It applies to journal manuscripts, conference papers, and internal review processes.

Core Framework

The Reviewer's Evaluation Hierarchy

Assess manuscripts in this order, from most to least fundamental:

1. Contribution: Does this advance the field in a meaningful way?
2. Validity: Are the methods sound and the conclusions supported by the evidence?
3. Completeness: Are there missing analyses, references, or explanations?
4. Clarity: Is the writing clear and well-organized?
5. Presentation: Are figures effective, formatting correct, and grammar clean?

The Response Strategy (For Authors)

Organize your revision around three categories:

• Accepted changes: implemented as suggested, with brief acknowledgment
• Modified changes: partially implemented with explanation of your reasoning
• Respectful disagreements: declined with evidence-based justification

Never ignore a comment. Every point must receive a visible response.

Process

Writing a Review

1. Read the manuscript once without taking notes to understand the full argument
2. Re-read with the evaluation hierarchy in mind, annotating specific issues
3. Summarize the paper's contribution in two to three sentences to confirm understanding
4. List major concerns that affect the validity or significance of the work
5. List minor concerns related to clarity, presentation, or missing details
6. Provide specific, actionable suggestions rather than vague criticism
7. Note strengths explicitly to maintain a balanced and constructive tone
8. Draft a confidential recommendation to the editor with clear justification

Responding to Reviews

1. Read all reviews completely before reacting emotionally
2. Create a response table mapping each comment to an action
3. Address major concerns first with substantive revisions
4. Revise the manuscript, tracking changes or highlighting modified text
5. Write a point-by-point response letter quoting each reviewer comment and your reply
6. Include page and line numbers referencing where changes appear in the revised manuscript

Key Principles

• Critique the work, never the author; maintain professional respect throughout
• Be specific: cite page numbers, equations, or figure numbers when identifying issues
• Distinguish between essential revisions and suggestions for improvement
• Recommend rejection only when fundamental flaws cannot be fixed by revision
• As an author, treat reviews as data about how your paper reads, not personal attacks
• Revisions that exceed what reviewers asked for signal seriousness and thoroughness
• Timeliness matters; complete reviews within the agreed deadline

Common Pitfalls

• Writing reviews that are vague ("the writing needs improvement" with no specifics)
• Requesting entirely new experiments that are outside the paper's scope
• As an author, becoming defensive rather than engaging with the substance of critiques
• Ignoring minor comments, which signals carelessness to the editor
• Submitting a response letter without actually making the corresponding changes
• Assuming a single round of revision will always be sufficient

Output Format

For reviews, deliver:

1. Summary: 2-3 sentences describing the paper's aim and contribution
2. Major comments: numbered list of substantive concerns with specific references
3. Minor comments: numbered list of presentation and clarity issues
4. Recommendation: accept, minor revision, major revision, or reject with rationale

For revision responses, deliver:

1. Cover letter: brief summary of key changes made
2. Point-by-point response: each reviewer comment quoted, followed by your response and location of changes
3. Revised manuscript: with changes tracked or highlighted