Research Methodology Design

Overview

Research methodology is the bridge between a question and an answer. A well-designed methodology produces valid, reliable results; a poorly designed one wastes resources and generates findings that cannot be trusted or replicated.

This skill covers selecting research approaches, designing studies, planning data collection and analysis, and documenting methodology clearly enough for replication. It applies across quantitative, qualitative, and mixed-methods research paradigms.

Core Framework

The Methodology Decision Tree

Level 1 - Paradigm: Choose your philosophical orientation. Positivist approaches seek generalizable, measurable truths. Interpretivist approaches seek deep understanding of meaning. Pragmatist approaches select methods based on what best answers the question.

Level 2 - Approach: Quantitative (experimental, survey, correlational), qualitative (case study, ethnography, phenomenology, grounded theory), or mixed methods (sequential, concurrent, transformative).

Level 3 - Design: Define variables or constructs, sampling strategy, data collection instruments, and analysis plan. Every design choice must be justified by the research question.

Validity and Reliability

Quantitative work must address internal validity (causal claims), external validity (generalizability), and reliability (consistency). Qualitative work must address credibility, transferability, dependability, and confirmability through triangulation, member checking, and thick description.

Process

1. State the research question precisely; the methodology must serve the question
2. Select the paradigm and approach that best fits the question type
3. Define the population and justify your sampling strategy with target sample size
4. Design or select data collection instruments and establish their validity
5. Plan the data collection procedure step by step, including ethical safeguards
6. Pre-register the study or analysis plan if applicable to your field
7. Specify the analysis techniques before collecting data to prevent fishing
8. Conduct a pilot study or dry run to identify procedural problems
9. Document every methodological decision with its rationale
10. Write the methods section with enough detail that another researcher could replicate your study

Key Principles

• The research question dictates the method, never the reverse
• Justify every design choice; reviewers will question unjustified decisions
• Transparency about limitations strengthens credibility rather than weakening it
• Pilot test instruments and procedures before the main study
• Pre-registration reduces researcher degrees of freedom and increases trust in findings
• Ethical approval must be obtained before any data collection involving human subjects
• Document deviations from the original plan and explain why they occurred
• Power analysis or saturation criteria should determine sample size, not convenience

Common Pitfalls

• Choosing a method because it is familiar rather than because it fits the question
• Under-powering quantitative studies, making results inconclusive
• Treating qualitative research as less rigorous than quantitative, skipping validity checks
• Failing to pilot test instruments, discovering problems mid-study
• Conflating correlation with causation in non-experimental designs
• Writing methods so vaguely that replication is impossible

Output Format

Deliver methodology documentation as:

1. Research design summary: one-page overview of paradigm, approach, and design with justification
2. Sampling plan: population definition, sampling method, target size, and recruitment strategy
3. Instruments: questionnaires, interview guides, observation protocols, or measurement tools
4. Procedure: step-by-step data collection protocol with timeline
5. Analysis plan: specified techniques, software, and decision rules for interpretation
6. Ethics documentation: consent forms, IRB application, and data management plan