How to Design Research Methodology
Daniel Ha · Seoul National University PhD StudentChoose a quantitative, qualitative, or mixed-methods approach based on your
research question, then design the methodology in six steps: research design,
sampling, data collection, analysis, validity, and ethics. The guiding
principle is that the question determines the method.
Why Does Methodology Design Matter?
Methodology determines how you will answer your research question, and it is the key basis on which reviewers assess the feasibility of your study.
The same topic can become entirely different research depending on the methodology. If you are studying "the impact of remote work on productivity," you could survey 500 respondents and analyze the data statistically, or you could conduct in-depth interviews with 10 participants to explore their experiences. Which method is right depends on whether you are asking "How much does it affect?" or "How does it affect?"
Reviewers look for three things in the methodology section — alignment between the research question and the method, feasibility, and a logical rationale for why this method was chosen.
Which Research Approach Should You Choose?
If you are asking "how much," choose quantitative; if you are asking "how or why," choose qualitative; if you need both, choose mixed methods.
Quantitative Research
Measures numerically and analyzes statistically. Suited for questions like "How much?", "What relationship?", and "Is there a difference?"
| Type | Description | Examples |
|---|---|---|
| Experimental | Manipulates variables and measures effects | A/B testing, pre-post tests |
| Survey | Collects large-scale data via questionnaires | Likert scale surveys, online surveys |
| Correlational | Statistically analyzes relationships between variables | Regression analysis, SEM |
| Meta-analysis | Synthesizes existing research results | Effect size aggregation, systematic reviews |
Qualitative Research
Explores meaning and context through words, behaviors, and texts. Suited for questions like "Why?", "How?", and "What experiences?"
| Type | Description | Examples |
|---|---|---|
| Phenomenology | Explores the essence of experiences | In-depth interviews, experience descriptions |
| Grounded theory | Derives theory from data | Iterative coding, theoretical sampling |
| Case study | Analyzes specific cases in depth | Single/multiple case analysis |
| Ethnography | Understands behavior in cultural context | Participant observation, field notes |
Mixed Methods
Uses both quantitative and qualitative methods together. Suited for complex questions that cannot be answered by a single method alone.
| Design | Sequence | When to Use |
|---|---|---|
| Convergent | Quantitative + qualitative simultaneously | Examining the same phenomenon from different angles |
| Sequential explanatory | Quantitative then qualitative | Explaining survey results through interviews |
| Sequential exploratory | Qualitative then quantitative | Validating exploratory findings at scale |
The type of your research question determines which approach, data collection method, and analysis method are most appropriate.
| Research Question Type | Suitable Approach | Data Collection | Analysis Method |
|---|---|---|---|
| "What is the effect of X on Y?" | Quantitative (experimental) | Experimental data, pre-post tests | t-test, ANOVA, regression |
| "What is the relationship between X and Y?" | Quantitative (correlational) | Structured questionnaires | Correlation analysis, SEM |
| "How do participants experience X?" | Qualitative | Semi-structured interviews, observation | Thematic analysis, phenomenological analysis |
| "What is the process of phenomenon X?" | Qualitative (grounded) | Interviews, document analysis | Grounded theory coding |
| "How does the effect of X work?" | Mixed | Surveys + interviews | Statistical + thematic analysis |
If you are unsure which methodology fits your research question, try entering it into Nubint AI's Methodology Advisor agent. It analyzes methods used in similar studies and compares the strengths and weaknesses of each approach.
What Order Should You Follow When Writing the Methodology Section?
Write in six steps: research design, participants, data collection, analysis methods, validity, and ethical considerations.
For each item, be sure to include "why did you choose this method?" Using the Literature Review agent to analyze prior research helps you identify commonly used methods in your field.
Step 1: Research Design Overview
State which approach you chose — quantitative, qualitative, or mixed — and why. The type of your research question serves as the rationale for the design choice.
Step 2: Research Participants
Specify who you will study, how you will select them, and why that sample size. For quantitative research, calculate sample size via power analysis; for qualitative research, collect data until saturation is reached.
| Decision | Considerations |
|---|---|
| Define the population | Who is the target population for generalization? |
| Sampling method | Probability sampling (random) vs. non-probability (convenience, snowball, purposive) |
| Sample size | Quantitative: calculate via power analysis. Qualitative: until saturation |
| Inclusion/exclusion criteria | Who is included and excluded? Provide clear criteria |
Step 3: Data Collection
Describe the instruments, procedures, and timeframe in detail. For quantitative research, prioritize instruments with established validity and reliability; if developing a new instrument, a pilot test is essential. For qualitative research, ensure that interview guide questions directly connect to your research questions.
Step 4: Data Analysis
Specify the analysis methods you will use and how they connect to your research questions. Plan your analysis before collecting data.
| Research Type | Analysis Method | Prerequisites/Key Procedures |
|---|---|---|
| Quantitative | t-test, ANOVA | Normality, homogeneity of variance |
| Quantitative | Correlation, regression | Linearity, normality |
| Quantitative | Structural Equation Modeling (SEM) | Sufficient sample size |
| Qualitative | Thematic analysis | Coding, categorization, theme identification |
| Qualitative | Phenomenological analysis | Extracting meaning units, describing essential structure |
| Qualitative | Grounded theory coding | Open coding, axial coding, selective coding |
Step 5: Validity and Reliability
For quantitative research, report internal/external validity and measurement reliability. For qualitative research, establish trustworthiness through triangulation, member checking, and audit trails.
| Research Type | Criterion | How to Verify |
|---|---|---|
| Quantitative | Internal validity | Did only the independent variable affect the dependent variable? |
| Quantitative | External validity | Can the results be generalized to other situations? |
| Quantitative | Reliability | Would the same conditions produce the same results? |
| Qualitative | Credibility | Member checking, triangulation |
| Qualitative | Transferability | Thick description |
| Qualitative | Dependability | Audit trail |
| Qualitative | Confirmability | Researcher reflexive journal |
Step 6: Ethical Considerations
Research involving human participants requires IRB (Institutional Review Board) approval, informed consent forms, and anonymized data storage. Omitting this section will inevitably draw criticism during review.
| Ethical Principle | Implementation |
|---|---|
| Informed consent | Explain the purpose, procedures, and risks; obtain written consent |
| Confidentiality | Anonymize/pseudonymize data; store with encryption |
| Minimize risk | Design the study to avoid psychological or physical harm |
| Data management | Specify retention period and disposal method after collection |
What Are Common Mistakes in Methodology Design?
The most common mistakes are a mismatch between the research question and methodology, failing to justify the chosen method, and providing no rationale for the sample size.
| Mistake | Solution |
|---|---|
| Methodology does not match the research question | Trace back from the question type to the method |
| No rationale for "Why this method?" | Reference similar studies + compare pros and cons |
| No justification for sample size | Provide power analysis (quantitative) or saturation rationale (qualitative) |
| Deciding the analysis method after data collection | Establish an analysis plan before collection |
| No mention of validity/reliability | Report reliability coefficients (quantitative) or triangulation (qualitative) |
What Is the Difference Between Quantitative and Qualitative Research?
Quantitative research measures with numbers and aims for generalizability, while qualitative research explores meaning and context in depth.
Quantitative research fits questions about magnitude and relationships, such as "how much" or "is there a difference." Qualitative research fits questions about meaning and process, such as "why" or "how do people experience this." Neither is inherently superior; the right choice depends on the nature of the research question. Mixed methods, which combine both approaches, compensate for the limitations of a single method — for example, identifying trends through a survey and then exploring the reasons through interviews, or discovering patterns through interviews and validating them with a large-scale survey.
Summary
Research methodology is designed in the sequence: research question, approach selection, data collection design, analysis plan, validity measures. The most important principle is that "the question determines the method."
Once your methodology is finalized, use the How to Write a Research Proposal guide to document your full research plan. If your data collection requires a survey, try Nubint AI's Survey Generator agent.