For researchers
Arguments and frameworks you can examine and use in your own research
Computational methods create choices about what to measure, which evidence to trust, and how to make an analysis open to scrutiny. The book develops frameworks for reasoning through those choices. You can use them to evaluate a method, plan an applied study, or locate a doctoral project’s contribution.
What the book argues
The chapter references point to the reasoning and qualifications behind these eight claims.
Computational social science is a methodology, not a toolkit. The book defines computational methods as approaches to inference that require writing and executing code, distinguished by the capacities that specifying a procedure in code makes possible. Research design organizes those methods into four stages: data management, concept representation, data analysis, and scientific communication, each constraining the options at the next. (Chs. 1, 12)
AI-assisted research is an environment problem with an epistemological root. Because large language models are opaque, they cannot be trusted the way human collaborators are trusted; what remains available is structuring the environment so AI contributions are constrained, traceable, and grounded in project materials. That is the Rules / Memory / Knowledge framework. Before attributing a poor result to the model, examine whether the agent had the current instructions, decisions, and source materials it needed. (Ch. 2)
Cheap data, costly validation. Digitization made data cheap to acquire without making it cheap to understand. Born-digital and repurposed data carry the biases of the platforms and institutions that generated them, and the ease of collection systematically obscures the effort validation requires. (Chs. 3–4)
Measurement is where epistemology meets code. Embeddings, networks, and topic models can each serve postpositivist hypothesis testing, constructivist exploration, transformative action research, or pragmatist problem-solving. The epistemological commitment is made in the measure, not the tool: deductively, inductively, or integratively. The marginal-cases problem asks whether a measure misses cases that are rare in the data but central to the research question. (Chs. 5–6)
Capacity is not purpose. A method’s capacities (iterating, modeling non-linear relationships, processing high-dimensional data) are separate from what a study asks it to do: describe, explain, predict, or integrate. Collapsing that distinction is one way predictive performance can be mistaken for conceptual validity. It also informs the book’s treatment of LLMs as annotators or synthetic respondents: benchmark-style evaluation shows a model reproduces patterns, not that it captures the mechanisms a social-scientific claim needs. (Chs. 7–8)
Scientific objectivity is a social achievement. It is maintained by communication structures that keep work open to scrutiny, not by individual rigor alone. For computational work, pipelines should be inspectable, results reproducible, and findings interpretable, so others can identify and investigate errors. (Chs. 9–10)
Quantitative is a verb, not a property. Treating methodological distinctions as properties of data rather than choices about observation is a category error identified in the 1960s, and both sides of the current AI debate commit it: critics who hold that models categorically cannot reach qualitative meaning, and enthusiasts who hold that they make qualitative coding obsolete. The productive question is whether a particular procedure captures a particular concept, for whom, and where it fails. (Ch. 12)
Integration, not replacement. Read against the case-study/statistics controversy and the mixed-methods movement, the computational transition is following a familiar arc: new capacities, enthusiasm, resistance, overselling, backlash, then resolution through integration. The book argues for judging methods by the questions they help answer and for combining approaches where their strengths complement one another. (Ch. 12)
Ethical judgment runs through these design decisions. Chapter 11 examines the responsibilities that accompany choices about data, measures, models, and communication.
Frameworks you can take
Use these frameworks to organize decisions across tools and programming languages.
| Framework | What it gives you | Where |
|---|---|---|
| Four-stage research design | The organizing spine: data management, concept representation, data analysis, and scientific communication, with each stage constraining the next | Ch. 1 |
| Three researcher roles | Algorithmic methodologist, applied methodologist, computational social scientist: a typology for locating a contribution (and a career) | Ch. 1 |
| Rules / Memory / Knowledge | An architecture for AI-assisted projects: rules configure what an agent may do, memory preserves what happened and why, knowledge grounds reasoning in project commitments | Ch. 2 · templates |
| 3S framework | Source, structure, standardization: three questions that surface what a dataset actually commits a study to | Ch. 3 |
| Deductive / inductive / integrative measurement | Locates any computational measure’s epistemological commitment; pairs with the marginal-cases check | Ch. 5 |
| Three-instrument coding sequence | Compare dictionary, LLM, and classifier coding of the same corpus; investigate disagreements in a validity audit | Ch. 6 |
| Capacities and epistemic purposes | Separates what a method can do from what a study asks of it; four purposes imply four validation standards | Ch. 7 |
| Inspectable / reproducible / interpretable | Check whether others can examine the pipeline, reproduce its results, and interpret its findings | Ch. 9 |
For doctoral students, the roles typology helps you choose training, collaborators, publication venues, and criteria for evaluating a dissertation. The book takes the perspective of a computational social scientist who often works as an applied methodologist.
The materials
- CSS Empirical Studies Database: 122 published computational studies with searchable research-design annotations, downloadable as CSV or BibTeX. Selected for teaching across methods, disciplines, and epistemic purposes, it is a convenience sample rather than a systematic review or sampling frame. Coverage is uneven across stages and thins after 2023.
- Worked notebooks and data: three notebooks with saved outputs covering text representation, topic modeling, and network analysis. Sample policy-to-scholarship network data support the network notebook; the text notebooks require your own corpus.
- Project skeleton: adaptable files for the Rules / Memory / Knowledge structure used to write this book.
Site text and code examples may be reused for teaching and research with attribution; linked tools and cited works carry their own licenses.
How to cite
Cite the book. The database, notebooks, and templates are its supporting materials rather than separately identified artifacts:
Ma, J. (forthcoming). Computational & AI-Assisted Methods for Social Sciences: A Research Design Primer. SAGE.
Final publication details will replace this entry when the book is in print. For citing a specific page of this site, see About.
Engaging
Send corrections through the errata page. Responses to the methodological arguments are also welcome, especially examples that reveal where a framework needs refinement.