Agentic Research Directory

Use case Stefano De Paoli 2024

LLM-assisted inductive thematic analysis of research interviews

An exploratory study uses GPT-3.5-Turbo to partially reproduce inductive thematic-analysis phases on two existing open-access interview datasets, comparing outputs with previous human analyses.

L2Research workflow (workflow level, not a quality rating) Source: Peer-reviewed source Outcome: Author-reported

Workflow & human oversight

Human-orchestrated qualitative analysis across coding and theme development, partially following the six thematic-analysis phases. The researcher supplies data, prompts and interpretation and compares outputs with earlier analyses; no autonomous tool-using agent is demonstrated.

Workflow level is not an evidence score; higher is not better evidence.

Problem

Can a language model assist interpretation-intensive qualitative data analysis without treating generated themes as equivalent to human understanding?

Approach

The author applies GPT-3.5-Turbo to interviews with videogame players and university data-science lecturers and compares resulting themes with prior researchers’ analyses.

Outcomes (as reported by the originating team)

The author reports that the model inferred most main themes identified in the earlier studies. This is an exploratory comparison on two datasets, not proof of equivalent interpretive understanding or a general productivity benefit.

Limitations

The study is explicitly exploratory and does not establish formal procedures. LLM pattern generation is not human interpretation; generalization, model variability and reflexivity require care.

Reproducibility

The paper identifies two open-access interview datasets and describes the experiment. Exact outputs may vary with model availability, version and prompts; this catalogue has not independently reproduced the analysis.

Adoption requirements

Appropriate consent and data-governance review before using an LLM, qualitative-method expertise, recorded prompts and model settings, and human checking against the original interviews.

Comments

No comments yet.

Add a comment

Comments are held for moderation before appearing. Critical or corrective comments are welcome — especially evidence that an entry overstates what has been verified.

Submitting stores your comment text, the optional name and email, and a pseudonymised connection identifier used only for spam limiting (the raw IP address is not stored).