ScrapeSenseLLM
Research tool documenting Reddit-data collection, local-LLM thematic coding using the Push-Pull-Mooring framework, and a dashboard for interpreting nootropics discourse.
Workflow level n/a Source: Repository-documented Outcome: Not empirically evaluated here
Research applicability
Useful for qualitative consumer and social-science discourse research; reported slight agreement makes researcher adjudication essential, not optional.
Getting started
Editorial, untested starting point: read the README reliability caveat, inspect the synthetic-data demo and missing configuration details, and establish a researcher-reviewed codebook. Test coding agreement on a small approved sample before substantive interpretation.
Maintenance
Documentation read on 2026-10-17; maintenance and runtime compatibility not tested.
License
Licensing and third-party data rights were not independently audited; check before reuse.
Workflow & human oversight
Workflow level intentionally unspecified for this reusable resource. Researchers select inputs, validate outputs and retain responsibility for interpretation.
Workflow level is not an evidence score; higher is not better evidence.
Approach
README describes coding six Reddit communities with a PPM codebook, a researcher-coded reliability subsample, a second model rater and community-level perceptual mapping. These are author-described procedures, not an editorial reproduction.
Limitations
README-only review; thesis, code and reliability calculations were not independently inspected or reproduced. README reports slight inter-rater agreement (kappa 0.115, 0.151 and 0.047); interpretive community archetypes must not be presented as reliable individual-level measurements. Several documentation links/parameters are blank and the balance formula has encoding corruption. No Reddit data is distributed according to README; privacy, consent/ethics and Reddit data terms require separate review.
Reproducibility
Primary repository documentation inspected; no installation, code execution, dataset inspection or independent outcome reproduction.
Adoption requirements
README demo specifies Python 3.11+, package installation and a synthetic-data generator followed by Streamlit. Real-data work additionally requires configured local-model tooling and authorized Reddit access; incomplete setup links need resolution.
Comments
No comments yet.
Add a comment
Comments are held for moderation before appearing. Critical or corrective comments are welcome — especially evidence that an entry overstates what has been verified.