Reading Anxiety or Reading the Label? Comparing Fine-Tuned and Frontier Models for Anxiety Detection on Social Media
Mirrored from arXiv — NLP / Computation & Language for archival readability. Support the source by reading on the original site.
Computer Science > Computation and Language
arXiv:2609.20847 (cs)
[Submitted on 6 Aug 2026]
Title:Reading Anxiety or Reading the Label? Comparing Fine-Tuned and Frontier Models for Anxiety Detection on Social Media
View a PDF of the paper titled Reading Anxiety or Reading the Label? Comparing Fine-Tuned and Frontier Models for Anxiety Detection on Social Media, by Cris Huynh and 1 other authors
View PDF
HTML (experimental)
Abstract:Anxiety is among the most common mental health conditions, and people often write about it online well before seeking clinical help. Practitioners building detection tools face a concrete choice: call a frontier commercial model, fine-tune a smaller model in-house, or deploy a conventional classifier. We compare six conditions spanning all three on a held-out Reddit test set under a single controlled protocol. We also identify a confound in how this task is evaluated. In the corpus used here, 69.3% of anxiety-labelled posts contain the word "anxiety" or a variant, roughly twice the rate of comparable conditions, so a classifier can score well by keyword matching rather than by modelling the language of the condition. We therefore evaluate every model twice, on original text and with those terms deleted, and report the difference as lexical dependence. A frontier model leads on anxiety F1 (0.846), but a 110M-parameter domain-adapted encoder reaches 0.831 with no external API dependency, and mental-health domain pretraining accounts for only 0.7 of those points. Lexical dependence spans 8.6 to 25.4 points and does not track model capability: the LoRA fine-tuned 3B model is the most keyword-dependent condition tested, above even a TF-IDF classifier, while the frontier zero-shot model is the least. Published figures on this corpus are therefore upper bounds, and the inflation is largest for the fine-tuned models such figures typically report.
| Comments: | 11 pages, 5 figures, 2 tables |
| Subjects: | Computation and Language (cs.CL); Social and Information Networks (cs.SI) |
| Cite as: | arXiv:2609.20847 [cs.CL] |
| (or arXiv:2609.20847v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2609.20847
arXiv-issued DOI via DataCite
|
Full-text links:
Access Paper:
- View PDF
- HTML (experimental)
- TeX Source
View a PDF of the paper titled Reading Anxiety or Reading the Label? Comparing Fine-Tuned and Frontier Models for Anxiety Detection on Social Media, by Cris Huynh and 1 other authors
References & Citations
Loading...
Bookmark
Bibliographic Tools
Code, Data, Media
Demos
Related Papers
About arXivLabs
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
TXYZ.AI (What is TXYZ.AI?)
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.