PsyProxy
Datasets·Medicine·01__health_reviews__druglib__benefits_effectiveness

Druglib drug-effectiveness reviews

Druglib Drug Reviews is a public corpus of patient-written reviews of prescription medications, each rating a drug’s benefits and overall effectiveness on 1–10 ordinal scales. The texts predominantly discuss a range of personal experiences related to the effects of various medications, highlighting both positive and negative outcomes. Common themes include improvement in mood , relief from physical pain , and management of chronic conditions such as anxiety, insomnia, and acne. Many reviews express satisfaction with treatments that resulted in reduced symptoms like cramps , hypertension , and menstrual issues , while others detail adverse effects, including emotional instability and relationship problems . Overall, the narratives reflect a complex interplay of benefits and drawbacks, illustrating the varied impact of medications on individuals' quality of life. [Summary on 50 random texts by ChatGPT 4o Mini].

Distribution of 1–10 effectiveness rating
1
2
3
4
5
314 at floor1,740 at ceiling
4,120
items
824
holdout n
1–10 effectiveness rating
target
Ordinal
kind
21
systems compared
Criterion validity

Reported holdout systems from the verified card

Ordinal prediction uses Quad. κ as the task-primary metric. Secondary columns keep the companion metrics visible so binary, ordinal, regression, and multiclass cards are not compared through one flattened score.

Source podium · Quad. κ · 10 families
Gold
PsyProxy
0.590
Silver
Topic models
0.322
Bronze
OpenAI (Rathje)
0.234
Model-family mix
PsyProxy · 4Baseline · 15Lexicon · 2
SystemFamilyVariantQuad. κWithin-oneMAEPrimary scale
psyproxyPsyProxy — Social Economics Lens v0.5 · 1000d
PsyProxypermissive0.5900.8580.70
psyproxyPsyProxy — Health Lens v0.9 · 1100d
PsyProxypermissive0.5480.8500.74
psyproxyPsyProxy — Behavioral Sciences Lens v0.5 · 1000d
PsyProxypermissive0.5100.8330.76
psyproxyPsyProxy — Technology Lens v0.5 · 800d
PsyProxypermissive0.4900.8260.77
baselineTool for the Automatic Analysis of Syntactic Sophistication and Complexity (TAASSC)
Baselinepermissive0.1920.7580.98
lexLinguistic Inquiry and Word Count (LIWC)
Lexiconpermissive0.1690.7400.98
baselineTool for the Automatic Analysis of Lexical Sophistication (TAALES)
Baselinepermissive0.1440.7450.99
baselineTextDescriptives
Baselinepermissive0.0890.7401.02
baselineTool for the Automatic Analysis of Cohesion (TAACO)
Baselinepermissive0.0580.7271.06
baselineEmpath
Baselinepermissive0.0100.7261.07
lexValence Aware Dictionary and sEntiment Reasoner (VADER)
Lexiconpermissive0.0000.7231.07
baselineDruglib drug reviews regression · via best lens
Baselinepermissive
baselineDisneyland TripAdvisor reviews continuous · via best lens
Baselinepermissive
baselineIMDB movie reviews (ACL) binary · via best lens
Baselinepermissive
baselineAmazon Video-Games reviews continuous · via best lens
Baselinepermissive
baselineAmazon Video-Games reviews ordinal · via best lens
Baselinepermissive
baselineDouban movie reviews (Chinese) ordinal · via best lens
Baselinepermissive
baselineAmazon Video-Games reviews binary · via best lens
Baselinepermissive
baselineSentiment140 tweets binary · via best lens
Baselinepermissive
baselineLIAR fact-check statements ordinal · via best lens
Baselinepermissive
baselineDisneyland TripAdvisor reviews binary · via best lens
Baselinepermissive