Datasets·Customer reviews·yelp_brandblind_hard

Starbucks vs Dunkin' (brand-blind hard)

Yelp brandblind (hard) . PsyProxy quantitative evaluation. The excerpts reflect a wide range of experiences at various coffee shop locations, primarily focusing on themes of customer service , order accuracy , and convenience . Many reviews highlight the inconsistencies in service quality, with some patrons expressing frustration over long wait times and incorrect orders, while others praise friendly staff and quick service. The tone varies from enthusiastic endorsements of specific locations to harsh criticisms of others, often emphasizing the importance of cleanliness , staff behavior , and the overall atmosphere of the establishments. Recurring mentions of drive-thru experiences and the challenges associated with them further illustrate the significance of operational efficiency in shaping customer satisfaction. [Summary on 50 random texts by ChatGPT 4o Mini].

Distribution of Brand: Starbucks vs Dunkin' (binary, brand-blind hard split)
1
2
5,870 at floor5,870 at ceiling
11,740
items
2,348
holdout n
Brand: Starbucks vs Dunkin' (binary, brand-blind hard split)
target
Binary
kind
15
systems compared
Criterion validity

Reported holdout systems from the verified card

Binary classification uses FVE as the task-primary metric. Secondary columns keep the companion metrics visible so binary, ordinal, regression, and multiclass cards are not compared through one flattened score.

Model-family mix
PsyProxy · 4Baseline · 11
SystemFamilyVariantFVEAUCF1Primary scale
psyproxyPsyProxy — Behavioral Sciences Lens v0.5 · 1000d
PsyProxypermissive0.1620.7610.697
psyproxyPsyProxy — Technology Lens v0.5 · 800d
PsyProxypermissive0.1570.7570.690
psyproxyPsyProxy — Sociology Lens v0.5 · 1000d
PsyProxypermissive0.1480.7520.683
psyproxyPsyProxy — Health Lens v0.9 · 1100d
PsyProxypermissive0.0810.6880.642
baselineDisneyland TripAdvisor reviews binary · via best lens
Baselinepermissive
baselineIMDB movie reviews (ACL) binary · via best lens
Baselinepermissive
baselineAmazon Video-Games reviews continuous · via best lens
Baselinepermissive
baselineAmazon Video-Games reviews ordinal · via best lens
Baselinepermissive
baselineDruglib drug reviews regression · via best lens
Baselinepermissive
baselineDisneyland TripAdvisor reviews continuous · via best lens
Baselinepermissive
baselineDruglib drug reviews ordinal · via best lens
Baselinepermissive
baselineDouban movie reviews (Chinese) ordinal · via best lens
Baselinepermissive
baselineSentiment140 tweets binary · via best lens
Baselinepermissive
baselineLIAR fact-check statements ordinal · via best lens
Baselinepermissive
baselineAmazon Video-Games reviews binary · via best lens
Baselinepermissive