Datasets·Customer reviews·eval12_yelp_brandblind_light_4lens_20260420

Starbucks vs Dunkin' (Eval 12, light)

eval12_yelp_brandblind_light_4lens_20260420 . PsyProxy quantitative evaluation. The texts predominantly discuss various aspects of customer experiences at coffee and donut establishments, focusing on themes such as service quality , staff friendliness , and order accuracy . Many reviews highlight wait times for orders, with some expressing frustration over delays or incorrect items being served. Complaints about inconsistent service and product availability are common, particularly regarding the lack of items like donuts or sandwiches. Positive remarks often center on the atmosphere of the locations and the cleanliness of the establishments, while negative feedback frequently addresses issues with management and employee attitudes. Overall, the reviews reflect a wide range of customer sentiments, from satisfaction with service to disappointment over operational shortcomings. [Summary on 50 random texts by ChatGPT 4o Mini].

Distribution of Brand: Starbucks vs Dunkin' (binary, Eval 12 light)
1
2
5,870 at floor5,870 at ceiling
11,740
items
2,348
holdout n
Brand: Starbucks vs Dunkin' (binary, Eval 12 light)
target
Binary
kind
15
systems compared
Criterion validity

Reported holdout systems from the verified card

Binary classification uses FVE as the task-primary metric. Secondary columns keep the companion metrics visible so binary, ordinal, regression, and multiclass cards are not compared through one flattened score.

Model-family mix
PsyProxy · 4Baseline · 11
SystemFamilyVariantFVEAUCF1Primary scale
psyproxyPsyProxy — Behavioral Sciences Lens v0.5 · 1000d
PsyProxypermissive0.3290.8540.771
psyproxyPsyProxy — Technology Lens v0.5 · 800d
PsyProxypermissive0.3220.8560.770
psyproxyPsyProxy — Sociology Lens v0.5 · 1000d
PsyProxypermissive0.3090.8480.761
psyproxyPsyProxy — Health Lens v0.9 · 1100d
PsyProxypermissive-1.0000.7710.713
baselineDisneyland TripAdvisor reviews binary · via best lens
Baselinepermissive
baselineIMDB movie reviews (ACL) binary · via best lens
Baselinepermissive
baselineDisneyland TripAdvisor reviews continuous · via best lens
Baselinepermissive
baselineAmazon Video-Games reviews continuous · via best lens
Baselinepermissive
baselineAmazon Video-Games reviews ordinal · via best lens
Baselinepermissive
baselineDruglib drug reviews ordinal · via best lens
Baselinepermissive
baselineDruglib drug reviews regression · via best lens
Baselinepermissive
baselineDouban movie reviews (Chinese) ordinal · via best lens
Baselinepermissive
baselineAmazon Video-Games reviews binary · via best lens
Baselinepermissive
baselineSentiment140 tweets binary · via best lens
Baselinepermissive
baselineLIAR fact-check statements ordinal · via best lens
Baselinepermissive