Datasets·AI·aita_human_vs_random_ai_3lens

AITA human vs random-AI

AITA: Human vs random-AI . PsyProxy quantitative evaluation. The excerpts reflect a diverse range of interpersonal conflicts and ethical dilemmas, primarily centered around themes of **family dynamics**, **relationship boundaries**, and **communication**. Many situations involve discussions of whether individuals are the "asshole" (YTA) or not (NTA) in various social contexts, highlighting issues such as **expectations**, **traditions**, and the importance of **empathy**. The tone fluctuates between serious and lighthearted, often encouraging self-reflection and open dialogue. Recurring topics include navigating **sibling relationships**, managing **personal autonomy**, and the complexities of **supporting loved ones** during challenging times, all while emphasizing the need for respectful interactions and understanding differing perspectives. [Summary on 50 random texts by ChatGPT 4o Mini].

Distribution of Human vs random-AI AITA-style writing
1
2
1,817 at floor1,817 at ceiling
3,634
items
727
holdout n
Human vs random-AI AITA-style writing
target
Binary
kind
15
systems compared
Criterion validity

Reported holdout systems from the verified card

Binary classification uses FVE as the task-primary metric. Secondary columns keep the companion metrics visible so binary, ordinal, regression, and multiclass cards are not compared through one flattened score.

Model-family mix
PsyProxy · 4Baseline · 11
SystemFamilyVariantFVEAUCF1Primary scale
psyproxyPsyProxy — Health Lens v0.9 · 1100d
PsyProxystrict0.8720.9950.967
psyproxyPsyProxy — Sociology Lens v0.5 · 1000d
PsyProxystrict0.8240.9910.952
psyproxyPsyProxy — Behavioral Sciences Lens v0.5 · 1000d
PsyProxystrict0.8080.9900.952
psyproxyPsyProxy — Technology Lens v0.5 · 800d
PsyProxystrict0.8060.9890.945
baselineDisneyland TripAdvisor reviews binary · via best lens
Baselinestrict
baselineIMDB movie reviews (ACL) binary · via best lens
Baselinestrict
baselineSentiment140 tweets binary · via best lens
Baselinestrict
baselineLIAR fact-check statements ordinal · via best lens
Baselinestrict
baselineDisneyland TripAdvisor reviews continuous · via best lens
Baselinestrict
baselineAmazon Video-Games reviews ordinal · via best lens
Baselinestrict
baselineAmazon Video-Games reviews continuous · via best lens
Baselinestrict
baselineDouban movie reviews (Chinese) ordinal · via best lens
Baselinestrict
baselineDruglib drug reviews ordinal · via best lens
Baselinestrict
baselineAmazon Video-Games reviews binary · via best lens
Baselinestrict
baselineDruglib drug reviews regression · via best lens
Baselinestrict