Datasets·AI·human_vs_gpt5_3lens

Human vs GPT-5 (Eval 17)

Human vs GPT-5 (3-lens) . PsyProxy quantitative evaluation. The excerpts reflect a diverse range of themes centered around relationships , personal growth, and the challenges of adulting . Many texts emphasize the importance of clear communication and setting boundaries in both romantic and familial contexts, advocating for emotional honesty and practical strategies to navigate complex situations. The tone is largely supportive and constructive, offering advice on managing stress, improving self-esteem , and fostering healthy habits. Recurring topics include the significance of self-awareness , the impact of societal expectations, and the need for balance between personal aspirations and interpersonal dynamics. Overall, the content promotes a mindset of resilience and intentionality in facing life's challenges. [Summary on 50 random texts by ChatGPT 4o Mini].

Distribution of Human vs GPT-5
1
2
3,014 at floor2,981 at ceiling
5,995
items
1,199
holdout n
Human vs GPT-5
target
Binary
kind
15
systems compared
Criterion validity

Reported holdout systems from the verified card

Binary classification uses FVE as the task-primary metric. Secondary columns keep the companion metrics visible so binary, ordinal, regression, and multiclass cards are not compared through one flattened score.

Model-family mix
PsyProxy · 4Baseline · 11
SystemFamilyVariantFVEAUCF1Primary scale
psyproxyPsyProxy — Sociology Lens v0.5 · 1000d
PsyProxypermissive0.9080.9970.980
psyproxyPsyProxy — Technology Lens v0.5 · 800d
PsyProxypermissive0.8750.9950.973
psyproxyPsyProxy — Health Lens v0.9 · 1100d
PsyProxypermissive0.8640.9950.965
psyproxyPsyProxy — Behavioral Sciences Lens v0.5 · 1000d
PsyProxypermissive0.8350.9910.964
baselineDisneyland TripAdvisor reviews binary · via best lens
Baselinepermissive
baselineIMDB movie reviews (ACL) binary · via best lens
Baselinepermissive
baselineAmazon Video-Games reviews ordinal · via best lens
Baselinepermissive
baselineAmazon Video-Games reviews continuous · via best lens
Baselinepermissive
baselineAmazon Video-Games reviews binary · via best lens
Baselinepermissive
baselineDisneyland TripAdvisor reviews continuous · via best lens
Baselinepermissive
baselineDouban movie reviews (Chinese) ordinal · via best lens
Baselinepermissive
baselineLIAR fact-check statements ordinal · via best lens
Baselinepermissive
baselineDruglib drug reviews regression · via best lens
Baselinepermissive
baselineSentiment140 tweets binary · via best lens
Baselinepermissive
baselineDruglib drug reviews ordinal · via best lens
Baselinepermissive