PsyProxy
Datasets·Social science·11__consumer_complaints__response_explanation_vs_relief

CFPB consumer complaints: explanation vs relief response

CFPB Consumer Complaints is a public corpus from the U.S. Consumer Financial Protection Bureau database of consumer complaints filed against financial-services companies, paired with the company’s response classification (explanation vs monetary relief). The texts in the corpus predominantly address issues related to inaccurate credit reporting , identity theft , and disputed accounts . Many individuals express concerns about unauthorized charges and fraudulent accounts appearing on their credit reports, which they assert are damaging their creditworthiness. Common themes include requests for validation of debts , disputes over erroneous personal information , and frustrations with the lack of response from credit reporting agencies. Additionally, there are mentions of legal rights under the Fair Credit Reporting Act and the potential for pursuing legal action if issues remain unresolved. Overall, the texts reflect a significant level of distress and urgency regarding the management of personal credit information. [Summary on 50 random texts by ChatGPT 4o Mini].

Distribution of Response type (explanation vs relief)
1
2
199,019 at floor100,981 at ceiling
300,000
items
60,000
holdout n
Response type (explanation vs relief)
target
Binary
kind
27
systems compared
Criterion validity

Reported holdout systems from the verified card

Binary classification uses FVE as the task-primary metric. Secondary columns keep the companion metrics visible so binary, ordinal, regression, and multiclass cards are not compared through one flattened score.

Source podium · FVE · 10 families
Gold
Topic models
0.074
Silver
PsyProxy
0.065
Bronze
LIWC
0.043
Model-family mix
Topic model · 2PsyProxy · 4Lexicon · 2Baseline · 16OpenAI / LLM · 3

Best PsyProxy row is #2 overall among all model families on this card.

SystemFamilyVariantFVEAUCF1Primary scale
topicHierarchical Dirichlet Process (tomotopy HDP)
Topic modelpermissive0.0740.6800.236
psyproxyPsyProxy — Technology Lens v0.5 · 800d
PsyProxypermissive0.0650.6680.260
psyproxyPsyProxy — Health Lens v0.9 · 1100d
PsyProxypermissive0.0650.6700.269
psyproxyPsyProxy — Social Economics Lens v0.5 · 1000d
PsyProxypermissive0.0640.6670.249
psyproxyPsyProxy — Behavioral Sciences Lens v0.5 · 1000d
PsyProxypermissive0.0610.6640.264
topicBERTopic
Topic modelpermissive0.0490.6410.033
lexLinguistic Inquiry and Word Count (LIWC)
Lexiconpermissive0.0420.6430.107
baselineTool for the Automatic Analysis of Syntactic Sophistication and Complexity (TAASSC)
Baselinepermissive0.0390.6410.103
baselineTextDescriptives
Baselinepermissive0.0340.6310.141
baselineTool for the Automatic Analysis of Lexical Sophistication (TAALES)
Baselinepermissive0.0290.6200.041
baselineEmpath
Baselinepermissive0.0270.6170.057
baselineTool for the Automatic Analysis of Cohesion (TAACO)
Baselinepermissive0.0210.6030.087
llmOpenAI Model gpt-5-nano
OpenAI / LLMpermissive0.0030.5380.000
lexValence Aware Dictionary and sEntiment Reasoner (VADER)
Lexiconpermissive0.0030.5400.002
llmOpenAI Model gpt-4o-mini
OpenAI / LLMpermissive0.0020.5270.000
llmOpenAI Model gpt-4.1-nano
OpenAI / LLMpermissive-0.0000.5070.000
baselineDisneyland TripAdvisor reviews continuous · via best lens
Baselinepermissive
baselineAmazon Video-Games reviews binary · via best lens
Baselinepermissive
baselineIMDB movie reviews (ACL) binary · via best lens
Baselinepermissive
baselineAmazon Video-Games reviews continuous · via best lens
Baselinepermissive
baselineAmazon Video-Games reviews ordinal · via best lens
Baselinepermissive
baselineDisneyland TripAdvisor reviews binary · via best lens
Baselinepermissive
baselineDouban movie reviews (Chinese) ordinal · via best lens
Baselinepermissive
baselineDruglib drug reviews regression · via best lens
Baselinepermissive
baselineLIAR fact-check statements ordinal · via best lens
Baselinepermissive
baselineDruglib drug reviews ordinal · via best lens
Baselinepermissive
baselineSentiment140 tweets binary · via best lens
Baselinepermissive