Hugging Face's logo

halilbabacan
/
cognitive_distortions_gpt_roberta_2k

Text Classification
English
medical
psychology
Model card Files Community
cognitive_distortions_gpt_roberta_2k
File size: 2,765 Bytes 
d35667c
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
 
---
license: mit
datasets:
- halilbabacan/cognitive_distortions_gpt4
language:
- en
metrics:
- accuracy
pipeline_tag: text-classification
tags:
- medical
- psychology
---

Epoch 1/3: 100%|██████████| 100/100 [00:22<00:00,  4.49it/s]
Validation: 100%|██████████| 26/26 [00:01<00:00, 16.91it/s]
Epoch: 1
Train Loss: 1.1479
Validation Loss: 0.2109
Accuracy: 0.9352
Error Rate: 0.0648
Epoch 2/3: 100%|██████████| 100/100 [00:12<00:00,  8.01it/s]
Validation: 100%|██████████| 26/26 [00:00<00:00, 32.50it/s]
Epoch: 2
Train Loss: 0.1944
Validation Loss: 0.1589
Accuracy: 0.9476
Error Rate: 0.0524
Epoch 3/3: 100%|██████████| 100/100 [00:12<00:00,  8.29it/s]
Validation: 100%|██████████| 26/26 [00:00<00:00, 31.56it/s]
Epoch: 3
Train Loss: 0.1459
Validation Loss: 0.1564
Accuracy: 0.9401
Error Rate: 0.0599

Sınıf Bazlı Metrikler:

Mind Reading:
Precision: 1.0000
Recall: 1.0000
F1-Score: 1.0000
Support: 36.0

Overgeneralization:
Precision: 0.9032
Recall: 0.5957
F1-Score: 0.7179
Support: 47.0

Magnification:
Precision: 0.9773
Recall: 0.9348
F1-Score: 0.9556
Support: 46.0

Labelling:
Precision: 0.6481
Recall: 0.9722
F1-Score: 0.7778
Support: 36.0

Personalization:
Precision: 1.0000
Recall: 1.0000
F1-Score: 1.0000
Support: 37.0

Fortune-telling:
Precision: 1.0000
Recall: 1.0000
F1-Score: 1.0000
Support: 36.0

Emotional Reasoning:
Precision: 1.0000
Recall: 1.0000
F1-Score: 1.0000
Support: 44.0

Mental Filter:
Precision: 1.0000
Recall: 1.0000
F1-Score: 1.0000
Support: 42.0

Should Statements:
Precision: 1.0000
Recall: 1.0000
F1-Score: 1.0000
Support: 38.0

All-or-Nothing Thinking:
Precision: 0.9744
Recall: 0.9744
F1-Score: 0.9744
Support: 39.0

Sınıf Mind Reading:
True Positive: 36
False Positive: 0
True Negative: 365
False Negative: 0

Sınıf Overgeneralization:
True Positive: 28
False Positive: 3
True Negative: 351
False Negative: 19

Sınıf Magnification:
True Positive: 43
False Positive: 1
True Negative: 354
False Negative: 3

Sınıf Labelling:
True Positive: 35
False Positive: 19
True Negative: 346
False Negative: 1

Sınıf Personalization:
True Positive: 37
False Positive: 0
True Negative: 364
False Negative: 0

Sınıf Fortune-telling:
True Positive: 36
False Positive: 0
True Negative: 365
False Negative: 0

Sınıf Emotional Reasoning:
True Positive: 44
False Positive: 0
True Negative: 357
False Negative: 0

Sınıf Mental Filter:
True Positive: 42
False Positive: 0
True Negative: 359
False Negative: 0

Sınıf Should Statements:
True Positive: 38
False Positive: 0
True Negative: 363
False Negative: 0

Sınıf All-or-Nothing Thinking:
True Positive: 38
False Positive: 1
True Negative: 361
False Negative: 1