Hugging Face's logo

jackmedda
/
google-bigbird-roberta-base_finetuned_augmented_augmented_deepseek

Text Classification
Transformers
Safetensors
big_bird
Generated from Trainer
Model card Files
xet
Community
jackmedda commited on
Commit
960c565
·
verified ·
1 Parent(s): fd2f1a6

End of training

Browse files
Files changed (3) hide show
  1. README.md +25 -14
  2. config.json +1 -1
  3. model.safetensors +1 -1
README.md CHANGED
@@ -21,11 +21,11 @@ should probably proofread and complete it, then remove this comment. -->
21
 
22
  This model is a fine-tuned version of [google/bigbird-roberta-base](https://huggingface.co/google/bigbird-roberta-base) on the None dataset.
23
  It achieves the following results on the evaluation set:
24
- - Loss: 0.6055
25
  - Accuracy: 0.7647
26
- - F1: 0.8667
27
- - Precision: 0.7647
28
- - Recall: 1.0
29
 
30
  ## Model description
31
 
@@ -56,20 +56,31 @@ The following hyperparameters were used during training:
56
 
57
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Precision | Recall |
58
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
59
- | 0.3359 | 1.0 | 23 | 0.7432 | 0.7 | 0.8235 | 0.7 | 1.0 |
60
- | 0.4858 | 2.0 | 46 | 0.9908 | 0.7 | 0.8235 | 0.7 | 1.0 |
61
- | 0.3094 | 3.0 | 69 | 0.8869 | 0.7 | 0.8235 | 0.7 | 1.0 |
62
- | 0.3995 | 4.0 | 92 | 0.8863 | 0.7 | 0.8235 | 0.7 | 1.0 |
63
- | 0.4267 | 5.0 | 115 | 1.0438 | 0.7 | 0.8235 | 0.7 | 1.0 |
64
- | 0.6401 | 6.0 | 138 | 0.9737 | 0.7 | 0.8235 | 0.7 | 1.0 |
65
- | 0.4194 | 7.0 | 161 | 1.1069 | 0.7 | 0.8235 | 0.7 | 1.0 |
66
- | 0.2656 | 8.0 | 184 | 1.1363 | 0.7 | 0.8235 | 0.7 | 1.0 |
67
- | 0.3611 | 9.0 | 207 | 1.2326 | 0.7 | 0.8235 | 0.7 | 1.0 |
 
 
 
 
 
 
 
 
 
 
 
68
 
69
 
70
  ### Framework versions
71
 
72
- - Transformers 4.48.2
73
  - Pytorch 2.3.0+cu121
74
  - Datasets 3.2.0
75
  - Tokenizers 0.21.0
 
21
 
22
  This model is a fine-tuned version of [google/bigbird-roberta-base](https://huggingface.co/google/bigbird-roberta-base) on the None dataset.
23
  It achieves the following results on the evaluation set:
24
+ - Loss: 1.3040
25
  - Accuracy: 0.7647
26
+ - F1: 0.8571
27
+ - Precision: 0.8
28
+ - Recall: 0.9231
29
 
30
  ## Model description
31
 
 
56
 
57
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Precision | Recall |
58
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
59
+ | 0.4568 | 1.0 | 46 | 0.7344 | 0.7 | 0.8235 | 0.7 | 1.0 |
60
+ | 0.6053 | 2.0 | 92 | 0.6889 | 0.7 | 0.8235 | 0.7 | 1.0 |
61
+ | 0.5004 | 3.0 | 138 | 0.6289 | 0.7 | 0.8235 | 0.7 | 1.0 |
62
+ | 0.6076 | 4.0 | 184 | 0.6493 | 0.7 | 0.8235 | 0.7 | 1.0 |
63
+ | 0.3798 | 5.0 | 230 | 0.7945 | 0.7 | 0.8235 | 0.7 | 1.0 |
64
+ | 0.2401 | 6.0 | 276 | 1.2776 | 0.7 | 0.8235 | 0.7 | 1.0 |
65
+ | 0.4076 | 7.0 | 322 | 1.1325 | 0.7 | 0.8235 | 0.7 | 1.0 |
66
+ | 0.1193 | 8.0 | 368 | 1.1424 | 0.7 | 0.8235 | 0.7 | 1.0 |
67
+ | 0.3332 | 9.0 | 414 | 0.9214 | 0.8 | 0.875 | 0.7778 | 1.0 |
68
+ | 0.1445 | 10.0 | 460 | 0.2424 | 0.9 | 0.9333 | 0.875 | 1.0 |
69
+ | 0.0029 | 11.0 | 506 | 1.6181 | 0.7 | 0.8235 | 0.7 | 1.0 |
70
+ | 0.1174 | 12.0 | 552 | 0.0031 | 1.0 | 1.0 | 1.0 | 1.0 |
71
+ | 0.0014 | 13.0 | 598 | 1.2314 | 0.8 | 0.875 | 0.7778 | 1.0 |
72
+ | 0.0011 | 14.0 | 644 | 1.1105 | 0.8 | 0.875 | 0.7778 | 1.0 |
73
+ | 0.0008 | 15.0 | 690 | 1.2286 | 0.8 | 0.875 | 0.7778 | 1.0 |
74
+ | 0.0008 | 16.0 | 736 | 1.2704 | 0.8 | 0.875 | 0.7778 | 1.0 |
75
+ | 0.0006 | 17.0 | 782 | 1.3157 | 0.8 | 0.875 | 0.7778 | 1.0 |
76
+ | 0.0005 | 18.0 | 828 | 1.3290 | 0.8 | 0.875 | 0.7778 | 1.0 |
77
+ | 0.0005 | 19.0 | 874 | 1.3752 | 0.8 | 0.875 | 0.7778 | 1.0 |
78
+ | 0.0004 | 20.0 | 920 | 1.3951 | 0.8 | 0.875 | 0.7778 | 1.0 |
79
 
80
 
81
  ### Framework versions
82
 
83
+ - Transformers 4.48.3
84
  - Pytorch 2.3.0+cu121
85
  - Datasets 3.2.0
86
  - Tokenizers 0.21.0
config.json CHANGED
@@ -36,7 +36,7 @@
36
  "rescale_embeddings": false,
37
  "sep_token_id": 66,
38
  "torch_dtype": "float32",
39
- "transformers_version": "4.48.2",
40
  "type_vocab_size": 2,
41
  "use_bias": true,
42
  "use_cache": true,
 
36
  "rescale_embeddings": false,
37
  "sep_token_id": 66,
38
  "torch_dtype": "float32",
39
+ "transformers_version": "4.48.3",
40
  "type_vocab_size": 2,
41
  "use_bias": true,
42
  "use_cache": true,
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a0038ad6364a89ace0bd5085f560e54a78aa3abbb89319c4ef3bcd167cf958b2
3
  size 512267464
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c609c8554167b6daa5a7f405f2ae75e2b0947f1918c3fc1cb069148036b389a
3
  size 512267464