Update README.md
Browse files
README.md
CHANGED
|
@@ -15,6 +15,68 @@ library_name: allennlp
|
|
| 15 |
该模型是基于 AllenNLP 在 [qgyd2021/language_identification](https://huggingface.co/datasets/qgyd2021/language_identification) 数据集上训练的语种识别模型。
|
| 16 |
|
| 17 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 18 |
测试代码:
|
| 19 |
```python
|
| 20 |
#!/usr/bin/python3
|
|
|
|
| 15 |
该模型是基于 AllenNLP 在 [qgyd2021/language_identification](https://huggingface.co/datasets/qgyd2021/language_identification) 数据集上训练的语种识别模型。
|
| 16 |
|
| 17 |
|
| 18 |
+
|
| 19 |
+
在 valid 验证集上的准确率情况:
|
| 20 |
+
|
| 21 |
+
| 语种 | 样本数量 | 准确率 |
|
| 22 |
+
| :--- | :----: | ------: |
|
| 23 |
+
| af | 6221 | 0.8666 |
|
| 24 |
+
| ar | 19808 | 0.9994 |
|
| 25 |
+
| bg | 19913 | 0.9958 |
|
| 26 |
+
| bn | 7396 | 0.9968 |
|
| 27 |
+
| bs | 1653 | 0.8232 |
|
| 28 |
+
| cs | 19122 | 0.9615 |
|
| 29 |
+
| da | 19500 | 0.9727 |
|
| 30 |
+
| de | 19702 | 0.996 |
|
| 31 |
+
| el | 19455 | 0.9761 |
|
| 32 |
+
| en | 39710 | 0.9942 |
|
| 33 |
+
| eo | 18542 | 0.9944 |
|
| 34 |
+
| es | 19924 | 0.9937 |
|
| 35 |
+
| et | 19482 | 0.9727 |
|
| 36 |
+
| fi | 19223 | 0.9554 |
|
| 37 |
+
| fo | 4612 | 0.9697 |
|
| 38 |
+
| fr | 19990 | 0.9957 |
|
| 39 |
+
| ga | 19949 | 0.9973 |
|
| 40 |
+
| gl | 508 | 0.822 |
|
| 41 |
+
| hi | 19984 | 0.9965 |
|
| 42 |
+
| hi_en | 1358 | 0.951 |
|
| 43 |
+
| hr | 18840 | 0.9789 |
|
| 44 |
+
| hu | 669 | 0.8873 |
|
| 45 |
+
| hy | 124 | 0.9688 |
|
| 46 |
+
| id | 4669 | 0.9968 |
|
| 47 |
+
| is | 19795 | 0.9876 |
|
| 48 |
+
| it | 19742 | 0.9941 |
|
| 49 |
+
| ja | 20130 | 0.9996 |
|
| 50 |
+
| ko | 20098 | 0.9998 |
|
| 51 |
+
| lt | 19280 | 0.9721 |
|
| 52 |
+
| lv | 19459 | 0.9931 |
|
| 53 |
+
| mr | 10300 | 0.9961 |
|
| 54 |
+
| mt | 19708 | 0.993 |
|
| 55 |
+
| nl | 18452 | 0.9258 |
|
| 56 |
+
| no | 19404 | 0.9714 |
|
| 57 |
+
| pl | 19920 | 0.9973 |
|
| 58 |
+
| pt | 19996 | 0.9946 |
|
| 59 |
+
| ro | 19804 | 0.9944 |
|
| 60 |
+
| ru | 20003 | 0.9954 |
|
| 61 |
+
| sk | 19804 | 0.9861 |
|
| 62 |
+
| sl | 19665 | 0.9926 |
|
| 63 |
+
| sv | 18941 | 0.95 |
|
| 64 |
+
| sw | 19768 | 0.9871 |
|
| 65 |
+
| th | 19917 | 0.9991 |
|
| 66 |
+
| tl | 19572 | 0.9991 |
|
| 67 |
+
| tn | 19883 | 0.9933 |
|
| 68 |
+
| tr | 19809 | 0.9939 |
|
| 69 |
+
| ts | 19752 | 0.9854 |
|
| 70 |
+
| uk | 17643 | 0.9994 |
|
| 71 |
+
| ur | 19895 | 0.992 |
|
| 72 |
+
| vi | 19836 | 0.9982 |
|
| 73 |
+
| yo | 1936 | 0.9827 |
|
| 74 |
+
| zh | 40108 | 0.9996 |
|
| 75 |
+
| zu | 5406 | 0.9905 |
|
| 76 |
+
|
| 77 |
+
|
| 78 |
+
|
| 79 |
+
|
| 80 |
测试代码:
|
| 81 |
```python
|
| 82 |
#!/usr/bin/python3
|