Files changed (1) hide show
  1. README.md +37 -25
README.md CHANGED
@@ -1,25 +1,37 @@
1
- ---
2
- license: other
3
- license_name: qwen
4
- license_link: https://huggingface.co/Qwen/Qwen2.5-72B-Instruct/blob/main/LICENSE
5
- language:
6
- - en
7
- pipeline_tag: text-generation
8
- base_model: Qwen/Qwen2.5-72B-Instruct
9
- tags:
10
- - chat
11
- - exl2
12
- library_name: transformers
13
- ---
14
-
15
- # Qwen2.5-72B-Instruct - EXL2 7.0bpw
16
-
17
- This is a 7.0bpw EXL2 quant of [Qwen/Qwen2.5-72B-Instruct](https://huggingface.co/Qwen/Qwen2.5-72B-Instruct)
18
-
19
- Details about the model can be found at the above model page.
20
-
21
- ## EXL2 Version
22
-
23
- These quants were made with exllamav2 version 0.2.4. Quants made on this version of EXL2 may not work on older versions of the exllamav2 library.
24
-
25
- If you have problems loading these models, please update Text Generation WebUI to the latest version.
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: qwen
4
+ license_link: https://huggingface.co/Qwen/Qwen2.5-72B-Instruct/blob/main/LICENSE
5
+ language:
6
+ - zho
7
+ - eng
8
+ - fra
9
+ - spa
10
+ - por
11
+ - deu
12
+ - ita
13
+ - rus
14
+ - jpn
15
+ - kor
16
+ - vie
17
+ - tha
18
+ - ara
19
+ pipeline_tag: text-generation
20
+ base_model: Qwen/Qwen2.5-72B-Instruct
21
+ tags:
22
+ - chat
23
+ - exl2
24
+ library_name: transformers
25
+ ---
26
+
27
+ # Qwen2.5-72B-Instruct - EXL2 7.0bpw
28
+
29
+ This is a 7.0bpw EXL2 quant of [Qwen/Qwen2.5-72B-Instruct](https://huggingface.co/Qwen/Qwen2.5-72B-Instruct)
30
+
31
+ Details about the model can be found at the above model page.
32
+
33
+ ## EXL2 Version
34
+
35
+ These quants were made with exllamav2 version 0.2.4. Quants made on this version of EXL2 may not work on older versions of the exllamav2 library.
36
+
37
+ If you have problems loading these models, please update Text Generation WebUI to the latest version.