michaelbenayoun
/

qwen3-tiny-4kv-heads-4layers-random

Text Generation

text-generation-inference

Model card Files Files and versions

michaelbenayoun HF Staff commited on 13 days ago

Commit

7716118

·

verified ·

1 Parent(s): 23b3fd9

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -16,7 +16,7 @@
     "full_attention",
     "full_attention",
     "full_attention",
-    "full_attention",
   ],
   "max_position_embeddings": 40960,
   "max_window_layers": 28,

     "full_attention",
     "full_attention",
     "full_attention",
+    "full_attention"
   ],
   "max_position_embeddings": 40960,
   "max_window_layers": 28,