rxavier
/

Taurus-7B-1.0

Text Generation

text-generation-inference

Model card Files Files and versions

rxavier commited on Mar 17, 2024

Commit

b2f2f15

·

verified ·

1 Parent(s): f2a9f5c

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -189,7 +189,7 @@ tokens = tokenizer.apply_chat_template(messages, tokenize=True, add_generation_p
 with torch.no_grad():
     outputs = model.generate(inputs=tokens, generation_config=generation_config, max_length=512)
-print(tokenizer.decode(outputs["sequences"].cpu().tolist()[0]))
 ```
 ## GGUF quants

 with torch.no_grad():
     outputs = model.generate(inputs=tokens, generation_config=generation_config, max_length=512)
+print(tokenizer.decode(outputs.cpu().tolist()[0]))
 ```
 ## GGUF quants