Long System Prompts

#7
by jdp8 - opened

I'm using this model in transformers.js and am trying to pass a system prompt that is a little big long. When I run the text generation, the model starts repeating the same words. I also tried to pass it in the first user message just in case, but I get more or less the same result.

Does this model only support short system prompts or is there something else that I have to do to support long system prompts?

Edit: It also starts repeating the same words with a short system prompt asking for a summary.

Sign up or log in to comment