No, english language works bad enough - going German won't improve the results as the base GPT-2 probably has a very small part of German text in it, compared to GPT-3.5 we use to generate with ChatGPT for example.