To really understand language on a deep level you cannot go with this generalistic (but very efficient) approach of an "international" transformer. In the end, we will have country or even dialect specific models. For generic text generation though