The GPT-3 paper reported SOTA performance for translation for several language pairs (with prompt-based few-shot learning), so I guess it's kind of expected that ChatGPT can do this out of the box. It still amazes me every time though.