"Doesnt Microsoft offer similar services ... just on a smaller scale?" Yes! But here bigger is very different. ChatGPT can consider the previous 8000 words, with something like 192 attention heads, and generate new text of any length.