In order to get an idea of inference hardware required for chatgpt and gpt3 models, try running GPT NeoX on a colab gpu. DistilGPT can easily run on colab gpus but large models with even more than 2 billion parameters are unusable.