I guess GPT-4 will be run on newest GPU infrastructure. ChatGPT implementation of GPT-4 might be very far away though so i think it will first be given access to companies through APIs just like how GPT-3 was given and until they find infra to feas