Ah, the GPT-3 results are in a separate table in the paper (table 2). You can in fact get logprobs for GPT-3 from the OpenAI API. You can't for Chatgpt yet, but OpenAI says Chatgpt will be added to the api soon, so I expect that may change!