You're wrong, the default engine in the API is text-davinci-003, which is definitely GPT 3.5. Text-davinci-003 and the model behind chatgpt have been tuned with RLHF, but if you use text-davinci-003 it will