"Oh no! GPT-3.5/4 has strong RLHF! We must not perpetrate OpenAI's agenda!"
a year later and thousands of models, and datasets, and "but synthetic data is good though!!!" later, every model calls itself ChatGPT, and none of them are even remotely believably human.