News OpenAI will reportedly unleash next-gen Orion AI model this December — Orion is expected to be 100X more potent than GPT-4

100x more on what metrics? We ran out of internet data so it's probably not dataset size. If model size (number of parameters) increase 100x then it's hard to do wide release due to inference compute requirement, I guess distillation can help in this case.
We have to wait and see.

The link to the verge is wrong.
 
"Yet, Orion's training involved synthetic data generated by o1, known internally as Strawberry."

ChatGPT, even in Version 4, generates a lot of false information. Now, if that new Orion model has been trained with synthetic data generated by GPT4, then it will of course not be an overly reliable source.
 
  • Like
Reactions: Hartemis