News OpenAI will reportedly unleash next-gen Orion AI model this December — Orion is expected to be 100X more potent than GPT-4

Bikki

Reputable
Jun 23, 2020
70
39
4,560
100x more on what metrics? We ran out of internet data so it's probably not dataset size. If model size (number of parameters) increase 100x then it's hard to do wide release due to inference compute requirement, I guess distillation can help in this case.
We have to wait and see.

The link to the verge is wrong.
 

ottonis

Reputable
Jun 10, 2020
220
190
4,760
"Yet, Orion's training involved synthetic data generated by o1, known internally as Strawberry."

ChatGPT, even in Version 4, generates a lot of false information. Now, if that new Orion model has been trained with synthetic data generated by GPT4, then it will of course not be an overly reliable source.
 
  • Like
Reactions: Hartemis