Our key finding is that by injecting information through an external synthetic data verifier, whether a human or a better model, synthetic retraining will not cause model collapse.
Lol, so to make a great model, they just need to have an even better one available first or a human who can verify every single thing it ingests.
Lol, so to make a great model, they just need to have an even better one available first or a human who can verify every single thing it ingests.
Hmm, call me skeptical on this claim.