Model collapse and the case for deep web data
Models trained on the output of earlier models lose the tails of the distribution and drift into nonsense. The clean data sits behind logins, and the PROPS framework is one way to train on it without anyone handing it over.