Training AI on machine-generated text could lead to ‘model collapse,’ researchers warn | University of Toronto

Source: Training AI on machine-generated text could lead to ‘model collapse,’ researchers warn | University of Toronto

“It’s kind of a reinforcing feedback loop where you only listen to the majority and you start forgetting whatever things were said less often,” he says. “There can be oddities where something that you start generating is actually not that common, and so it just starts reinforcing its own mistakes.”