Tweet of the Day, GIGOGOGOG@#$%!@#$!@ edition.

I’m surprised anybody’s surprised. I mean, isn’t this intuitive? AI prompt results don’t have conscious decisions behind them; the model just does a high-probability guess, based on the existing information in its database. Dump enough AI prompt results into the database, and the amount of actual information goes down. Eventually it collapses, and you get a smear of fuzzy junk.

This seems pretty straightforward, yes?

A new paper in Nature found that you cannot, in fact, train AIs on AI-generated data and expect them to continue improving.

What happens is actually that the model collapses and ends up producing nonsense. pic.twitter.com/gHWP2GMafr
— Crémieux (@cremieuxrecueil) July 25, 2024

Via @Strangeland_Elf.

2 thoughts on “Tweet of the Day, GIGOGOGOG@#$%!@#$!@ edition.”

This is the near term fate of the internet, as we use AI generated content to “create content” on websites, while training AI on all available internet content.

Yay. I have predictive power.

For my next trick: The climate of the Northern hemisphere will abruptly cool in about three months.

Comments are closed.