Look up stuff where? Some things are verifiable more or less directly: the Moon is not 80% made of cheese,adding glue to pizza is not healthy, the average human hand does not have seven fingers. A “reasoning” model might do better with those than current LLMs.

But for a lot of our knowledge, verifying means “I say X because here are two reputable sources that say X”. For that, having AI-generated text creeping up everywhere (including peer-reviewed scientific papers, that tend to be considered reputable) is blurring the line between truth and “hallucination” for both LLMs and humans

Basically, model collapse happens when the training data no longer matches real-world data

I’m more concerned about LLMs collaping the whole idea of “real-world”.

I’m not a machine learning expert but I do get the basic concept of training a model and then evaluating its output against real data. But the whole thing rests on the idea that you have a model trained with relatively small samples of the real world and a big, clearly distinct “real world” to check the model’s performance.

If LLMs have already ingested basically the entire information in the “real world” and their output is so pervasive that you can’t easily tell what’s true and what’s AI-generated slop “how do we train our models now” is not my main concern.

As an example, take the judges who found made-up cases because lawyers used a LLM. What happens if made-up cases are referenced in several other places, including some legal textbooks used in Law Schools? Don’t they become part of the “real world”?

I tried reading the paper. There is a free preprint version on arxiv. This page (from the article linked by OP) also links the code they used and the data they tried compressing, in the end.

While most of the theory is above my head, the basic intuition is that compression improves if you have some level of “understanding” or higher-level context of the data you are compressing. And LLMs are generally better at doing that than numeric algorithms.

As an example if you recognize a sequence of letters as the first chapter of the book Moby-Dick you’ll probably transmit that information more efficiently than a compression algorithm. “The first chapter of Moby-Dick”; there … I just did it.

I was not blaming your country at all, you’re more than doing your part. It’s just frustrating.

Thinking of the families of the victims, I hope that knowing they are not forgotten and people are trying to uncover the truth about what happened will at least provide some closure.

Especially right now, I’m feeling lots of things but “lucky” ain’t one…

The Netherlands and Australia want the ICAO Council to order Russia to enter into talks on possible reparations

“enter into talks on possible reparations”. Absolutely brutal, I wouldn’t want to be Russia right now…

These are more realistic. I hear they can form a flock and shit all over you. Scary stuff!

Can’t wait for Trump to do his thing and backstab them the second this publicity stunt loses media attention in 3…2…1…

They’ll probably get off the plane, take a couple of selfies and board another one directly to El Salvador.

When we say “Ye did this”, how many people actually recorded, played, produced, published this? I know next to nothing about modern music production, so maybe now he can do all of that at home with a laptop and an internet connection, but if there are others making money out of a clearly unstable person and getting none of the hate, I’d like at least to try and avoid giving them my money

nope… not until I’m almost but not quite done with thing B. THEN I’ll leave B unfinished and go back to thing… wait, what about thing C?!

Thank you for taking a stand in favor of all the vampires out there who are being unfairly denied careers in law enforcement

Are there any vampire rules against throwing a tear gas grenade through your window?

Still apparently no recorded kills, even if it’s not something he would have had interest in hiding

“you had me at extraordinarily expensive” DJT

The thing is that social media have an oversized influence that makes a calm discussion of possible solutions very hard to have. When the US recognized the implications of letting a foreign power exert so much control over their people, they tried banning TikTok, or breaking it up so their US operation would be under US control.

Facebook should also be split and its EU operation purchased by a European company, that could then spend more time implementing the other changes you mention (doom-scrolling, data protection) and less time lobbying to get all these pesky EU regulations removed.

And yes, it does feel heartbreaking to count the US as a threat to national security, but China has never threatened to annex Greenland with military force, so what would have been paranoia and extreme anti-americanism last year is now the sensible, level-headed thing to do.

Not just teenagers. Facebook and quite a few others should outright be banned. Not only they are scientifically proven to be a mental health catastrophe and a political threat to democracy, it’s also pretty clear now that both these things are part of their design, not bugs or unintended emerging properties.

Yep. Also, going by that measure, Hitler was a vegetarian and lover of animals who never personally killed anyone

The US being by far the biggest exporter of movies, the only way this makes sense is that Trump is not seeing enough ass-kissing (and bribes campaign donations) from the US movie industry, so he’s actively trying to damage them.

Claim foreign movies are a threat, wait for other countries to retaliate against US movies, sit back and watch bribes sales of $TRUMP grow as the major studios seek his political favor.

I read the article, looking for Musk to explain more and all I got is that he can’t be a Nazi because he has never personally killed anyone.

No, seriously, that’s the clever defense of Mr. Geniusman.

I’ve not harmed anyone in my life, so it’s an outrageous thing to claim that I’m a Nazi, because the issue with Nazis was not their mannerisms or their, you know, choice of dress, but the fact that they killed millions of people