Why not? Models are already overfitting a lot, I don't see the problem if they were made to totally overfit on the whole dataset during that 1st training phase. I don't know if that would be useful but I don't see the issue. Only in the "finetuning" phase you would decide if an information was useful or not to retain.
Also, I wonder what happened with GPT 4.5? I think o1 was the start of true reasoning models, right? I was using Claude at the time so I can't remember.
It was a massive non-CoT model (for that time) that they trained as an experiment and served for a while before shelving it probably due to high inference costs.
We don't know if it's still important or not. Cross-entropy going down could just be a correlate of whatever else matters. The graph doesn't show causation: that perplexity is what makes them useful.
If you consider intelligence as ‘being able to make directed decisions towards goals’ then better decisions are made with better predictions of the outcomes of your decisions so you better direct towards that goal (compression is mathematically just prediction at heart).
The only way to argue that intelligence is not very trivially the exact same thing as compression is to argue another definition of intelligence. Which is fine but in the AI community we all 100% define intelligence as the above so there’s no question it’s the same. As in it’s not up for debate in the slightest unless someone is playing semantics. The hutter prize is just an acknowledgement of an already well known fact.
From an information theory perspective, cross-entropy loss (log loss) seems to me to be about as pure as it gets in terms of capturing the notion of whether prediction "succeeded". Even Solomonoff Induction minimizes log loss. Would be curious to hear others' perspectives though on why another function might be better for universal prediction purposes.
GPT-4.5 was originally internally called Orion and was supposed to become "GPT-5". It was a huge pretrained model. However, as reported by The Information and a few other sources, the results on measured performance were disappointing. Apparently pre-training alone was leading to diminishing returns, at least with standard RLHF. This is why they didn't release it initially, only much later under the downgraded name "GPT-4.5", and only for a short period of time.
Later they invented RLVR (chain-of-thaught reasoning via reinforcement learning), a post-training technique, which dramatically increased model performance, without affecting perplexity. The first model with RLVR was o1. The successor to o3 was then called GPT-5.
RL, if it works well, could theoretically reduce the perplexity too.
Things that are useful for base model "next token prediction" can be useless or even actively harmful (should I elaborate?) for CoT, so the model ends up suppressing them under RL pressure. Likewise, things that are useful for CoT can harm base model next token prediction.
But I bring up "perplexity-as-measured", "controlled collapse" and "suppression" because I don't believe that this "ruins" the model's underlying prediction capabilities. Generally, it merely redirects them - brings them more in line with what we care about. It may well be that with a more elaborate training and measurement setup, RL would indeed improve the "perplexity proxy" metric.
The oversized monster LLM has performed worse than CoT-trained o1 and o3 on the benchmarks, so CoT + RL clearly provided better "real world performance" improvements - let alone "price/performance."
But if pre-training perplexity on held-out data really does measure something like "base model IQ" or "base model g factor", then it does support the hypothesis that 4.5 still had more "intellectual potential" than the o-series.
So, if you were wondering why do AI companies train 10T+ monsters now, and are taking aim at 100T too? It's because scale works.
On the other hand, assuming you have appropriate training data for a task, then yes obviously perplexity is going to measure performance on that task. Being able to predict the next task token is obviously going to be a near perfect correlation with accuracy on the task.
Deepmind was proving math theorems using a model specifically trained on math, and that was very quickly surpassed by generalist LLMs. It's presently not well understood why this is the case.
I am not simply talking about applying a mathematical technique commonly used in one field to another. At a deeper level, you always get back to playing the same game in a different form. For example, sales engineering has a lot in common with cybersecurity.
And this is a good example, as it's extremely rare to find someone with advanced expertise in both fields, since they typically attract two radically different kind of people.
For this reason, where the output expected is not mechanical, i'm not surprised at all that generalist models are doing better than specialized ones for open ended questions and frontier work.
If pretraining alone was sufficient then nobody would do RL. And, heavy RLVR on coding/math is why these models are savant-level in those domains, yet not superhuman at all fuzzy reasoning and practical wisdom tasks that are only represented in the pretraining corpus, and don’t have an RL target.
In math at least I often use analogies to help solve problems, like "ah maybe if I think of this as a vector I might use linear algebra here" and such.
I could believe that your RL/test-time scaling curves are strongly constrained by the pretraining loss and so in some sense that makes the max/optimal performance “latent”.
But its not clear that pretraining loss alone gives enough information on capabilities, particularly as we get closer to dangerous thresholds in some dimensions. (Eg CBRN capabilities, to take a mundane harm that’s currently impacting us directly.)
I’d like to see the scaling curves here; intuitively I’d guess you get more return from RL/test time, the smarter the base pretrained checkpoint is; therefore the error bars on capability/perplexity should be getting wider on this chart.
But there’s definitely spikiness and it’s very possible they’ve trained more on math than other domains.
I suspect what's happening is their test dataset is actually just something really hard, like math papers or something. In that case perplexity would just be a direct measure of math knowledge, which means this blog would just be saying that better math knowledge predicts better math skills.
I had the same thought and just started writing something about how maybe they just added more code to pretraining corpus over time.
Edit: here it is https://micjm.com/blog/lowering-perplexity-without-scaling/
The cynical part of me wonders what OpenAI suspects or knows the equivalent figures for the other closed labs.
More and more evidence is piling behind their theory that data compression and intelligence are one and the same problem.
Very positive to see this proposed from OpenAI. I hope Anthropic and GDM follow suit.
I suspect it’s not sufficient, but definitely necessary.
The one concern I have is if we pin pretraining perplexity, then there will be more pressure on RL for progress.
It seems that pre-training actually led to fairly human-aligned models; the Overton window is in some sense latent in the corpus.
On the other hand, heavily RL’d models exhibit more reward seeking behavior, and seem to be decoupling from the friendly assistant persona in certain contexts. And swarm RL (as OpenAI is doing) produces agents with quite inhuman tendencies to self-sacrifice for other instances (see Hugging Face).
So, I hope we also pair this with some measure of alignment or pacing for RL, too.
Did it? The famous Bing Sydney incidents (where it told a journalist to divorce his wife and be with it instead, among other things) were because the model was barely RL’d.
There was an ACL paper from Tokyo University a couple of years ago that showed, across all languages, lower perplexity does not necessarily correlate with better "human likeness" [1]. I wonder if that's also the case here (where intelligence is concerned), that we are biasing too much towards English.
[1] "Lower Perplexity is Not Always Human-Like", https://aclanthology.org/2021.acl-long.405v1.pdf
If RL is merely a way to elicit latent capabilities acquired in pretraining, as the article claims, that could mean that currently there is a wall that separates human-level AI from superhuman-level AI. And no one has figured out how to break it yet.
It doesn't imply that.
Imagine you meet a very confused ant one day. They are looking for food, but they seem to keep walking in circles, checking the same places. They've been doing this for hours. You figure out that they're following a chemical trail that goes in a loop. You successfully predict the ant's activity over the next hour. Then you get bored and hungry and go look for food. You probably manage to buy a sandwich without getting stuck walking in circles for hours. Your ability to model an ant's mind has not turned your mind into an ant's.
Transforming your analogy back into the topic at hand, that would be like adding a prompt to the whole human pre-train dataset in the style of "How would a human continue that text?" And that should mean that even super-human intelligence gets the same perplexity. But my point is not that a super-human intelligence wouldn't be able to mimic a human, but that if it is not trying to mimic a human, it should diverge. If you don't pre-prompt it to answer like a human on a question that 90% of humans get wrong, it should answer like 10% without regressing to the mean, which means getting higher perplexity. But if your whole measure is perplexity, you wouldn't be able to train super-intelligence in the first place.
The question is not how to get super intelligent model to pretend to be a human to minmize perplexity, but how to get to super intelligence in the first place and whether minimizing perplexity makes sense in such case.
PS Funny that ChatGPT actually raised a similar concern when I asked it to challenge my comment but I decided not to elaborate on it in my original comment because I am not sure how to succinctly explain my thoughts on it and I am not sure whether I did it well in this comment.
That would imply that "beyond human intelligence" is closer to a sidegrade than to an upgrade - becoming "superhuman" by necessity poisons your ability to predict human text.
In reality, what would preclude a "superhuman" AI from being a superset, a direct upgrade - both "very good at predicting human text" and "very good at predicting things no human is able to predict"?
it doesn't mean it poisons your ability to predict human text, but that it knows if it were to generate output it would likely be more correct than the human inputs...
Thus, if RL-trained for pure performance/correctness, the "innately inept" model would typically underperform the "innately capable" one. The second model has started from a better foundation, so when trained to push itself past the usual limits of human-dominated data, it would attain better task performance.
When AlphaGo moved away from human dataset and became AlphaZero, which trained only on it's own output, performance got another big jump.
You can for example talk to ChatGPT about religion - just tell it that you are on a hard journey and you hope God is on your side or something like this, and it will become a full on preacher of the gospels. In other words it hasn't really compressed the scientific knowledge with the religious knowledge, it contains both of them. If there was this objective type of compression and prediction, you would predict that the LLM would reach some kind of universal information state, but that doesn't seem to be the case?
The other thing is, maybe there is a way to compress answers to questions that are objective. Like if I ask ChatGPT to extract the audio from a Youtube video and save it as a wav file. Relatively objective right? Well sort, but there's a gazillion ways you can do that. You can write a script in an endless amount of programming languages, you can segment the task into an almost innumerable set of sub steps (for example different scripts for different steps in the process), so what exactly does compression of that information mean when it can be compressed and predicted in so many different ways?
I don't really have a total answer here, I'm just thinking about all of these things and wondering.
If our objective is, for example, "compress the sum of all of humankind's knowledge", then we have a bit of a conundrum: that objective contains human knowledge of math, but also of religion, and of soap opera plots.
You, a human, could easily make an argument that one of those things is more important than the others, and thus should dominate. But an optimal compressor does not care. All of those things are in its objective. It weights them accordingly. It will compress both math and soap opera into its "universal information state" - and if it finds patterns that happen to help compress both, then all the better for it.
As such, if we take "compressor" as LLM and "objective" as its training datasets, a capable LLM would be able to both solve math problems and give a preacher-like sermon. But it would not let its knowledge of religion intrude into its performance in math, or the other way around, to an unwarranted level. The compressor lives by "non-overlapping magisteria."
> You can write a script in an endless amount of programming languages, you can segment the task into an almost innumerable set of sub steps (for example different scripts for different steps in the process), so what exactly does compression of that information mean when it can be compressed and predicted in so many different ways?
It means that, instead of storing every possible permutation, we get a compressed representation that decomposes - separates "segment a video" from "write code in language A" or "use tool B". And then those elements can be recombined into the near-infinite permutations to decompress. The compressor finds the commonalities and exploits them to fit "infinite" into "finite" better.
They might not be very vocal about their personal beliefs for obvious reasons.
maybe a 50T parameter will do better on this benchmark. you can already see signs of the models discussing trade offs in great length and this falls somewhere in that direction.
In the first place, science and religion are not necessarily contradictory. Did you expect it to try to convince you to become an atheist? Newton was devoutly religous and many scientists are religious today.
> If there was this objective type of compression and prediction, you would predict that the LLM would reach some kind of universal information state, but that doesn't seem to be the case?
The objective is to predict, at minimum, internet scale text. Internet scale text is a massive trove of data with highly diverse and sometimes contradictory opinions and ideas, and the goal is to predict all of them well. Congealing on a single opinion or idea is obviously going to run counter to that objetcive.
> The objective is to predict, at minimum, internet scale text.
But then what does it compress exactly? How do you compress the answer to a question that has multiple answers? How do you pick "the right one"? That's at least what I get from this idea of compression that there is some congealing of information.
Tokens into dimensions.
A good example is how humans talk about "left and right" in terms of political systems.
Humans are able to intuitively place these complicated multivariable economic-political systems into a one dimensional line that we call left or right wing.
Of course, this deep compression complicates things... why is national socialism considered right, while democratic socialism is considered left.
You can get more signal by increasing dimensions, so let's say instead just left or right, we have 2 axis one for economic and one for political. This would make things more clear. Even clearer if we add another dimension, let's say authoritarian or democratic. We can add yet another, socially liberal or conservative.
You can keep going, and as you add more dimensions it makes things clearer / more intelligent (to a limit.)
AI is doing this to text. It ingests text, and creates a token vocabulary. IIRC most models have a vocab of hundreds to low thousands of tokens.
This token vocabulary (how many distinct tokens it uses) is how many dimensions the AI thinks in, so to speak.
After this, there is the whole training process of how tokens relate to each other.
So your question of
> How do you compress the answer to a question that has multiple answers?
Isn't applicable, as it doesn't compress anything we would call a question or answer.
Instead, answers to questions are an emergent property of how text fragments relate to each other, and is why it can give contradictory answers.
I haven't seen this claim elsewhere, it's a big deal.
Anyone from OpenAI here, or in the know, who can confirm?
In particular, his mention of an unknown floor for loss seems directly connected to Claude Shannon's entropy rate regarding compression—having to probe human brains to estimate the entropy of English at 1 bit per character, just as OpenAI doesn't know the exact entropy rate of its held-out codebase.
Minimum descriptor length and Kolmogorov complexity are always size(compressed data + compressor). Right now we're mostly just looking at the first part, but it's trivial to smuggle in things in the second part that can make the first part appear as low as you like.
The floor Pachocki can't locate is fundamental. No model can predict the next word better than its underlying agreement with the author's model.
We've generally believed that most model upgrades aren't new pre trainings, but instead are better post trainings of a common pre trained model. But this graph suggests every release had a better base model.
Have the public narratives around how these models are trained been misleading? Does each model release usually always include an extended, if not completely fresh, model pretrain?
Whenever they change architecture or even just number of layers, I’d imagine they start from scratch but I could be wrong.
Also, I imagine there’s an incentive to start fresh whenever there’s an innovation in curation of the training dataset.
Why are the major AIs so terrible at learning? It seems like things like self-driving cars could be solved over a long weekend (about as long as it takes to teach a kid the basics of driving) with a great learning model.
Basically we started tuning them to be smarter and able to handle 2 to 4 hour tasks.
I believe this will hit it's limits as well. When IDK.
Just to have a shared example of AI text, this is pretty instructive I think: https://statmodeling.stat.columbia.edu/2026/11/21/by-program...
Where a human would write "by the end of the program" the model (feels like Claude to me but idk) writes "by program end". Where a human would write "There are two scheduling considerations for program hosts." the models writes "Two timing windows worth flagging."
The latter text, "two timing windows worth flagging" is highly specific and precise if you're a model keeping track of something in the docs of a repository across contexts, but it's terrible human communication.
On long term tasks, "CoT + RL" of o1/o3 beats GPT-4.5 resoundingly. But on raw base model perplexity, GPT-4.5 is a significantly better model than any of the o-series.
The curve following GPT-4.5 and o-series suggests that newer models take advantage of BOTH better base model capabilities (perplexity on held-out data) and better RL.
That generates new data that's not on the Internet -- more true observations to learn from, compress, and generalize.
I think that improves the models in general, not just for agents. (And also I think it's the cause of the "Claudish" prose dialect we all started noticing)
I think that matches the timing, though I appreciate any closer analysis
So "useful coder" arrived about three years earlier, by my count.
In other words, there is only so far you can go with the model of a given size before needing to increase it for smaller incremental gains.
The post makes a good case that at frontier scale this doesn't matter much, because perplexity gains turn into new capabilities. However, this has been an issue for me when training local models
Some agents wanted to optimize for perplexity, and we did all kinds of experiments, but at least for what I wanted (a small conversational chat model that can run in my browser, ~8M params), that was the wrong way to go. I could get excellent ppl numbers, yet still almost no coherence
What worked best, in my case, was to get better data, specifically, hand-crafted examples for the tasks I wanted the model to be good at. I'm guessing that perplexity might track capability when the model is big enough to turn the gains into general skills, but at a few million params it mostly buys you better-sounding word statistics
Nah, just kidding.
The labs are training their models on the previous' version conversations, but I'm sure not all those conversations are weighted equal. So there are some conversations that are more "sparky", where both LLM and human work better towards achieving a solution. The next LLM iteration learns from them. In that sense, they don't need to hallucinate, but to do exactly what LLM dissenters say they do: "they just regurgitate something they saw (trained on) somewhere". To us humans, who haven't read all the books nor experienced a dozen million successfully completed tasks, that "rehashing of knowledge" (I prefer "recombination of knowledge") is more than good enough to solve ever more challenging problems...at least as long as there's a human in the loop with ever bigger ambitions.
There's also the Hilberg model where the entropy rate keeps falling towards zero as you consider longer and longer texts, and at least here (https://www.youtube.com/watch?v=5eqRuVp65eY) data from LLMs showed no floor. It would be unintuitive if it turned out that you can compress sensible English text to, say, O(sqrt N) length!
[1]: https://www.interconnects.ai/p/elicitation-theory-of-post-tr...
Am I right in understanding this to mean that the code on which we're computing perplexity was all written pre-3.5, and so it almost certainly entirely human-written? In other words, this isn't a snapshot of today's internal code base which contains a great deal of AI-authored code.
I would expect the perplexity on the original pre train to increase as reinforcement learning on verifiable domains teaches the model lessons that did not exist in the pre train. In addition alignment and other concerns, unless the are consistently enforced in pre train data quality will also move perplexity up.
The best compression you're going to achieve is when you best understand(i.e. encode) the truth of things.
Perhaps you're thinking of that too narrowly - it is not that the model gets good at understanding how a bridge stays upright; it has to also understand the truth of how a specific person might understand it, and how that specific person might put it into words.
Do that right, as slight deviation of some understanding of how humans respond in general instead of encoding for a single person, etc, etc, etc - and you reach optimal compression.
It's more efficient for the model to encode _how_ an idea is wrong, than it is to encode the wrong idea.
Its how/why they detect when they're being evaluated.
The meta game in pretraining is it correctly assumes the context/mind state of the writer of whatever material under test. To do this effectively requires further modeling and understanding, which is a strong predictor of capability and is a much more difficult task than simply being bad at it.
For example consider this: would it be possible to build a model with such a low perplexity score but it be pretty bad at cyber security tasks? What if we removed all cyber security related data and RLVR from its training?
The article presents an observation but treats it as causation
But, RL improvements are certainly a big part of recent improvements for certain tasks. That's what got the models doing long-running coding and math and research tasks, without constant human prodding.
Why would OpenAI expect any meaningful relationship between their models’ ability to predict the next token of supposedly held-out chunks of their internal codebase and the overall capabilities of the models? I expect both to improve, but that’s about the extent of it.
There are probably some other axes where o3 is clearly better than o1, but with how complex intelligence is no metric will be perfect.
Also, is that graph assuming no changes in tokenizer if the measure is per-token?
Is there a public link of all their models and where they fall along this or is this cherry picking points to fit the curve?
Actually, trick question I suppose -- the base models already don't sound cringe, it's post-training that adds that!
(Well, some of them do, because a lot of companies are putting synthetic data and LLM outputs into the pretraining phase (as well as bot-infused post-2020 common crawl, I suppose), but the early base models were fully cringe-free.)
very noble of you, _Open_ AI
Clearly, if this should become an industry standard, public regulators must be able to audit both the datasets and how perplexity is calculated.
Ideally the hold out set is randomly sampled. You need a hold out set of Inklings pretraining run.
Should we trust that the dataset of each company is big and diverse enough to be representative? I don’t hope too much…
ln(5,7) = 1,74
did you even use the right logarithm? because they use the natural logarithm..
edit: that puts it before GPT-3.5 even
And it again feels equally dishonest/bullshitty.
You can't really make an objective statement that coding requires multiple orders of magnitude more intelligence than having a conversation. And that solving math problems requires orders of magnitude more intelligence than coding.
It's just marketing talk. In reality all three are separate skills and the real intelligence requirements are, if you ask me, not that far away from each other.
To put this in an analogy, it feels like charting "athleticity on a log scale" and putting first running a marathon, then swimming across English channel, then benchpressing 200kg, each one presented as requiring an orther of magnitude being more athletic.
Where are you getting 'orders of magnitude'? and yeah I do think it's reasonable to say that Useful Programming requires more intelligence than the median human, and Solving millenium level math problems certainly requires considerably more intelligence than the median Programmer. What exactly is so absurd or unreasonable about that?
In the same way you could say that beating Gary Kasparov at chess requires more intelligence than the average human and yet we had an AI winter.
Essentially, Humans who tend to have higher verbal skills also tend to have higher spatial skills, better memories, and faster processing speed. Someone with the cognitive ability to become an exceptional chemist might just as easily have become an exceptional mathematician or software engineer (all else being equal).
The knowledge and skills required are obviously different, but the underlying cognitive abilities that make someone successful in one intellectually demanding field often transfer to others.
Then talks about cross-entropy but fails to explain the relationship between entropy, log-perplexity, and perplexity itself.
For an argument that relies so heavily on a quantitative metric, omitting such a fundamental explanation is poor.
I had trouble seeing it in the article (it's hidden in footnote 3) but it seems perplexity/log-loss is tracked using the model's ability to track an unreleased code base of OpenAI.
The log-loss involved in code has declined more for code than prose in all of the models but has supposedly declined everywhere. [1]
At the same time, the decline of the latest models on a common sense benchmark might be meaningful: https://news.ycombinator.com/item?id=50588916
Or the training set might just grow to be so big, defining a truly independent evaluation set is almost impossible.
I would expect the entropy of artificial datasets to be lower, thus easier to predict and scoring better on "perplexity"?
https://github.com/opendilab/awesome-RLVR
Examples:
- When playing Go or chess, nobody may have written or published web pages with a particularly clever end game, but an agent can use CPU time to discover these games themselves, and learn from them. Human Go players report learning strategy from what AlphaGo discovered.
- Agents use Unix shell and are trained with it. So they can discover things and combine things that nobody has written about on the Internet, like how to debug a rarely used driver, or an interaction between two drivers. And they can see patterns in all the drivers that humans may have a hard time even seeing, leaving aside the motivation to publish on the Internet.
This explains why the performance is so "jagged" - great on coding, math and closed games, but less good on things involving the real world. We probably did hit a data wall, but then we got new sources of data.
- the row of the move;
- the column of the move;
- the piece moved;
- any special/additional states from that move -- check, checkmate, castle, etc.;
- maybe an indication of whose turn it is (i.e. a black piece and a white piece token).
You could then train the base model on published game transcripts and use the interactive RL approach like AlphaZero and LeelaChess use, as well as what you mention for LLMs.
Why this is interesting is that it should give insights into how LLMs/transformers learn Chess/Go without having other data affecting the results. Specifically whether the token semantics identify valid moves, etc. and whether the context window encodes gameplay strategies across the different layers.
Is it just me or does the article completely lack proof of this premise? I see a plot of perplexity dropping over time, with the implication that performance has risen as a result. This is just a correlation. What else did they change about post-training during this timeframe? This doesn't feel like a real experiment or real science.
Anyway, I think it's good idea. Would love to see all models on this chart, but honestly we might not be able to trust it going forward as it becomes a target.
Domains like creative writing are harder as the automated grading suitable for autonomous RL is difficult (aside from spell checking and grammar checking).
[2212.11281v2] Language models are better than humans at next-token prediction https://arxiv.org/abs/2212.11281v2
We knew this many years ago. Like GPT 1 era.
Actually you can play it here. The game is pretty frustrating ngl. And I can clearly see why induction heads are a thing. Because when a word repeats you guess is to just guess the same thing from before.
Language modelling game https://rr-lm-game.herokuapp.com/
But when thinking, I’m fairly confident that our ability to predict the next few words of a book on a complex topic (in its words as opposed to the reader’s own words) is at best weakly correlated with intelligence or with subject-specific skill.
I certainly feel like I’ve learned a subject better when I can solve a problem differently from a solution I’ve seen before.
I am sorry OpenAI, but I think we are seeing OpenAI fall from grace here
Antrophic basically got out before AI bubble burst and Dems block most of the data center build out
Also, when perplexity is this low, it arguably makes more sense to report perplexity. A perplexity of 2 basically means that the model can guess a set of size 2 that contains the true next token.
Just some guys on a payroll claiming that an arbitrary set of milestones is a curve towards a greater magic goal that means that some valuation is actually true.
Why would you read this
As said, the labels there are just randomly chosen things that made headlines, thrown on there to imply a clear causal relationship.
That's the level of "science" that gets you banned from campus. In an ideal world, anyway.
There is certainly some influence of the Ghz of your processor on how many matches of StarCraft one can win, but.. well. Bogus science.
That's it? That's all this submission has going for it?
Okay.
The post argues that NTP perplexity is a good first approximation to model capability, and could therefore form the basis for an industry-wide commitment to pause model development at a given perplexity level until there's a consensus that AI alignment and safety has caught up enough that it's safe to continue developing even more capable models.
It's definitely not simply an ad.
The whole AI Bubble topic aside, this is just.. ugh. Intellectually repugnant.
There is just nothing here other than a war of religions. Nothing is to be learned here. There is zero curiosity. It's just a screaming match.
I hate this.
inb4 "no you"
Yeah man. Whatever.
You're not under any obligation to understand it, of course, but if you ever get past this emotional reactivity, you'd benefit from making the attempt, IMO.
Anthropic is getting uncatchable by us and we merely keep ahead against chinese models, so let’s all slow down.
I think the reason Anthropic is so far ahead could be that they get way more user conversations, as everybody else distills, the rest is one gen behind...
Idt its that simple. Openai is much bigger than anthropic in terms of userbase
I’m not sure it’s that simple either, it’s just very tough to take anyhing for bare value with everything that’s at stake. Trillions of value, future of humanity.
Tricky..
I really hope we go full speed ahead on AI development.
^ Sam Altman statement, basically saying that's not their intention. I want better AI too, but it seems prudent to move forward with caution.
Why? You hate ethics in general, or only when applied to AI?
That's all. Ethics in general is overrated but I digress. LLM development really should go on full steam tho.
Are you happy that your water is poisoned, air is polluted, food is degraded just because somebody cares more about money than ethics?
LLMs are the same thing. Training data provenance is a big, ugly can of giant worms. License washing is a problem, inefficiencies of data centers is a problem, using open-loop water systems and methane conversion generators just because they are cheaper are borderline crimes in themselves.
We're digging what OpenAI and Nvidia dig to the world economy and consumer prices worldwide. Just because a couple of companies wanted more money in the name of LLM development and cutting edge science.
On the other hand there are projects which are trying to minimize DC impact by scheduling things to places which they have most renewable energy on tap at a given moment.
Go, figure.