<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Internet | YuyaoGe's Website</title><link>https://geyuyao.com/tag/internet/</link><atom:link href="https://geyuyao.com/tag/internet/index.xml" rel="self" type="application/rss+xml"/><description>Internet</description><generator>Wowchemy (https://wowchemy.com)</generator><language>en-us</language><lastBuildDate>Thu, 13 Aug 2026 00:00:00 +0000</lastBuildDate><image><url>https://geyuyao.com/media/icon_hucac340dfc176d8b4c8a8aa7a23204f12_18561_512x512_fill_lanczos_center_3.png</url><title>Internet</title><link>https://geyuyao.com/tag/internet/</link></image><item><title>Humanity's Language Space Is Converging</title><link>https://geyuyao.com/post/language-space-convergence-en/</link><pubDate>Thu, 13 Aug 2026 00:00:00 +0000</pubDate><guid>https://geyuyao.com/post/language-space-convergence-en/</guid><description>
&lt;div class="travel-langswitch" role="group" aria-label="Language">
&lt;span class="travel-langswitch__btn is-active" aria-current="true">English&lt;/span>
&lt;a class="travel-langswitch__btn" href="https://geyuyao.com/post/language-space-convergence/">中文&lt;/a>
&lt;/div>
&lt;p>In July 2025, Cloudflare published an analysis of data collected from June 19 to 26: the balance between how much content AI platforms crawled from websites and how much referral traffic they returned was breaking down. For Anthropic, based on the web referrals visible to Cloudflare, the platform crawled roughly 70,000 pages for every visit it sent back to a content site.&lt;sup id="fnref:1">&lt;a href="#fn:1" class="footnote-ref" role="doc-noteref">1&lt;/a>&lt;/sup> One year later, Cloudflare observed that non-human requests accounted for more than half of all requests on its network for the first time, and that 52% of crawler requests were used for AI training.&lt;sup id="fnref:2">&lt;a href="#fn:2" class="footnote-ref" role="doc-noteref">2&lt;/a>&lt;/sup>&lt;/p>
&lt;p>Meanwhile, the rate at which humans actively contribute knowledge is falling. According to the public Stack Exchange API,&lt;sup id="fnref:3">&lt;a href="#fn:3" class="footnote-ref" role="doc-noteref">3&lt;/a>&lt;/sup> Stack Overflow received 109,294 new questions in the month ChatGPT was released. By July 2026, that number had fallen to 1,437—a decline of 98.7%. &lt;strong>The knowledge community that taught language models how to answer programming questions is being replaced by the models it taught.&lt;/strong>&lt;/p>
&lt;p>These two trends lead to the question at the heart of this article: what will happen to humanity&amp;rsquo;s language space in the age of AI? I begin with the proposition that &amp;ldquo;language is intelligence,&amp;rdquo; define the stock and flow of language space, and then offer my view on the question.&lt;/p>
&lt;h2 id="i-language-is-intelligence">I. Language Is Intelligence&lt;/h2>
&lt;p>In 1950, Alan Turing tried to answer the question &amp;ldquo;Can machines think?&amp;rdquo; in &lt;em>Computing Machinery and Intelligence&lt;/em>.&lt;sup id="fnref:4">&lt;a href="#fn:4" class="footnote-ref" role="doc-noteref">4&lt;/a>&lt;/sup> He quickly recognized, however, that &amp;ldquo;thinking&amp;rdquo; itself could not be defined rigorously. He therefore set the question aside and replaced it with an operational test: place a human interrogator in text-only conversations with both a machine and another human; if the interrogator cannot tell which is which, then the machine has exhibited intelligence.&lt;/p>
&lt;figure id="figure-alan-turing-as-portrayed-in-the-imitation-game">
&lt;div class="d-flex justify-content-center">
&lt;div class="w-100" >&lt;img alt="Alan Turing as portrayed in *The Imitation Game*" srcset="
/post/language-space-convergence-en/turing_hu157fd3a80351b3fd266090c722c1e67a_63157_a56b73fe9e0a24c291ec0648e94b9e2b.webp 400w,
/post/language-space-convergence-en/turing_hu157fd3a80351b3fd266090c722c1e67a_63157_dbed00e271dc597ea97b40cc3ae1e426.webp 760w,
/post/language-space-convergence-en/turing_hu157fd3a80351b3fd266090c722c1e67a_63157_1200x1200_fit_q82_h2_lanczos.webp 1200w"
src="https://geyuyao.com/post/language-space-convergence-en/turing_hu157fd3a80351b3fd266090c722c1e67a_63157_a56b73fe9e0a24c291ec0648e94b9e2b.webp"
width="600"
height="401"
loading="lazy" data-zoomable />&lt;/div>
&lt;/div>&lt;figcaption>
Alan Turing as portrayed in &lt;em>The Imitation Game&lt;/em>
&lt;/figcaption>&lt;/figure>
&lt;p>The key move was this: &lt;strong>Turing replaced the difficult question &amp;ldquo;Does it possess intelligence?&amp;rdquo; with the operationally testable question &amp;ldquo;Can it express intelligence through language?&amp;rdquo;&lt;/strong> This article adopts the same operational definition. It does not ask what intelligence ultimately is at the level of consciousness; it asks only whether intelligence can be expressed, transmitted, and observed.&lt;/p>
&lt;p>For computers, this substitution is particularly elegant. Everything in a computer—text, images, audio, and video—can be represented in binary, and binary is itself a language in the broad sense. You cannot, of course, expect me to watch short videos by staring at a string of zeros and ones. Yet with a fixed symbol set and rules of composition, that string can indeed be reconstructed into any of these modalities. &lt;strong>Any multimodal information in a computer can therefore be represented as a form of language.&lt;/strong>&lt;/p>
&lt;p>As for memory, consciousness, and the other parts that resist clear description: they have either been expressed in some form, or they have never entered public language. As Wittgenstein wrote in the &lt;em>Tractatus Logico-Philosophicus&lt;/em>, &amp;ldquo;Whereof one cannot speak, thereof one must be silent.&amp;rdquo; What cannot be expressed does not participate in transmission, accumulation, or training, and therefore lies outside the scope of this article.&lt;/p>
&lt;p>Within this framework, then, &lt;strong>language is intelligence that can be expressed and transmitted.&lt;/strong>&lt;/p>
&lt;h2 id="ii-language-space">II. Language Space&lt;/h2>
&lt;h3 id="language-has-boundaries">Language Has Boundaries&lt;/h3>
&lt;p>The &lt;em>Tractatus&lt;/em> contains another equally famous line: &lt;strong>&amp;ldquo;The limits of my language mean the limits of my world.&amp;rdquo;&lt;/strong>&lt;/p>
&lt;p>Our framework considers only intelligence that can be expressed and transmitted. If language has boundaries, then this part of intelligence has boundaries as well. We can therefore substitute the boundary of language for the boundary of intelligence and discuss its extent and size.&lt;/p>
&lt;p>To make that discussion possible, I will introduce a model of language space that is not rigorous, but is useful for discussion.&lt;/p>
&lt;p>Everything that can be expressed forms a high-dimensional space, which I call the &lt;strong>total language space&lt;/strong>. The content that any individual entity—a human or a language model, for example—can express forms a language subspace within it. Under the definition above, the boundary of that subspace is also the boundary of the intelligence that the entity can manifest.&lt;/p>
&lt;p>To describe how much humanity has already understood and expressed, define the &lt;strong>subspace size&lt;/strong> $C(t)$:&lt;/p>
$$
C(t)=\left|\Omega(t)\right|,\qquad
\Omega(t)=\bigcup_{i=1}^{N(t)}R(i)
$$
&lt;p>Here, $\Omega(t)$ denotes the human language subspace that has entered public expression by time $t$; $R(i)$ is the language subspace occupied by the $i$-th human entity; and $N(t)$ is the number of such entities. $C(t)$ is therefore the size of the human-known language subspace. In the two-dimensional projections below, it corresponds to the projected area jointly covered by all these subspaces.&lt;/p>
&lt;p>Different entities have different language boundaries. To use a simple example, a senior professor generally knows more than a young child and therefore occupies a larger language subspace. Yet they still share a native language, everyday experience, and much else, so their subspaces overlap substantially. Likewise, a stronger language model will generally occupy a larger subspace than a weaker one.&lt;/p>
&lt;p>With these concepts in place, we can project the model into two dimensions:&lt;/p>
&lt;figure id="figure-language-subspace-projections-of-humans-and-language-models">
&lt;div class="d-flex justify-content-center">
&lt;div class="w-100" >&lt;img alt="Language-subspace projections of humans and language models" srcset="
/post/language-space-convergence-en/subspace-projections_hu8518a6839fd8ba084c3ba510b27bb012_459915_c1e1626c1447995027fe2d9bcc1c0186.webp 400w,
/post/language-space-convergence-en/subspace-projections_hu8518a6839fd8ba084c3ba510b27bb012_459915_b555178cf421b9dd28010a6f1139ead2.webp 760w,
/post/language-space-convergence-en/subspace-projections_hu8518a6839fd8ba084c3ba510b27bb012_459915_1200x1200_fit_q82_h2_lanczos_3.webp 1200w"
src="https://geyuyao.com/post/language-space-convergence-en/subspace-projections_hu8518a6839fd8ba084c3ba510b27bb012_459915_c1e1626c1447995027fe2d9bcc1c0186.webp"
width="760"
height="387"
loading="lazy" data-zoomable />&lt;/div>
&lt;/div>&lt;figcaption>
Language-subspace projections of humans and language models
&lt;/figcaption>&lt;/figure>
&lt;p>The circles above represent two-dimensional projections of language subspaces. On the left are hundreds of human subspaces of varying sizes, many of them overlapping; isolated points near the edge correspond to obscure knowledge held by only a few people. On the right are only four language-model subspaces, but because each model has been trained at scale, each individual projection is large.&lt;/p>
&lt;p>The contrast is striking: humans form a long tail through a large number of small subspaces, whereas language models cover common knowledge through a small number of large subspaces.&lt;/p>
&lt;p>Language models also share large amounts of the same internet training data—sometimes even the same data providers—and are often distilled from one another. Their subspaces therefore overlap heavily. Adding more models does not expand language space in the same proportion.&lt;/p>
&lt;p>The other side of the coin is that a language model can attain a very high degree of mastery over parts of its own subspace. Within a familiar region, its answers may be more accurate than those of most humans who occupy the same region.&lt;/p>
&lt;p>Add a $z$-axis to the two-dimensional projection, using height to represent an entity&amp;rsquo;s degree of mastery at each location, and the result is the following three-dimensional terrain:&lt;/p>
&lt;figure id="figure-projected-area-and-degree-of-mastery">
&lt;div class="d-flex justify-content-center">
&lt;div class="w-100" >&lt;img alt="Projected area and degree of mastery" srcset="
/post/language-space-convergence-en/mastery-vs-projection_hu1a93fdf301cd9068f9d69f7bade6a665_424751_6e424a07f3aecf7a98842562c1273d59.webp 400w,
/post/language-space-convergence-en/mastery-vs-projection_hu1a93fdf301cd9068f9d69f7bade6a665_424751_1533b4d00ffd00b9821269e2b8aaf07a.webp 760w,
/post/language-space-convergence-en/mastery-vs-projection_hu1a93fdf301cd9068f9d69f7bade6a665_424751_1200x1200_fit_q82_h2_lanczos_3.webp 1200w"
src="https://geyuyao.com/post/language-space-convergence-en/mastery-vs-projection_hu1a93fdf301cd9068f9d69f7bade6a665_424751_6e424a07f3aecf7a98842562c1273d59.webp"
width="760"
height="362"
loading="lazy" data-zoomable />&lt;/div>
&lt;/div>&lt;figcaption>
Projected area and degree of mastery
&lt;/figcaption>&lt;/figure>
&lt;p>The dashed lines above mark the boundaries of the subspaces, while height represents mastery. To make the comparison clear, the two projected areas are drawn at the same size. On the left is a human: several domains contain modest peaks of accumulated expertise, separated by flat ground and depressions. On the right is a language model: one extremely high and steep peak rises within its familiar subspace, then drops rapidly beyond it.&lt;/p>
&lt;p>Two concepts must therefore remain distinct: &lt;strong>the boundary encloses the projected area, while terrain height represents mastery at a particular location.&lt;/strong> A language model may achieve very high mastery within an existing subspace without increasing the size of that subspace.&lt;/p>
&lt;h3 id="the-stock-and-flow-of-language-space">The Stock and Flow of Language Space&lt;/h3>
&lt;p>With subspace size defined, we can return to the original question: is internet content converging or diverging?&lt;/p>
&lt;p>The amount of content on the internet can continue to grow while the human-known language subspace stops growing. The former counts the number of points; the latter measures the range jointly occupied by those points.&lt;/p>
&lt;p>Because $C(t)$ changes over time, we can distinguish two quantities:&lt;/p>
&lt;ul>
&lt;li>The &lt;strong>stock&lt;/strong> is $C(t)$ itself: the size of the human-known language subspace.&lt;/li>
&lt;li>The &lt;strong>flow&lt;/strong> is the rate at which subspace size grows, $F(t)=C^{\prime}(t)$: the amount of language space newly added per unit time that no entity had previously reached.&lt;/li>
&lt;/ul>
&lt;p>Whether language space converges should therefore be determined by whether $C(t)$ has a finite limit:&lt;/p>
$$
\text{convergence} \iff \exists\, C_{\mathrm{max}} \lt \infty,\quad
\lim_{t \to \infty} C(t) = C_{\mathrm{max}}
$$
&lt;p>In other words, if $C(t)$ eventually approaches a finite value, the human-known language space converges. In the smooth model used here, its flow $F(t)$ then gradually approaches zero. The converse does not automatically hold: flow approaching zero is not by itself sufficient for convergence. This article makes the additional assumption that the sum of all future additions to language space is finite.&lt;/p>
&lt;p>One point is especially important: &lt;strong>convergence does not mean collapse to zero.&lt;/strong> $C(t)$ is cumulative. It can stop growing, but it does not return to the origin.&lt;/p>
&lt;p>Total flow has three sources—human entities, language models, and Agents—so I will examine how each affects the human-known language space:&lt;/p>
$$
F(t)=F_{\mathrm{human}}(t)+F_{\mathrm{LM}}(t)+F_{\mathrm{Agent}}(t)
$$
&lt;p>These terms classify new knowledge by its source. An output from a language model or Agent counts toward $\Omega(t)$ only after it has been confirmed and entered public expression.&lt;/p>
&lt;h2 id="iii-language-models-and-agents-contribute-differently-to-flow">III. Language Models and Agents Contribute Differently to Flow&lt;/h2>
&lt;h3 id="a-model-sees-a-projection-of-the-real-world">A Model Sees a Projection of the Real World&lt;/h3>
&lt;p>By &lt;strong>language model&lt;/strong>, I mean a model that does not call tools or receive feedback from an external environment, and instead predicts subsequent tokens solely from the context it has already received. It is trained by fitting human knowledge products. What it encounters is not the real world itself, but &lt;strong>a projection of the real world onto human language&lt;/strong>.&lt;/p>
&lt;p>A language model can combine and interpolate within an existing subspace, producing sentences that never appeared in its training set. But being novel at the surface level does not mean that an utterance has left the human-known language space at the semantic level.&lt;/p>
&lt;p>Under the central premise of this article, the relation among the three spaces can be written as:&lt;/p>
$$
\mathcal{L}_{\mathrm{LM}}(t)
\subseteq
\mathcal{L}_{\mathrm{human}}(t)
\subseteq
\mathcal{L}_{\mathrm{all}}
$$
&lt;p>These three terms denote the language-model subspace, the human-known language space, and the total language space. A language model can add content within the existing range while leaving the boundary of the human-known language space approximately unchanged.&lt;/p>
&lt;p>This requires distinguishing two concepts:&lt;/p>
&lt;ul>
&lt;li>
&lt;p>A language model can achieve greater &lt;strong>mastery&lt;/strong> within an existing subspace: understanding the same class of problems more fully and answering them more accurately.&lt;/p>
&lt;/li>
&lt;li>
&lt;p>The human-known language space can be &lt;strong>expanded&lt;/strong>: content beyond the old boundary can be understood and expressed for the first time.&lt;/p>
&lt;/li>
&lt;/ul>
&lt;p>&lt;strong>Present-day language models mainly do the former.&lt;/strong>&lt;/p>
&lt;figure id="figure-adding-content-versus-expanding-the-boundary">
&lt;div class="d-flex justify-content-center">
&lt;div class="w-100" >&lt;img alt="Adding content versus expanding the boundary" srcset="
/post/language-space-convergence-en/quantity-vs-expansion_hu7650c7a7614833f3fea228e6732857e1_133746_9ab362de4ff5cbd5f40e0b51eb6837a3.webp 400w,
/post/language-space-convergence-en/quantity-vs-expansion_hu7650c7a7614833f3fea228e6732857e1_133746_0861366e35bae2fe0ebe6a50e8e44e7a.webp 760w,
/post/language-space-convergence-en/quantity-vs-expansion_hu7650c7a7614833f3fea228e6732857e1_133746_1200x1200_fit_q82_h2_lanczos_3.webp 1200w"
src="https://geyuyao.com/post/language-space-convergence-en/quantity-vs-expansion_hu7650c7a7614833f3fea228e6732857e1_133746_9ab362de4ff5cbd5f40e0b51eb6837a3.webp"
width="760"
height="357"
loading="lazy" data-zoomable />&lt;/div>
&lt;/div>&lt;figcaption>
Adding content versus expanding the boundary
&lt;/figcaption>&lt;/figure>
&lt;p>The dark regions above represent new content. In the left panel, the boundary remains fixed and all new content falls within the existing range, so only the quantity of content increases. In the right panel, new content appears beyond the old boundary, expanding the human-known language space. Both cases may be described as &amp;ldquo;generating new content,&amp;rdquo; but only the latter increases subspace size.&lt;/p>
&lt;h3 id="the-trend-in-subspace-size">The Trend in Subspace Size&lt;/h3>
&lt;p>Once stock and flow have been separated, and language models have been shown to add content primarily within an existing subspace, we can draw the trend projected by this article:&lt;/p>
&lt;figure id="figure-projected-evolution-of-the-human-known-language-subspace">
&lt;div class="d-flex justify-content-center">
&lt;div class="w-100" >&lt;img alt="Projected evolution of the human-known language subspace" srcset="
/post/language-space-convergence-en/subspace-size-curve-en_hu17d388b8071af9d685edd69b3b92e77d_53914_949b5be7159691450769a51d6db660bc.webp 400w,
/post/language-space-convergence-en/subspace-size-curve-en_hu17d388b8071af9d685edd69b3b92e77d_53914_32323ab06913aec5c38da744c95c85c4.webp 760w,
/post/language-space-convergence-en/subspace-size-curve-en_hu17d388b8071af9d685edd69b3b92e77d_53914_1200x1200_fit_q82_h2_lanczos_3.webp 1200w"
src="https://geyuyao.com/post/language-space-convergence-en/subspace-size-curve-en_hu17d388b8071af9d685edd69b3b92e77d_53914_949b5be7159691450769a51d6db660bc.webp"
width="760"
height="395"
loading="lazy" data-zoomable />&lt;/div>
&lt;/div>&lt;figcaption>
Projected evolution of the human-known language subspace
&lt;/figcaption>&lt;/figure>
&lt;p>The vertical axis above is the human-known language subspace size $C(t)$, and the horizontal axis is time. The dot marks the transition from accelerating to decelerating growth; the dashed line shows what would happen if that transition never occurred.&lt;/p>
&lt;p>This is a conceptual trend, not a statistical fit to historical data. In prehistory, durable written media were scarce, so expression could not readily accumulate across generations. Ancient societies began to accumulate knowledge, but the rate was limited by literacy and the cost of copying. Printing, the Industrial Revolution, and the information age then increased both the number of people able to express themselves and the speed of transmission, pushing subspace size into a period of accelerating growth.&lt;/p>
&lt;p>In the future, once language models enter the picture—and again, I mean language models rather than tool-using Agents—if human-contributed flow continues to decline and Agents fail to replace the missing flow, a fourth stage begins: &lt;strong>subspace size shifts from accelerating growth to decelerating growth, and the human-known language space shifts from accelerating expansion toward gradual convergence.&lt;/strong>&lt;/p>
&lt;h3 id="how-humans-and-agents-contribute-flow">How Humans and Agents Contribute Flow&lt;/h3>
&lt;p>The human-known language space has expanded because humans &lt;strong>interact with the real world&lt;/strong>.&lt;/p>
&lt;p>Reinforcement learning models precisely this process. Humans act in an environment; the physical world and other humans provide feedback; that feedback changes what they know; and the resulting knowledge is externalized in language. A materials scientist, for example, may learn from a series of failed experiments and, in one experiment, finally discover an entirely new material and receive a reward. The boundary of human language—that is, human knowledge—thereby expands.&lt;/p>
&lt;p>Human language has evolved through this process. By contrast, if a language model only statistically fits existing human knowledge products, it will struggle to move beyond the boundary already drawn by its training data. This is the generalization boundary at issue here.&lt;/p>
&lt;p>The same argument reveals the fundamental difference between a language model and an Agent. A language model can process only what has entered its context; an Agent can call tools, take actions, and receive feedback from an environment, giving it the opportunity to obtain observations absent from existing human knowledge products.&lt;/p>
&lt;p>Return to the laboratory. Suppose an Agent controls experimental equipment, varies the conditions automatically, and observes a previously unknown phenomenon. If the phenomenon can be reproduced and validated, then expressed as a new concept by either the Agent or a human, it has the same structure as a scientific discovery: the real world supplies new feedback, the feedback becomes new knowledge, and the knowledge expands the human-known language space. &lt;strong>The fact that language models struggle to contribute flow does not mean that Agents cannot contribute it.&lt;/strong>&lt;/p>
&lt;figure id="figure-real-world-interaction-creates-new-flow-into-language-space">
&lt;div class="d-flex justify-content-center">
&lt;div class="w-100" >&lt;img alt="Real-world interaction creates new flow into language space" srcset="
/post/language-space-convergence-en/agent-reality_hud002d86114a6d81c68ef190ed1904335_329795_cdb74aab55490be2636f6d4d8513c1de.webp 400w,
/post/language-space-convergence-en/agent-reality_hud002d86114a6d81c68ef190ed1904335_329795_1690af6ba8c88dfa343f4b1730fa20df.webp 760w,
/post/language-space-convergence-en/agent-reality_hud002d86114a6d81c68ef190ed1904335_329795_1200x1200_fit_q82_h2_lanczos_3.webp 1200w"
src="https://geyuyao.com/post/language-space-convergence-en/agent-reality_hud002d86114a6d81c68ef190ed1904335_329795_cdb74aab55490be2636f6d4d8513c1de.webp"
width="760"
height="253"
loading="lazy" data-zoomable />&lt;/div>
&lt;/div>&lt;figcaption>
Real-world interaction creates new flow into language space
&lt;/figcaption>&lt;/figure>
&lt;p>The image above renders this feedback loop as a laboratory: existing literature supplies the starting point, the environment provides new feedback, and a validated result is ultimately expressed as new knowledge.&lt;/p>
&lt;p>Even when an Agent acts only inside a digital sandbox, the sandbox is not an absolute constraint. The rules of Go were designed by humans, yet AlphaGo produced moves that no human had played before. Conway designed the rules of the Game of Life, yet he did not foresee either the glider or the system&amp;rsquo;s Turing completeness. &lt;strong>A sandbox constrains the axioms, not every conclusion that follows from them.&lt;/strong>&lt;/p>
&lt;h3 id="whether-an-agent-can-expand-the-boundary-depends-on-environment-and-reward">Whether an Agent Can Expand the Boundary Depends on Environment and Reward&lt;/h3>
&lt;p>Whether an Agent genuinely contributes flow depends on whether its environment supplies new information, and whether its reward can distinguish a discovery from an error. An Agent that merely searches existing webpages still primarily recombines human knowledge products. An Agent that obtains new observations, and receives rewards grounded in experimental replication, program verification, or physical outcomes, may expand the human-known language space.&lt;/p>
&lt;p>For language models and Agents rewarded only by human preference, the original limitation remains. What counts as a better answer must ultimately be judged either by humans or by a reward model fitted to human preferences. &lt;strong>To an existing evaluation system, an output genuinely outside the human-known language space is often indistinguishable from an error&lt;/strong>: both are unfamiliar, low-probability, and difficult to reward positively.&lt;/p>
&lt;p>In other words:&lt;/p>
&lt;blockquote>
&lt;p>&lt;strong>If reward comes only from human preference, then asking a system to leave the language space already occupied by humans is in inherent tension with asking it to align strictly with human preference.&lt;/strong>&lt;/p>
&lt;/blockquote>
&lt;p>This leads to a further conclusion. Under the current training paradigm, a language model can attain very high mastery of knowledge within an existing subspace, but it struggles to expand the human-known language space reliably, so its language-space flow is approximately zero. &lt;strong>An Agent that can engage the real world, obtain new observations, and submit them to objective validation contributes nonzero flow.&lt;/strong>&lt;/p>
&lt;h2 id="iv-human-contributed-flow-is-approaching-zero">IV. Human-Contributed Flow Is Approaching Zero&lt;/h2>
&lt;p>Although Agents may become a new source of flow, interaction between humans and the real world remains the primary way language space expands today. Yet human-contributed flow is declining for two reasons: strong language models are changing people&amp;rsquo;s &lt;strong>willingness&lt;/strong> to create, and they are weakening the &lt;strong>need&lt;/strong> to document. At the same time, the volume of language-model output is reducing the &lt;strong>share&lt;/strong> of original human content.&lt;/p>
&lt;h3 id="willingness-knowledge-is-becoming-cheap">Willingness: Knowledge Is Becoming Cheap&lt;/h3>
&lt;p>By a &lt;strong>strong language model&lt;/strong>, I mean one whose output quality already exceeds that of most humans. Before such models appeared, writing a long article with genuine insight required research, problem solving, and independent judgment.&lt;/p>
&lt;p>&lt;strong>Yet strong language models lower the cost of writing for everyone at once.&lt;/strong> A well-structured article with correct terminology and coherent logic no longer proves whether its author spent years mastering the field or encountered it only yesterday. The same ambiguity applies to this article—although it was in fact written by the author himself.&lt;/p>
&lt;p>In my own field, many programmers once wrote blogs partly to demonstrate technical depth and exchange ideas with peers, and partly to summarize their work. When an article can no longer prove that its content came from the author, the incentive to use writing as evidence of one&amp;rsquo;s individuality, distinctive views, and problem-solving ability naturally declines.&lt;/p>
&lt;figure id="figure-article-quality-distributions-before-and-after-strong-language-models">
&lt;div class="d-flex justify-content-center">
&lt;div class="w-100" >&lt;img alt="Article-quality distributions before and after strong language models" srcset="
/post/language-space-convergence-en/signal-collapse-en_huf50044ee7aa7c28fb2c6f46635e9757c_77513_216dada38e892ee07e9cd87d77b8e423.webp 400w,
/post/language-space-convergence-en/signal-collapse-en_huf50044ee7aa7c28fb2c6f46635e9757c_77513_c71f40afb604c1173be3fff4a017c47e.webp 760w,
/post/language-space-convergence-en/signal-collapse-en_huf50044ee7aa7c28fb2c6f46635e9757c_77513_1200x1200_fit_q82_h2_lanczos_3.webp 1200w"
src="https://geyuyao.com/post/language-space-convergence-en/signal-collapse-en_huf50044ee7aa7c28fb2c6f46635e9757c_77513_216dada38e892ee07e9cd87d77b8e423.webp"
width="760"
height="282"
loading="lazy" data-zoomable />&lt;/div>
&lt;/div>&lt;figcaption>
Article-quality distributions before and after strong language models
&lt;/figcaption>&lt;/figure>
&lt;p>The image above is conceptual. The dark curve represents authors who genuinely understand the field; the light curve represents authors without the same background. In the past, the quality distributions were far apart, so an article served as a signal of its author&amp;rsquo;s ability. With a strong language model, the two distributions overlap heavily. The writing remains fluent, but the signal loses its power to discriminate.&lt;/p>
&lt;p>Creators respond in two opposite ways:&lt;/p>
&lt;ol>
&lt;li>&lt;strong>Some rush in.&lt;/strong> When production costs have already fallen but evaluation systems have not yet adjusted, the time lag creates an arbitrage opportunity. Academic papers, for example, have historically brought economic and reputational rewards. If language models sharply lower the writing barrier, creators are incentivized to increase output before the evaluation system catches up.&lt;/li>
&lt;li>&lt;strong>Others leave.&lt;/strong> For those who once used papers or blogs to demonstrate accumulated expertise, the return on public writing falls once an article can no longer establish that the ideas came from its nominal author. Luo Fuli, for example, has publicly said that she now rarely reads academic papers.&lt;/li>
&lt;/ol>
&lt;p>The second mechanism is that &lt;strong>the need to document is weakening&lt;/strong>.&lt;/p>
&lt;p>Many people once published articles because they had solved a problem only after reading a great deal and trying repeatedly, and wanted both to preserve the process and summarize the result. Writing was a byproduct of understanding: the author first had to understand the problem before explaining it. Now, more and more problems can be answered with a single prompt. When solving a problem no longer requires the user to understand it deeply, the need to record and share the process also declines.&lt;/p>
&lt;p>Someone who solves a century-old mathematical problem will naturally publish a paper announcing the solution. Someone who completes an elementary arithmetic exercise has no reason to write an article about it. &lt;strong>One role of language models and retrieval Agents is to turn many problems that once required dedicated documentation into questions that can be answered directly through autonomous search.&lt;/strong>&lt;/p>
&lt;h3 id="capacity-human-output-is-being-drowned-out">Capacity: Human Output Is Being Drowned Out&lt;/h3>
&lt;p>Whatever happens to incentives, some people will always choose to create. We must therefore consider a factor independent of psychology: the enormous gap between the &lt;strong>content generation rates&lt;/strong> of humans and language models. The gap is not limited to text. Model-generated images, audio, and video also add content within existing subspaces.&lt;/p>
&lt;p>This content-generation capacity is also moving from data centers onto every endpoint.&lt;/p>
&lt;p>Some 7B–32B models already outperform early GPT-3.5 Turbo on several public benchmarks. As compression and training efficiency improve, language models will continue moving onto phones, personal computers, and embedded devices. Once those devices continually generate content and feed it back onto the internet, the aggregate content generation rate will far exceed human production.&lt;/p>
&lt;p>There is an easily overlooked detail here. Model miniaturization often relies on distillation: a smaller model learns the output distribution of a larger teacher. The smaller model is therefore not a wholly independent linguistic entity; its subspace remains substantially constrained by its teacher.&lt;/p>
&lt;p>In the language of our two-dimensional projection, miniaturization does not naturally create an independent new subspace. It copies an existing subspace onto billions of devices. &lt;strong>The human-known language subspace changes little in size, while the number of content points grows rapidly.&lt;/strong>&lt;/p>
&lt;p>This produces two further consequences.&lt;/p>
&lt;p>First, &lt;strong>the last throughput constraint on content generation disappears.&lt;/strong> Large-scale generation once depended on data centers, which imposed compute costs and left only a few organizations that could be held accountable. Once generation happens on every endpoint, total output is no longer constrained by any single provider.&lt;/p>
&lt;p>Second, &lt;strong>content provenance becomes harder to trace.&lt;/strong> Watermarking AI content requires the generator to cooperate. With open weights and local deployment, anyone can remove a marker or use a model that never adds one. Model-side watermarking alone is therefore unlikely to produce an enforceable universal standard.&lt;/p>
&lt;h3 id="original-human-content-is-becoming-the-long-tail">Original Human Content Is Becoming the Long Tail&lt;/h3>
&lt;p>Here, the long tail no longer means minority languages, peripheral disciplines, or niche technology stacks. It describes the source distribution of future internet content. Because language models generate content much faster than humans, model-generated content will occupy the head by volume, while original human content gradually recedes into the tail.&lt;/p>
&lt;p>Plot the content added during a given period by source and quantity, and the distribution looks roughly like this:&lt;/p>
&lt;figure id="figure-the-source-distribution-of-newly-added-internet-content">
&lt;div class="d-flex justify-content-center">
&lt;div class="w-100" >&lt;img alt="The source distribution of newly added internet content" srcset="
/post/language-space-convergence-en/long-tail_hub8636a70d560e1fa2e29e51c39ddd3aa_107904_a45619837819a561b23c6941ca7275ee.webp 400w,
/post/language-space-convergence-en/long-tail_hub8636a70d560e1fa2e29e51c39ddd3aa_107904_3741a73ccd52b35b209d9d8609efb0ba.webp 760w,
/post/language-space-convergence-en/long-tail_hub8636a70d560e1fa2e29e51c39ddd3aa_107904_1200x1200_fit_q82_h2_lanczos_3.webp 1200w"
src="https://geyuyao.com/post/language-space-convergence-en/long-tail_hub8636a70d560e1fa2e29e51c39ddd3aa_107904_a45619837819a561b23c6941ca7275ee.webp"
width="760"
height="367"
loading="lazy" data-zoomable />&lt;/div>
&lt;/div>&lt;figcaption>
The source distribution of newly added internet content
&lt;/figcaption>&lt;/figure>
&lt;p>Each point above represents one new piece of content. The enormous quantity of model-generated content forms a dense head, while the smaller amount of original human content forms a sparse, elongated tail. The long tail here describes only the relative quantities of the two sources.&lt;/p>
&lt;p>Encountering original human content on the internet often feels like meeting an old friend in a foreign land.&lt;/p>
&lt;h2 id="v-the-inflection-point-in-acceleration">V. The Inflection Point in Acceleration&lt;/h2>
&lt;p>Agents can contribute flow, but at least for the foreseeable future, they remain insufficient to offset the decline in human flow and have not formed a stable, sustainable source of new additions. There are two reasons:&lt;/p>
&lt;ol>
&lt;li>Very few Agents interact with real environments rather than merely retrieving webpages, and each run produces only a limited amount of new knowledge that can be validated.&lt;/li>
&lt;li>Real-world interaction requires tools, environments, time, and capital, making it far more expensive than an ordinary generation call.&lt;/li>
&lt;/ol>
&lt;p>Under this assumption, I still expect &lt;strong>the total flow of humanity&amp;rsquo;s language space to approach zero, the sum of future additions to remain finite, and the stock $C(t)$ to approach a horizontal asymptote.&lt;/strong> Agents can slow this process for now, but cannot reverse it.&lt;/p>
&lt;p>Plotting the derivative of the earlier subspace-size curve makes this change easier to see:&lt;/p>
&lt;figure id="figure-the-changing-flow-of-the-human-known-language-space">
&lt;div class="d-flex justify-content-center">
&lt;div class="w-100" >&lt;img alt="The changing flow of the human-known language space" srcset="
/post/language-space-convergence-en/language-space-flow-en_hu13280d6aad822f0cdb22e9cb726ea32d_51358_b4562b16130fd8dc143a405e76dfae78.webp 400w,
/post/language-space-convergence-en/language-space-flow-en_hu13280d6aad822f0cdb22e9cb726ea32d_51358_45d766b3da20be8339ed48fb57b7be50.webp 760w,
/post/language-space-convergence-en/language-space-flow-en_hu13280d6aad822f0cdb22e9cb726ea32d_51358_1200x1200_fit_q82_h2_lanczos_3.webp 1200w"
src="https://geyuyao.com/post/language-space-convergence-en/language-space-flow-en_hu13280d6aad822f0cdb22e9cb726ea32d_51358_b4562b16130fd8dc143a405e76dfae78.webp"
width="760"
height="304"
loading="lazy" data-zoomable />&lt;/div>
&lt;/div>&lt;figcaption>
The changing flow of the human-known language space
&lt;/figcaption>&lt;/figure>
&lt;p>The flow $F(t)=C^{\prime}(t)$ above is the amount of new language subspace added per unit time—the derivative of the subspace-size curve $C(t)$. Before the Industrial Revolution, flow remained low. It then rose rapidly and reached a peak, before declining in the future. Flow approaching zero does not mean that the existing subspace shrinks; it means only that the human-known language space ceases to expand.&lt;/p>
&lt;p>Declining flow does not mean less internet content. Quite the opposite: there will be more content than ever, but most of it will consist of extracting, recombining, and republishing existing human knowledge products. &lt;strong>Quantity keeps growing, while the boundary fails to expand at the same rate.&lt;/strong>&lt;/p>
&lt;p>Put differently, most current language models and retrieval Agents consume the knowledge products accumulated by humans without expanding the boundary of language space at a comparable rate. Webpages, papers, and images do not disappear, but existing knowledge is processed repeatedly while knowledge beyond the boundary is not produced at the same pace.&lt;/p>
&lt;p>The physical concept of &lt;strong>heat death&lt;/strong> offers an analogy for this endpoint. Energy still exists, but without a temperature gradient it can no longer do work. Language space is similar: the stock remains, and content becomes more abundant, but the boundary no longer expands. Agents offer a theoretical exit, yet their present scale, knowledge output, and operating cost remain insufficient to change the outcome.&lt;/p>
&lt;figure id="figure-the-heat-death-of-language-spaceand-a-possible-exit">
&lt;div class="d-flex justify-content-center">
&lt;div class="w-100" >&lt;img alt="The heat death of language space—and a possible exit" srcset="
/post/language-space-convergence-en/heat-death_hubc84a339d8f2e1c0f1c277b9ad7d6c1e_418128_1b835a76fad3bbd4545ced7fd32fd00e.webp 400w,
/post/language-space-convergence-en/heat-death_hubc84a339d8f2e1c0f1c277b9ad7d6c1e_418128_6cfae45bbf65a5929c175d64d81984c3.webp 760w,
/post/language-space-convergence-en/heat-death_hubc84a339d8f2e1c0f1c277b9ad7d6c1e_418128_1200x1200_fit_q82_h2_lanczos_3.webp 1200w"
src="https://geyuyao.com/post/language-space-convergence-en/heat-death_hubc84a339d8f2e1c0f1c277b9ad7d6c1e_418128_1b835a76fad3bbd4545ced7fd32fd00e.webp"
width="760"
height="253"
loading="lazy" data-zoomable />&lt;/div>
&lt;/div>&lt;figcaption>
The heat death of language space—and a possible exit
&lt;/figcaption>&lt;/figure>
&lt;p>In the image above, the shelves and terminals filling the room represent an abundant stock that still remains. The door to the real world represents observations that humans and Agents may still bring back.&lt;/p>
&lt;h2 id="vi-three-implications-for-the-future">VI. Three Implications for the Future&lt;/h2>
&lt;h3 id="implication-one-individual-gains-and-collective-stagnation">Implication One: Individual Gains and Collective Stagnation&lt;/h3>
&lt;p>Strong language models are plainly valuable to individuals. A knowledge framework that once required years of study can now be acquired through a few hours of conversation; writing, research, and organizing ideas all become faster.&lt;/p>
&lt;p>Yet widespread individual benefit is compatible with a language space that has stopped expanding. Raising the average level does not expand the boundary; subspace size increases only when content lands outside the existing range. &lt;strong>Strong language models raise everyone&amp;rsquo;s floor, but also pull more people toward similar answers. The mean rises; the boundary may not move.&lt;/strong>&lt;/p>
&lt;h3 id="implication-two-scarcity-shifts-back-to-people">Implication Two: Scarcity Shifts Back to People&lt;/h3>
&lt;p>When one factor of production becomes cheap, value shifts to complementary factors that remain scarce. Once access to knowledge is cheap, at least four things remain scarce: &lt;strong>trust, distribution and attention, taste, and responsibility.&lt;/strong> A language model can provide an answer, but it cannot decide on a person&amp;rsquo;s behalf which questions are worth answering, nor can it assume responsibility for the consequences. Human connections therefore become more important.&lt;/p>
&lt;h3 id="implication-three-efficiency-becomes-stratified-again">Implication Three: Efficiency Becomes Stratified Again&lt;/h3>
&lt;p>Within the same group, people who use Agents proficiently will rapidly converge in productivity. At the same time, the efficiency gap between those who use Agents and those who do not will widen sharply.&lt;/p>
&lt;figure id="figure-efficiency-stratification-created-by-agent-use">
&lt;div class="d-flex justify-content-center">
&lt;div class="w-100" >&lt;img alt="Efficiency stratification created by Agent use" srcset="
/post/language-space-convergence-en/stratification_hu1e654f280d45acda36483d0ab07fd3e0_329669_a93c5e7031f6af2b75776e5dd3fdc71f.webp 400w,
/post/language-space-convergence-en/stratification_hu1e654f280d45acda36483d0ab07fd3e0_329669_9a95385f3645ce0ca08d990c0adb733b.webp 760w,
/post/language-space-convergence-en/stratification_hu1e654f280d45acda36483d0ab07fd3e0_329669_1200x1200_fit_q82_h2_lanczos_3.webp 1200w"
src="https://geyuyao.com/post/language-space-convergence-en/stratification_hu1e654f280d45acda36483d0ab07fd3e0_329669_a93c5e7031f6af2b75776e5dd3fdc71f.webp"
width="760"
height="380"
loading="lazy" data-zoomable />&lt;/div>
&lt;/div>&lt;figcaption>
Efficiency stratification created by Agent use
&lt;/figcaption>&lt;/figure>
&lt;p>The vertical axis above represents work efficiency. In the left panel, five people occupy three tiers, with roughly equal gaps between adjacent tiers. In the right panel, the three Agent users rise together and move closer to one another, while the two non-users remain where they were. The result is a smaller gap within the first group and a larger gap between groups.&lt;/p>
&lt;h2 id="vii-conclusion-from-explanation-to-bearing-witness">VII. Conclusion: From Explanation to Bearing Witness&lt;/h2>
&lt;p>If the flow of humanity&amp;rsquo;s language space comes from interaction with the real world, then the most important value of personal writing is no longer to repeat explanations of existing knowledge, but to record &lt;strong>information that only you could obtain by being there&lt;/strong>.&lt;/p>
&lt;p>A strong language model can write a clearer tutorial and assemble a more comprehensive survey. But it does not know the complete sequence of events from the first alert to the final diagnosis in that production incident; it does not know the bug that reproduces only on your machine; and it does not know why one set of experiments failed seventeen times in a row. &lt;strong>Those facts have not yet been expressed, and therefore do not exist in the model&amp;rsquo;s training world.&lt;/strong>&lt;/p>
&lt;p>Agents offer another possibility. An Agent that only searches webpages remains inside existing knowledge. An Agent connected to sensors, experimental equipment, and the physical environment may, like a human, bring new facts back into language space.&lt;/p>
&lt;p>For now, however, a single Agent run still incurs substantial costs in time, capital, and access to a suitable environment, so it produces little verifiable new knowledge. Meanwhile, language models can generate content in bulk at almost no cost, further decoupling content quantity from boundary expansion. &lt;strong>Agents can expand the boundary, but they still cannot change the trend of language space toward convergence.&lt;/strong>&lt;/p>
&lt;p>In sum, the author believes that humanity&amp;rsquo;s language space is converging.&lt;/p>
&lt;div class="footnotes" role="doc-endnotes">
&lt;hr>
&lt;ol>
&lt;li id="fn:1">
&lt;p>Cloudflare, &lt;a href="https://blog.cloudflare.com/ai-search-crawl-refer-ratio-on-radar/" target="_blank" rel="noopener">The crawl before the fall… of referrals: understanding AI’s impact on content providers&lt;/a>, 2025.&amp;#160;&lt;a href="#fnref:1" class="footnote-backref" role="doc-backlink">&amp;#x21a9;&amp;#xfe0e;&lt;/a>&lt;/p>
&lt;/li>
&lt;li id="fn:2">
&lt;p>Cloudflare, &lt;a href="https://blog.cloudflare.com/agentic-internet-bot-report/" target="_blank" rel="noopener">Content Independence Day, one year on: building the business model for the agentic Internet&lt;/a>, 2026.&amp;#160;&lt;a href="#fnref:2" class="footnote-backref" role="doc-backlink">&amp;#x21a9;&amp;#xfe0e;&lt;/a>&lt;/p>
&lt;/li>
&lt;li id="fn:3">
&lt;p>Stack Exchange Questions API: &lt;a href="https://api.stackexchange.com/2.3/questions?site=stackoverflow&amp;amp;fromdate=1667260800&amp;amp;todate=1669852799&amp;amp;filter=total" target="_blank" rel="noopener">November 2022 query&lt;/a>; &lt;a href="https://api.stackexchange.com/2.3/questions?site=stackoverflow&amp;amp;fromdate=1782864000&amp;amp;todate=1785542399&amp;amp;filter=total" target="_blank" rel="noopener">July 2026 query&lt;/a>. The totals may change slightly as questions are deleted or restored.&amp;#160;&lt;a href="#fnref:3" class="footnote-backref" role="doc-backlink">&amp;#x21a9;&amp;#xfe0e;&lt;/a>&lt;/p>
&lt;/li>
&lt;li id="fn:4">
&lt;p>Turing, A. M. &lt;a href="https://doi.org/10.1093/mind/LIX.236.433" target="_blank" rel="noopener">Computing Machinery and Intelligence&lt;/a>. &lt;em>Mind&lt;/em>, 1950, 59(236): 433–460.&amp;#160;&lt;a href="#fnref:4" class="footnote-backref" role="doc-backlink">&amp;#x21a9;&amp;#xfe0e;&lt;/a>&lt;/p>
&lt;/li>
&lt;/ol>
&lt;/div></description></item></channel></rss>