大语言模型渴望书脊。
The LLMs Yearn for the Spines

原始链接: https://buttondown.com/hillelwayne/archive/the-llms-yearn-for-the-spines/

作者通过分析 GitHub 上历年的合并请求(Pull Request)标题,探究某些词汇是否已演变为“大语言模型惯用语”(LLMisms),即被 AI 模型过度偏好的术语。以“spine”一词为例,作者观察到其 2026 年的使用量较 2025 年激增了 20 倍,即便在剔除 GitHub 整体增长因素后,这一增长依然显著。 作者探讨了 GPT-5.5 等特定模型或 Claude、Cursor 等工具是否为诱因,但该趋势似乎呈现普遍性,而非局限于特定模型。分析还涵盖了其他词汇:虽然“ladder”一词的增长被归因为自动依赖项更新,但“gate”、“lane”、“truth”和“seam”等词的频率也显著上升。这表明,大语言模型已形成独特的语言习惯,并渗透到了现代软件工程文档中。作者提供了一个用于深入探索的工具,并指出尽管大语言模型容易出现此类模式,但识别特定模型的“指纹”仍是一项复杂且持续的挑战。

Hacker News 最新 | 往期 | 评论 | 提问 | 展示 | 招聘 | 提交 登录 大语言模型渴望“书脊” ( buttondown.com/hillelwayne ) 9 分 由 zdw 1 小时前 | 隐藏 | 往期 | 收藏 | 1 条评论 帮助 skybrian 4 分钟前 [–] Anthropic 非常看重它的“宪法”。也许大型人工智能实验室也应该像杂志社那样,聘请一些编辑来为他们的人工智能制定一种“内部风格”? 看来他们其实有某种内部风格,只不过是无意中形成的罢了。 回复 指南 | 常见问题 | 列表 | API | 安全 | 法律 | 申请 YC | 联系 搜索:
相关文章

原文

Earlier this year I worked on a couple of AI-generated TLA+ specifications, and one thing I've noticed was that they all used the word "spine" somewhere. Then I saw some non-TLA+ public projects use "spine" too and got curious if it was a new LLMism (LLisM?).

If it is, we should see it appear in a discontinuous jump in the number of code projects that use "spine". The proper way to thoroughly explore this would be via the GitHub archive data dump but that'd take forever and I have a full time job now. Instead, I'm going to use GitHub Search. We can't filter code samples by date but can filter pull requests, which seems like an acceptable enough proxy.

Here's a graph of the number of public PRs each year with "spine" in the title:

I stopped 2026 at 2026-09-01, meaning the first nine months of this year have seen 20 times more "spine" PRs as all of 2025. Now it could be the case that that GitHub grew, like, a lot in the last year. Maybe the 20x increase is due there being 20x as many pull requests. We can account for this by comparing it against all public PRs:

If "spine" wasn't an LLisM, we would expect only a 1.5xish increase from 2025, not a 20x increase. One other possible confounder could be that LLMs don't like the word spine but PRs Georg submitted 15,000 changes to a chiropractor repo. I will deal with this issue by ignoring it.

Can we figure out which models specifically are obsessed with spines? Let's try breaking the change down by month:

Looking at LLM timeline, the only widely-used model released in May was Opus 4.8, which came out too late in the month to explain the spike. GPT 5.5 came out in April, which could be the cause. But I'm not convinced by this. For one, the spine count is still 1.5xing each month before April, and I definitely remember seeing spines as early as February. Also, I spot checked and many of the PRs that use "spine" are coauthored by Claude or Cursor. So I think it's not specific to one LLM, but could be convinced otherwise.

Avdi isn't crazy, LLMs are obsessed with gates:

That's one out of every 300 PRs, BTW. If we include PRs where "gate" appears anywhere, that number jumps to 1 in 26.

The reason I'm only looking at titles is because if we include PR bodies, we get an artifact when searching for "ladder". In 2022, over 30,000 PRs used the word "ladder". Looking at a sample, almost all of them are due to automated upgrades of boto3, which has "ABR package ladders" in the upgrade description. I felt really good about finding this until, out of curiosity, I asked a cleanroom LLM to "figure out the spike". It got the same answer much faster 😢

Anyway, looking at just PR titles removes that artifact for "ladder":

I was going to make an "LLM love ladder" joke, but turns out I was misremembering and the meme is "I love lamp". I checked, they don't love "lamp" any more than the average dev.

They do, however, love "lane":

Maybe this is explained by "CPU lanes"? I dunno.

Since formal verification is a hot topic in AI, of course we see a lot more PRs talking 'bout proofs:

This isn't as big of an increase, possibly because we already had "proof of work". What is a big increase is truth:

Finally, while I was writing this, a coworker mentioned she saw the word "seam" way more often, so I checked that too:

I think with some more time and sophistication, it should be possible to figure out which words are particular to specific LLMs. I'm not that sophisticated, though!

I put the tool I vibecoded to do this analysis up as a gist. Go tell me how cool I am for making reproducible datasets and/or how I screwed everything up by making an obvious mistake.


My Systems Distributed talk Logic for Programmers is going live Sept 23! I'll be doing a livechat and answering questions from viewers as it plays, and giving background notes on the Making Of. Should be starting 11 AM central / noon Eastern.

联系我们 contact @ memedata.com