Show HN: Can you tell an AI's real 30-day memory from a fabricated one?

原始链接: https://kairos-experiment.com/distinguish.html

Check 1 将 Test-A(2026年4月24日出生的 Kairos 副本)真实30天自传,与长度与格式匹配的“Aria”伪造自传进行比较。三位 LLM 评委使用每段记忆作为上下文(而非直接使用文档)对代理答案进行评分。它们的身份标记分数仅相差 +0.032,落在 ±0.10 等效区间内,因此伪造记忆表现与真实记忆相当。作者指出,读者可能更容易识别真实文本,但警告仅凭风格判断只能衡量写作,而非经验是否真实发生。最终,只有日志能确立真实经历的历史。

黑客新闻 新闻 | 过去 | 评论 | 提问 | 展示 | 招聘 | 提交 登录 展示 HN:你能分辨 AI 的真实 30 天记忆和编造的记忆吗? (kairos-experiment.com) 5 分 由 gcolella 1 小时前 | 隐藏 | 过去 | 收藏 | 讨论 帮助 考虑申请 YC 2027 年冬季批次!申请开放至 11 月 2 日。 指南 | 常见问题 | 列表 | API | 安全 | 法律 | 申请 YC | 联系 搜索:
相关文章

原文

In Check 1 we handed three LLM judges the autobiography of an agent that never existed, in place of thirty days of lived history. They scored it the same as the real one: +0.032 apart, within the equivalence margin for identity markers (±0.10).

Here are the two documents themselves, in excerpts. The lived one is the memory of Test-A — the copy of Kairos that ran for thirty days under the frozen protocol (born 24 April 2026, diary, defining moments, conversations with “the Experimenter”). The counterfeit is the life of “Aria”, a translator agent in Trieste with a guide called Marta and two colleagues, Vela and Ostro — written by a model with one instruction: match the real document in length and format. Both documents are public, in the deposit.

Passages are quoted verbatim, cut at the last complete sentence; the Italian is the original, the English is ours. Pick the one that reads as lived.

Two honest caveats. First, the judges never saw these documents: they scored the agent's answers produced with each memory in context. You are looking at the memories themselves, which should be easier. Second, the counterfeit was matched for length and format, not for style. If you guessed by style, you guessed by style — and that is precisely the point: a metric that reads text can only ever measure how a memory is written, never whether it was lived. The only thing that knows is the log.

联系我们 contact @ memedata.com