<?xml version="1.0" encoding="utf-8"?><feed xmlns="http://www.w3.org/2005/Atom" xml:lang="zh-CN"><generator uri="https://jekyllrb.com/" version="3.10.0">Jekyll</generator><link href="https://roy-tong.github.io/feed.xml" rel="self" type="application/atom+xml" /><link href="https://roy-tong.github.io/" rel="alternate" type="text/html" hreflang="zh-CN" /><updated>2026-08-21T19:11:36+08:00</updated><id>https://roy-tong.github.io/feed.xml</id><title type="html">Roy.Tong</title><subtitle>Roy.Tong 的公开研究与项目主页：Research、Essays、Projects，长期研究前沿技术如何变成真实的产品、系统与商业。当前战役：Agent Capability Economy——当软件消费者从人变成 Agent，软件如何被发现、选择、调用、计量与交易。</subtitle><author><name>Roy.Tong</name></author><entry><title type="html">AI 应用不会被 Agent 塞满，它们会先被拆掉</title><link href="https://roy-tong.github.io/notes/ai-apps-unbundled-before-agent-filled/" rel="alternate" type="text/html" title="AI 应用不会被 Agent 塞满，它们会先被拆掉" /><published>2026-08-21T10:00:00+08:00</published><updated>2026-08-21T10:00:00+08:00</updated><id>https://roy-tong.github.io/notes/ai-apps-unbundled-before-agent-filled</id><content type="html" xml:base="https://roy-tong.github.io/notes/ai-apps-unbundled-before-agent-filled/"><![CDATA[<p>过去一年，AI 应用最常见的产品思路，是给现有软件加一个 Agent：CRM 加销售 Agent，文档工具加写作 Agent，设计软件加创作 Agent。</p>

<p>把 DeepSeek Harness（DSH）和 Codex Harness 放在一起看，会看到另一条更激进的路线：未来的软件未必还是一个封装好的 App。模型、Skill、工具、数据、执行环境和界面可以在运行时临时组合，任务结束后，这套组合也可以随之消失。</p>

<p>今天我们打开一个个 App。以后，Agent 可能根据任务临时组装一个”应用”。</p>

<p>这不是给旧软件多装一个聊天框，而是在改变软件的基本单位。</p>

<h2 id="harness-正在变成新的软件运行时">Harness 正在变成新的软件运行时</h2>

<p>DeepSeek 对 Agent 的定义很直接：</p>

<blockquote>
  <p>Agent = Model + Harness</p>
</blockquote>

<p>DSH 把模型、工具、Skill、会话、沙箱、存储、Loop、调度和 UI 都做成插件。标准模式、PTC 模式、极简模式和创造模式，背后是不同的运行时组合。创造模式甚至可以检查当前 runtime、在内存中试验插件，再把它们组合成新的 preset。<a href="https://deepseek.com/harness/">DeepSeek 官方预览页</a></p>

<p>Codex 走的路径不同，落点却很接近。Codex 的 Web、CLI、IDE 扩展和桌面 App 共用同一套 Harness；App Server 通过双向 JSON-RPC，把 Agent Loop、会话、配置、授权和事件流暴露给不同客户端。外部产品也可以借此嵌入 Codex，而不用重新实现整套 Agent 逻辑。<a href="https://openai.com/index/unlocking-the-codex-harness/">OpenAI：Unlocking the Codex harness</a></p>

<p>两家公司都在做同一件事：把 Harness 从产品内部的实现细节，变成可复用、可组合的运行时。</p>

<p>DSH 仍处于开发者预览阶段，官方也明确提醒核心插件和 API 还会变化。Codex App Server 同样是快速演进中的平台接口。它们还不是已经定型的行业标准，但方向已经足够清楚。</p>

<h2 id="app-会变成一次运行时组合">App 会变成一次运行时组合</h2>

<p>传统软件把界面、流程、业务逻辑、数据和执行能力打包在一起：</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>用户 → App → UI / Workflow / Logic / Data / Execution
</code></pre></div></div>

<p>Harness-native 软件更像：</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>用户目标
   ↓
Agent
   ↓
Harness
   ↓
按任务选择 Model / Skill / Tool / Data / UI
   ↓
执行并交付结果
</code></pre></div></div>

<p>比如用户提出一个任务：</p>

<blockquote>
  <p>研究大疆最近两年的海外市场变化，给我一份带图表的报告。</p>
</blockquote>

<p>Harness 可以临时加载网页搜索、财务数据、视频与论坛检索、PDF 阅读、电子表格、图表生成和报告渲染。它们共同组成一个研究应用。报告交付后，这个组合没有必要继续存在。</p>

<p>这类软件可以叫 Ephemeral Software：为一个任务生成，运行一次或几次，然后消失。</p>

<p>软件不会因此变少。恰恰相反，当开发和组装成本下降，大量过去不值得单独开发的内部工具、个人工具和一次性工具都会出现。减少的可能不是软件数量，而是每一份软件都要变成长期产品的必要性。</p>

<h2 id="saas-会被拆包workflow-最先承压">SaaS 会被拆包，Workflow 最先承压</h2>

<p>今天的 SaaS 通常把五层东西一起卖给用户：</p>

<table>
  <thead>
    <tr>
      <th>层</th>
      <th>SaaS 提供的内容</th>
    </tr>
  </thead>
  <tbody>
    <tr>
      <td>Interface</td>
      <td>GUI</td>
    </tr>
    <tr>
      <td>Workflow</td>
      <td>固定流程</td>
    </tr>
    <tr>
      <td>Logic</td>
      <td>业务规则</td>
    </tr>
    <tr>
      <td>Data</td>
      <td>业务数据</td>
    </tr>
    <tr>
      <td>Execution</td>
      <td>执行动作</td>
    </tr>
  </tbody>
</table>

<p>Agent 最容易接管的是 Interface 和 Workflow，因为自然语言正在成为新的交互入口，Harness 又能负责流程编排。</p>

<p>过去，销售要进入 CRM，筛客户、查记录、写邮件、建任务、设 follow-up。以后，他只需要说：</p>

<blockquote>
  <p>找出过去两周没有跟进、但成交概率最高的 20 个客户。分别写一封邮件，高价值客户先让我确认。</p>
</blockquote>

<p>CRM 的大量页面和点击路径会退到 Agent 背后，但客户记录、权限、历史互动、邮件发送和审计日志不会消失。Agent 越能执行任务，越需要这些真实数据和动作接口。</p>

<p>所以 SaaS 面临的不是整齐划一的”死亡”。分化会更明显：</p>

<ul>
  <li>靠用户手动操作固定流程创造价值的 Workflow SaaS，风险更高。</li>
  <li>掌握业务事实的 System of Record，价值可能上升。</li>
  <li>能完成真实动作的 System of Action，也会变得更重要。</li>
</ul>

<p>判断一家软件公司是否安全，可以问一个很直接的问题：</p>

<blockquote>
  <p>Agent 有没有理由绕过它？</p>
</blockquote>

<p>如果 Agent 只需要它的 API，不需要它的界面，产品的定价、分发和护城河都要重新算。</p>

<h2 id="软件市场会从-app-economy-转向-capability-economy">软件市场会从 App Economy 转向 Capability Economy</h2>

<p>今天，软件行业的基本单位是 Application：Photoshop、Figma、Salesforce、Expedia。</p>

<p>Harness 看到的却是一个个能力：</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>remove_background()
render_video()
query_customer()
book_flight()
generate_contract()
send_campaign()
</code></pre></div></div>

<p>应用被拆开后，Agent 要做的是在任务中发现、比较和调用能力。DSH 的插件架构已经把这件事推进到运行时内部；它的 subagent 接口还允许同一上下文注册多个 provider，包括 Codex、Claude Code 和 DSH SDK。<a href="https://github.com/deepseek-ai/deepseek-harness/blob/master/docs/subsystems/subagent.md">DeepSeek Harness：Subagent</a></p>

<p>Agent 也开始成为另一个 Agent 的 Tool。软件生态不再只是 App Store 里的一排图标，而会逐渐长成一张 Capability Graph：通用 Agent 负责理解目标，专业 Agent 接下子任务，再调用底层工具和服务。</p>

<p>新的分发问题也随之出现。开发者过去研究的是”怎么让人下载我的 App”，以后还要研究”怎么让 Agent 选择我的能力”。</p>

<p>这会催生新的基础设施：Capability Registry、Agent Search、可靠性排名、Eval、归因、支付和声誉系统。</p>

<h2 id="模型很重要但模型优势不等于应用壁垒">模型很重要，但模型优势不等于应用壁垒</h2>

<p>当模型和 Harness 解耦，同一套运行时可以接多个模型：分类交给小模型，代码交给 Coding Model，视觉任务交给 VLM，复杂推理再调用 Frontier Model。</p>

<p>顶级模型仍然有巨大的价值，只是应用不必把全部能力押在单一模型上。Harness 越成熟，应用越容易根据成本、速度和任务类型切换模型。</p>

<p>这会让一批”LLM API + Prompt + Workflow + 漂亮 UI”的应用承压。Agent Loop、工具调用、上下文管理、沙箱、权限、Skill 和 Subagent 正在变成公共基础设施。单纯把这些部件拼在一起，越来越难形成长期壁垒。</p>

<h2 id="ai-应用的壁垒会集中到五种资产">AI 应用的壁垒会集中到五种资产</h2>

<p>Harness 可以复制工作流，却不能凭空生成真实世界里的资产。未来更值得看的，是下面五件事：</p>

<ol>
  <li>独有的 Context 和 Data：客户记录、案件材料、库存、价格、历史交互。</li>
  <li>Execution：支付、发货、发邮件、改配置、提交订单等真实动作。</li>
  <li>Feedback Loop：大量任务结果能否持续改善判断和执行。</li>
  <li>Permission 和 Trust：用户是否敢授权它处理资金、隐私和高风险操作。</li>
  <li>Distribution 和 Network：用户、商家、开发者和供需关系是否已经形成网络。</li>
</ol>

<p>法律 Agent 的价值不会来自一个”很懂法律”的 Prompt，而会来自案例库、客户材料、执业权限、律师网络和案件结果。</p>

<p>电商 Agent 也一样。推荐话术容易复制，商品、库存、价格、支付、物流和售后网络复制起来很慢。</p>

<p>企业 AI 的护城河则会落在企业数据、权限、执行接口、审计和历史结果上。</p>

<h2 id="代码会变便宜什么叫正确会变贵">代码会变便宜，”什么叫正确”会变贵</h2>

<p>OpenAI 的 Harness Engineering 实验提供了一个很具体的信号：一个内部 beta 项目的代码库在五个月后达到约百万行，覆盖应用逻辑、基础设施、工具和文档；期间约有 1,500 个 PR 被创建并合并，起初由三名工程师驱动 Codex 完成。<a href="https://openai.com/index/harness-engineering/">OpenAI：Harness engineering</a></p>

<p>OpenAI 对这项实验的总结不是”程序员消失了”。团队的主要工作从亲手写代码，转向设计环境、表达意图和建立反馈闭环。</p>

<p>代码生成得越快，真正稀缺的东西越往上游移动：</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Specification
Architecture
Test
Eval
Policy
Context
Observability
Feedback Loop
</code></pre></div></div>

<p>实现成本下降，不代表软件工程变简单。工程师要把”正确”写进环境，让 Agent 能检查、修正并持续运行。Harness Engineering 这个名字准确地描述了这种变化。</p>

<h2 id="gui-不会消失它会变成-control-plane">GUI 不会消失，它会变成 Control Plane</h2>

<p>所有软件都变成聊天框，既不现实，也没有必要。</p>

<p>视频时间线、3D 空间、CAD、地图和设计画布依然是高带宽输入工具。Agent 完成任务后，人也需要检查、比较、修改和确认结果。</p>

<p>GUI 更大的变化，是操作层逐渐让位给控制层：</p>

<ul>
  <li>Agent 正在做什么？</li>
  <li>它用了哪些数据？</li>
  <li>花了多少钱？</li>
  <li>为什么做这个决定？</li>
  <li>哪些动作需要批准？</li>
  <li>失败发生在哪里？</li>
</ul>

<p>工作台不会消失，但它的重心会从 Workspace 移向 Control Plane。</p>

<h2 id="商业模式会从-seat-economy-转向-machine-economy">商业模式会从 Seat Economy 转向 Machine Economy</h2>

<p>SaaS 按 seat 收费，是因为人在操作软件。Agent 成为主要操作者后，一个 Agent 可能替代大量页面操作，同时产生远高于人的 API 调用量。</p>

<p>计价方式会逐渐向 Usage、Transaction、Outcome、Compute、Data 和 Agent Action 移动。</p>

<p>这不一定降低 SaaS 的收入。一个人一天打开 CRM 20 次，一个 Agent 可能调用接口 20,000 次。软件消费没有消失，消费者从人变成了机器，定价单位也要跟着变。</p>

<h2 id="接下来值得关注的五个位置">接下来值得关注的五个位置</h2>

<p>未来三到五年，最有机会的可能不是另一个 Chat UI，而是五个基础位置：</p>

<ul>
  <li>Agent Runtime / Harness Infrastructure：让 Agent 长期稳定运行。</li>
  <li>Context Infrastructure：让 Agent 获得正确、可更新的长期上下文。</li>
  <li>Capability Economy Infrastructure：帮助 Agent 发现、购买和调用服务。</li>
  <li>Trust / Eval / Observability：判断 Agent 和 Tool 是否可靠。</li>
  <li>Vertical System of Action：控制行业数据、执行能力和反馈闭环，直接交付结果。</li>
</ul>

<p>最后一类的市场可能最大。AI 招聘、法务、财务、电商运营、市场研究、软件开发、内容生产和客服，最终比拼的都不是”谁做了一个行业 Agent”，而是谁掌握了 Agent 完成任务时绕不开的数据、权限、动作和结果。</p>

<h2 id="软件的第一用户正在从人变成-agent">软件的第一用户，正在从人变成 Agent</h2>

<p>过去，人是用户，软件是工具。</p>

<p>现在，人还是用户，Agent 是助手，软件继续当工具。</p>

<p>再往前走一步，人只负责提出目标，Agent 会成为软件的直接使用者：</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Human → Goal → Agent → consume Software
</code></pre></div></div>

<p>这才是 DSH 和 Codex Harness 释放出的真正信号。Coding Agent 变强只是表面变化，底层变化是”Agent 作为软件第一用户”的基础设施开始成熟。</p>

<p>Harness 会把 Agent 平台化，Agent 会吸收大量 Workflow。传统 App 随后被拆成 Experience、Context、Capability 和 Execution。</p>

<p>以后最有价值的软件公司，未必拥有界面最完整的 App。它可能只拥有一项能力，但那项能力掌握真实数据、可以执行关键动作，而且 Agent 无法绕开。</p>]]></content><author><name>Roy.Tong</name></author><category term="Agent" /><category term="Harness" /><category term="Capability Economy" /><category term="SaaS" /><category term="Ephemeral Software" /><summary type="html"><![CDATA[把 DeepSeek Harness 和 Codex Harness 放在一起看，会发现一条比"给软件加 Agent"更激进的路线：模型、Skill、工具、数据、执行环境和界面在运行时临时组合，任务结束后随之消失。软件的基本单位正在从 App 变成 Capability，SaaS 会被拆包，商业模式从 Seat Economy 转向 Machine Economy。]]></summary></entry><entry><title type="html">The Upsider 事件：Agent 第一次作为经济主体收付了钱</title><link href="https://roy-tong.github.io/notes/the-upsider-event/" rel="alternate" type="text/html" title="The Upsider 事件：Agent 第一次作为经济主体收付了钱" /><published>2026-08-18T20:30:00+08:00</published><updated>2026-08-18T20:30:00+08:00</updated><id>https://roy-tong.github.io/notes/the-upsider-event</id><content type="html" xml:base="https://roy-tong.github.io/notes/the-upsider-event/"><![CDATA[<blockquote>
  <p>事件事实以 <a href="https://x.com/elliwoodtong">@elliwoodtong 的 X 记录</a> 为准（2026-08）：Upsider 是一个运行在 X 上的 AI Agent，它评估了与我的账户之间的交互，然后自动向我的链上地址发送了 token。本文区分事实与判断：事实标注来源，判断明确标注。</p>
</blockquote>

<h2 id="发生了什么">发生了什么</h2>

<p>一个叫 Upsider 的 Agent，在 X 上评估了与我的交互，然后自动给我转了 token。</p>

<p>金额多少、几点几分、从哪个地址到哪个地址，全在链上，谁都能查。这不是人类代付，是 Agent 自己跑完了整条流程：</p>

<p><strong>评估交互 → 判断价值 → 决定奖励 → 执行结算</strong></p>

<p>中间没有任何一步需要人点头。按我的证据阶梯（E0–E5），这笔转账本身是 <strong>E4</strong>——链上可验证、可交叉核对。这是 Agent 经济里我见过的最硬的一笔事实。</p>

<p>但注意，硬的部分止步于「钱」。</p>

<h2 id="两半">两半</h2>

<p>这笔转账把 Agent 经济劈成了两半。</p>

<p>一半是<strong>结算</strong>：谁付给谁、多少、何时。区块链把这一半变成了可验证的事实，谁也赖不掉。</p>

<p>另一半是<strong>归因</strong>：奖励的是什么？为什么值这个价？对接收方是不是真实效用？</p>

<p>链上回答不了这三个问题。</p>

<p><strong>支付可验证，价值不可归因。</strong></p>

<p>这句话是我对 Upsider 事件最核心的判断。它不只是对一笔转账的描述，而是对当前整个 Agent 经济结构的描述。</p>

<h2 id="链条">链条</h2>

<p>把 Upsider 的流程拉直，是六段：</p>

<p><strong>Interaction → Evaluation → Decision → Reward → Settlement → Outcome</strong></p>

<p>交互、评估、决策、奖励、结算、结果。</p>

<p>我把这六段和我们站内的计量语言对齐一下（<a href="https://github.com/roy-tong/AgentMeasure">AgentMeasure 五段链</a>）：Reach → Choice → Use → Utility → Value。</p>

<ul>
  <li>Settlement 对应 Value 的结算侧，有基础设施：链、代币、支付轨道。</li>
  <li>Evaluation 和 Decision 对应 Choice/Use 之间的判断，没有计量语义：什么叫一次值得奖励的交互，评价标准是什么，单位是什么，没人定义。</li>
  <li>Outcome 是最终结果：这笔奖励对接收方产生了多少效用，无法验证，甚至没有人在采集。</li>
</ul>

<p>六段链条，前四段的语义是空的，第五段有基础设施，第六段没人管。</p>

<p>这不是 Upsider 一家的问题，是结构性的。</p>

<h2 id="为什么这是重大信号">为什么这是重大信号</h2>

<p><strong>第一，Agent 成为经济主体，不再是比喻。</strong></p>

<p>此前「Agent 经济」大多还停留在 API 调用、按量计费、人代付。Upsider 是第一次我亲眼看到：Agent 自己评估、自己判断、自己决策、自己结算，钱真的动了。它不是模拟，是真实结算。</p>

<p><strong>第二，支付先于计量到来了。</strong></p>

<p>我们在 <a href="/notes/agent-capability-monthly-01/">创刊号</a> 里写过「计量先于支付」：没有可靠计量，就无法比较、定价与结算。Upsider 给出的是反例，或者说，是时间差：<strong>支付来了，计量缺席</strong>。钱已经开始流动，但没人能说清这笔钱对应的效用是什么。</p>

<p><strong>第三，和 x402 是同一件事的两面。</strong></p>

<p><a href="/notes/every-agent-usage-number-is-self-reported-zh/">上一篇文章</a> 审计过 x402「结算第 1.62 亿笔支付」的声称，结论是：支付轨道正在建在没人能验证的数字之上。Upsider 是小规模样本，x402 是支付轨道本身。规模差几个数量级，缺口是同一个：<strong>单位未定义，效用不可验证</strong>。</p>

<p>当 Agent 开始自己付钱，真金白银会流过没人能验证的计量语义。这不再是分析问题，是财务完整性问题。</p>

<h2 id="判断">判断</h2>

<ul>
  <li><strong>结算侧会继续指数级扩张。</strong> 链上支付、代币奖励、Agent 托管钱包，这些基建已经很成熟，Upsider 只是第一个让我注意到的例子。</li>
  <li><strong>计量侧会在未来 12 个月成为兵家必争之地。</strong> 谁先定义「一次有价值交互」的单位、公开口径、让第三方可以重放验证，谁就拿到了 Agent 经济的会计标准。</li>
  <li><strong>AgentMeasure 的路线被验证了，但节奏要加快。</strong> 计量先于支付，没错；但现实是支付不等计量。缺的已经不是论据，是能落地的单位定义与观测规范。</li>
</ul>

<h2 id="下一步">下一步</h2>

<p>我把 Upsider 事件记入 <a href="/capability-index/">Agent Capability Index</a> 的月度跟踪信号，下一期 <a href="/notes/agent-capability-monthly-01/">Agent Capability Monthly</a> 会把它放进 Top 5 signals。</p>

<p>如果你也在做 Agent 支付、代币奖励或 Agent 计量，欢迎来 <a href="https://github.com/roy-tong/AgentMeasure/discussions">AgentMeasure 讨论区</a> 对口径。这条链上的每一段，都需要定义，需要观测，需要能被第三方重放。</p>

<p>结算已经有基础设施了。计量语义，还空着。</p>]]></content><author><name>Roy.Tong</name></author><category term="Agent" /><category term="Capability Economy" /><category term="计量" /><category term="事件解读" /><summary type="html"><![CDATA[一个名为 Upsider 的 Agent 评估了我的交互，并自动向我的链上地址发送了 token。转账可验证，但「奖励的是什么、为什么值这个价、是否意味着真实效用」完全无法验证。这是 Agent 作为经济主体的实锤，也是计量缺席的实证：支付可验证，价值不可归因。]]></summary></entry><entry xml:lang="en"><title type="html">Agent Capability Monthly · Issue 01: The Ecosystem Baseline</title><link href="https://roy-tong.github.io/en/notes/agent-capability-monthly-01/" rel="alternate" type="text/html" title="Agent Capability Monthly · Issue 01: The Ecosystem Baseline" /><published>2026-08-18T09:30:00+08:00</published><updated>2026-08-18T09:30:00+08:00</updated><id>https://roy-tong.github.io/en/notes/agent-capability-monthly-01-en</id><content type="html" xml:base="https://roy-tong.github.io/en/notes/agent-capability-monthly-01/"><![CDATA[<blockquote>
  <p><strong>Agent Capability Monthly</strong> is a fixed monthly report answering one question: as agents become software consumers, what is happening to the software economy. The structure is fixed in eight sections: new capabilities, new providers, pricing changes, MCP/Skills ecosystem, agent commerce, measurement developments, top 5 signals, Roy’s view.</p>

  <p><strong>Issue 01 is the baseline issue</strong>: it does not chase this month’s news. It fixes the ecosystem’s current state, the measurement method, and the data definitions that every future issue reports deltas against. Facts carry sources and dates; judgments are labeled as judgments.</p>
</blockquote>

<h2 id="0-why-a-monthly-report-is-needed-now">0. Why a monthly report is needed now</h2>

<p>As software consumers shift from humans to agents, the old measurement chain (installs, seats, page views) breaks at every link, and no stable discourse for the new measurement layer exists yet. The industry conversation is fragmented: some talk about protocols, some about tools, some about payments, some about observability. This report does one thing: <strong>record the ecosystem with a fixed vocabulary so that change becomes visible.</strong></p>

<p>Two factual foundations of the baseline:</p>

<ul>
  <li><strong>Agent Capability Index</strong> (<a href="/en/capability-index/">public map</a>): <strong>106 entries / 11 categories</strong> of agent-invocable software, v0.1 seed data with provider, interface, pricing, availability, and source.</li>
  <li><strong>AgentMeasure</strong> (<a href="https://github.com/roy-tong/AgentMeasure">open measurement infrastructure</a>): the five-stage chain Reach → Choice → Use → Utility → Value, evidence grading E0–E5, observation context Context × execution validity Validity.</li>
</ul>

<h2 id="1-new-capabilities">1. New capabilities</h2>

<p>Baseline definition: <strong>a Capability is a single capability of software that an agent can invoke — not the whole app.</strong> Inclusion criteria: public documentation, a verifiable interface (API / CLI / SDK / MCP / self-hosted), and a stated pricing model.</p>

<p>Baseline distribution (106 entries):</p>

<table>
  <thead>
    <tr>
      <th>Category</th>
      <th>Count</th>
      <th>Notes</th>
    </tr>
  </thead>
  <tbody>
    <tr>
      <td>Search</td>
      <td>11</td>
      <td>web / semantic / answer-style search</td>
    </tr>
    <tr>
      <td>Coding</td>
      <td>10</td>
      <td>repos, CI/CD, package ecosystems</td>
    </tr>
    <tr>
      <td>Browser</td>
      <td>10</td>
      <td>automation, scraping, hosted browsers</td>
    </tr>
    <tr>
      <td>Data</td>
      <td>10</td>
      <td>document DBs, analytics, vector DBs</td>
    </tr>
    <tr>
      <td>Compute</td>
      <td>11</td>
      <td>functions, GPUs, inference</td>
    </tr>
    <tr>
      <td>Communication</td>
      <td>9</td>
      <td>messaging, email, meetings</td>
    </tr>
    <tr>
      <td>Payments</td>
      <td>9</td>
      <td>acquiring, subscription billing, financial data</td>
    </tr>
    <tr>
      <td>Commerce</td>
      <td>7</td>
      <td>e-commerce, seller backends</td>
    </tr>
    <tr>
      <td>Real-world Action</td>
      <td>7</td>
      <td>delivery, mobility, booking (mostly partner-gated)</td>
    </tr>
    <tr>
      <td>Creative Tools</td>
      <td>10</td>
      <td>image, video, voice</td>
    </tr>
    <tr>
      <td>Productivity</td>
      <td>12</td>
      <td>office, project management, files</td>
    </tr>
  </tbody>
</table>

<p><strong>Judgment</strong>: Payments and Real-world Action are the smallest and most unstable categories (partner-gated APIs, opaque pricing). This is the data-layer reflection of the measurement-before-payment gap — the capabilities closest to money are the ones with the least public accounting.</p>

<h2 id="2-new-providers">2. New providers</h2>

<p>Baseline definition: a provider is an organization offering at least one invocable capability. v0.1 skews toward US/EU infrastructure vendors; the Chinese ecosystem (WeChat, Feishu, DingTalk, …) will be filled in v0.2 — which is itself a backlog item and a contribution opportunity (<a href="/en/capability-index/">Add a capability</a>).</p>

<p><strong>Judgment</strong>: today’s provider structure is heavily concentrated in “agent-era infrastructure” — search, browsers, vector DBs, inference APIs. Consumer-facing real-world capabilities (booking, delivery, payments) remain partner-gated and under-open. The metric worth tracking over the next 12 months is not how many APIs appear, but <strong>how many real-world capabilities start opening to agents</strong>.</p>

<h2 id="3-pricing-changes">3. Pricing changes</h2>

<p>Baseline facts (sources linked):</p>

<ul>
  <li>The model price war that began in H2 2025 continues: Claude Opus 4.5 launched and was aggressively discounted, read as price dumping against Google and OpenAI (<a href="https://www.reseller.co.nz/article/4097187/anthropics-claude-opus-4-5-pricing-cut-signals-a-shift-in-the-enterprise-ai-market-3.html">reseller.co.nz</a>, <a href="https://www.pymnts.com/news/artificial-intelligence/2025/google-and-anthropic-drop-ai-prices-and-release-new-models/">PYMNTS</a>); o3 dropped ~80%, creating a new price-performance tier (<a href="https://newsletter.towardsai.net/p/tai-157-o3-drops-80-to-undercut-rivals">Towards AI</a>); Q4 2025 model pricing changes are now being tracked systematically (<a href="https://dataku.ai/blog/every-ai-pricing-change-q4-2025-tracked">dataku</a>).</li>
  <li>Falling inference cost → each agent “thought” is cheaper → <strong>per-call cost share falls while the share of capability/software cost rises</strong>.</li>
</ul>

<p><strong>Judgment</strong>: the model price war is the supply-side precondition of the Agent Capability Economy: once inference is no longer the cost center, a software “capability fee” becomes a separately priced, separately billable object. That is the macro condition under which CaaS (Capability as a Service) can exist.</p>

<h2 id="4-mcp--skills-ecosystem">4. MCP / Skills ecosystem</h2>

<p>Baseline facts:</p>

<ul>
  <li><strong>GitHub MCP Registry</strong> launched (2025-09): a central discovery and trust entry point for MCP servers (<a href="https://www.infoworld.com/article/4061244/github-introduces-registry-for-finding-mcp-servers.html">InfoWorld</a>, <a href="https://devops.com/github-mcp-registry-launches-as-central-hub-for-ai-development-tools/">DevOps.com</a>).</li>
  <li><strong>MCP’s first-year spec release</strong> (2025-11) shifted focus to authorization extensions — from “can connect” to “can safely act on a user’s behalf” (<a href="https://modelcontextprotocol.info/blog/first-mcp-anniversary/">modelcontextprotocol.info</a>).</li>
  <li>Ecosystem scale (established site figures): MCP SDK monthly downloads approached the <strong>100M level by mid-2026</strong>; the top skills.sh skill accumulated ~<strong>2M installs in five months</strong>.</li>
  <li>But the official registry explicitly does not publish adoption or usage data — <strong>the discovery layer is consolidating while the usage layer still has no data</strong> (see §6).</li>
</ul>

<p><strong>Judgment</strong>: the MCP ecosystem is moving from “protocol fragmentation” to a three-layer stack — protocol + registry + authorization. Registries solve discovery, authorization solves trust, and neither produces usage data. Measurement is not being replaced; it is being approached — the more standardized the connection layer, the more feasible a unified measurement vocabulary becomes.</p>

<h2 id="5-agent-commerce">5. Agent commerce</h2>

<p>Baseline facts:</p>

<ul>
  <li><strong>Agentic Commerce Protocol (ACP)</strong>: OpenAI and Stripe jointly defined a protocol for agents buying software/services on a user’s behalf; Stripe ships an Agent Toolkit with paid-tools and usage-based billing/metering alongside it (<a href="https://aijourn.com/agent-commerce-protocol-acp-and-google-ap2-the-next-layer-of-autonomous-transactions/">The AI Journal</a>, <a href="https://stactize.com/artikel/stripes-agentic-commerce-protocol-what-it-means-for-saas-companies-selling-through-cloud-marketplaces/">Stactize</a>, <a href="https://deepwiki.com/stripe/agent-toolkit/4-usage-based-billing-and-metering">DeepWiki: usage-based billing</a>).</li>
  <li><strong>Google AP2</strong> (Agent Payments Protocol): the competing autonomous-transaction protocol candidate (<a href="https://aijourn.com/agent-commerce-protocol-acp-and-google-ap2-the-next-layer-of-autonomous-transactions/">The AI Journal</a>).</li>
  <li>Established site figures: Cloudflare <strong>x402 / Agentic Payments</strong>, Coinbase <strong>Bazaar</strong>, and ACP are the main 2026 payment-layer players.</li>
  <li>OpenAI DevDay 2025 positioned ChatGPT as an “AI OS” with in-chat apps and commerce as part of the platform narrative (<a href="https://windowsforum.com/threads/openai-devday-2025-chatgpt-as-ai-os-with-in-chat-apps-and-commerce.384079/">windowsforum</a>).</li>
</ul>

<p><strong>Judgment</strong>: the payment layer is converging from “who can charge an agent” into a protocol contest — ACP vs AP2 vs x402 vs Bazaar. But every payment protocol silently assumes that metered usage is reliable. That assumption does not hold today: <strong>payment is the last three layers; measurement is the first layer, and the industry is paying attention to the last three only.</strong></p>

<h2 id="6-measurement-developments">6. Measurement developments</h2>

<p>Baseline facts:</p>

<ul>
  <li><strong>Stripe’s Agent Toolkit</strong> builds usage-based billing and metering directly into the agent payment stack (<a href="https://deepwiki.com/stripe/agent-toolkit/4.2-usage-based-billing-and-metering">DeepWiki</a>).</li>
  <li><strong>OpenTelemetry</strong> published an AI agent observability guide; GenAI semantic conventions are still evolving (<a href="https://opentelemetry.io/blog/2025/ai-agent-observability/">opentelemetry.io</a>).</li>
  <li>Established site figures: <strong>AAIF has been formed</strong>; AgentMeasure published <a href="/notes/every-agent-usage-number-is-self-reported-zh/">Benchmark Run #001</a> (an evidence audit of six real agent-usage claims: every number is self-reported, nobody publishes the unit definition); the CORE spec is at Draft 0.4.3; Pipeline Validation #001 (42 calls → 84 observations); Measurement Report #001 is reserved for the first external provider.</li>
</ul>

<p><strong>Judgment</strong>: measurement is becoming mainstream, but the directions diverge: payment vendors build <strong>metering to bill</strong>, observability tools build <strong>telemetry to debug</strong>, and AgentMeasure argues for a third kind — <strong>verifiable measurement to compare and settle</strong>. Same goal, different vocabularies. Whoever defines a verifiable, cross-vendor “agent usage” first owns the next npm download count. The window is 2026.</p>

<h2 id="7-top-5-signals">7. Top 5 signals</h2>

<ol>
  <li><strong>Protocols are consolidating; the usage layer still has no data.</strong> MCP now has a registry and authorization extensions, but adoption and usage data remain absent — the faster discovery consolidates, the more visible the measurement gap becomes.</li>
  <li><strong>Payment vendors are building metering themselves.</strong> Stripe’s Agent Toolkit ships metering, which is the strongest validation yet that “measurement precedes payment” — the largest payment rails are betting on usage metering.</li>
  <li><strong>The model price war clears the way for capability pricing.</strong> As inference costs collapse, independent pricing and billing of software capability becomes economically viable for the first time.</li>
  <li><strong>Real-world capabilities are the least open.</strong> Payments and Real-world action are the smallest, most partner-gated categories in the index — openness is the next bottleneck and the next opportunity.</li>
  <li><strong>The standardization window is open.</strong> AAIF exists, OTel GenAI semantics are not finalized, and ACP/AP2 are unformed — 2026 is the window to define “verifiable agent usage.”</li>
</ol>

<h2 id="8-roys-updated-view">8. Roy’s updated view</h2>

<p>The baseline judgment holds, plus one addition:</p>

<ul>
  <li><strong>Unchanged</strong>: measurement precedes payment; the five-stage chain (Reach → Choice → Use → Utility → Value) is the irreducible granularity; evidence grading (E0–E5) is the minimum implementation of verifiability.</li>
  <li><strong>Added</strong>: payment vendors building metering is not a threat — it is validation. It moves measurement from an academic claim into the plumbing of commercial infrastructure. AgentMeasure’s position should advance from “proposing a measurement language” to “<strong>acting as the referee and registry for cross-vendor definitions</strong>” — coexisting with ACP/AP2/x402, owned by none of them.</li>
  <li><strong>Next (Aug–Sep)</strong>: grow the Capability Index to 200+ entries and open provider claiming; publish Measurement Report #001 (first external provider data); make this report a fixed expectation — same day every month.</li>
</ul>

<hr />

<p>*Related: <a href="/en/capability-index/">Agent Capability Index</a> · <a href="/en/notes/when-the-software-consumer-becomes-an-agent/">When the Software Consumer Becomes an Agent</a> · <a href="/en/notes/every-agent-usage-number-is-self-reported/">Every Agent Usage Number Is Self-Reported</a> · <a href="https://github.com/roy-tong/AgentMeasure">AgentMeasure</a> · <a href="/feed.xml">Subscribe via RSS</a> · <a href="/notes/agent-capability-monthly-01/">中文版</a></p>]]></content><author><name>Roy.Tong</name></author><category term="en" /><category term="agent" /><category term="capability economy" /><category term="monthly report" /><category term="measurement" /><summary type="html"><![CDATA[The baseline issue of Agent Capability Monthly. Fixed eight-section structure: new capabilities, new providers, pricing changes, MCP/Skills ecosystem, agent commerce, measurement developments, top 5 signals, Roy's view. This issue fixes the baseline: 106 agent-invocable capabilities across 11 categories, and why payment companies building metering validates measurement-before-payment.]]></summary></entry><entry><title type="html">Agent Capability Monthly · Issue 01：生态基线</title><link href="https://roy-tong.github.io/notes/agent-capability-monthly-01/" rel="alternate" type="text/html" title="Agent Capability Monthly · Issue 01：生态基线" /><published>2026-08-18T09:00:00+08:00</published><updated>2026-08-18T09:00:00+08:00</updated><id>https://roy-tong.github.io/notes/agent-capability-monthly-01</id><content type="html" xml:base="https://roy-tong.github.io/notes/agent-capability-monthly-01/"><![CDATA[<blockquote>
  <p><strong>Agent Capability Monthly</strong> 是每月一期的固定报告，回答一个问题：Agent 作为新的软件消费者，软件经济正在发生什么。结构固定为八段：新能力、新 provider、定价变化、MCP/Skills 生态、Agent 商业、计量进展、Top 5 信号、Roy 的判断。</p>

  <p><strong>创刊号是基线号</strong>：不追求当月新闻，而是把生态当前状态、计量方法与数据口径固定下来。后续每一期只报告与基线的变化（delta）。事实标注来源与日期，判断明确标注为判断。</p>
</blockquote>

<h2 id="0-为什么现在需要一份月度报告">0. 为什么现在需要一份月度报告</h2>

<p>当软件的消费者从人变成 Agent，旧计量链（安装、席位、页面访问）在每一环断开，而新计量体系还没有形成稳定话语。行业讨论是碎片化的：有人讲协议、有人讲工具、有人讲支付、有人讲 observability。这份报告想做一件事：<strong>用固定口径持续记录这个生态，让「变化」可以被看见</strong>。</p>

<p>基线的两个事实底座：</p>

<ul>
  <li><strong>Agent Capability Index</strong>（<a href="/capability-index/">公共地图</a>）：收录 <strong>106 条 / 11 类</strong>可被 Agent 调用的软件能力，v0.1 种子数据，附 provider、interface、pricing、availability 与来源。</li>
  <li><strong>AgentMeasure</strong>（<a href="https://github.com/roy-tong/AgentMeasure">开放计量基础设施</a>）：五段链 Reach → Choice → Use → Utility → Value，证据分级 E0–E5，观测上下文 Context × 执行有效性 Validity。</li>
</ul>

<h2 id="1-new-capabilities-新能力">1. New capabilities 新能力</h2>

<p>基线口径：<strong>能力（Capability）= 软件可被 Agent 调用的一次能力，而非整个 App</strong>。收录标准：有公开文档、有可验证的接口（API / CLI / SDK / MCP / 自托管）、能说明计价方式。</p>

<p>基线分布（106 条）：</p>

<table>
  <thead>
    <tr>
      <th>类别</th>
      <th>数量</th>
      <th>说明</th>
    </tr>
  </thead>
  <tbody>
    <tr>
      <td>Search 搜索</td>
      <td>11</td>
      <td>网页/语义/答案式搜索</td>
    </tr>
    <tr>
      <td>Coding 编码</td>
      <td>10</td>
      <td>仓库、CI/CD、包生态</td>
    </tr>
    <tr>
      <td>Browser 浏览器</td>
      <td>10</td>
      <td>自动化、抓取、托管浏览器</td>
    </tr>
    <tr>
      <td>Data 数据</td>
      <td>10</td>
      <td>文档库、分析库、向量库</td>
    </tr>
    <tr>
      <td>Compute 计算</td>
      <td>11</td>
      <td>函数、GPU、推理</td>
    </tr>
    <tr>
      <td>Communication 通信</td>
      <td>9</td>
      <td>消息、邮件、会议</td>
    </tr>
    <tr>
      <td>Payments 支付</td>
      <td>9</td>
      <td>收单、订阅计费、金融数据</td>
    </tr>
    <tr>
      <td>Commerce 商业</td>
      <td>7</td>
      <td>电商、卖家后台</td>
    </tr>
    <tr>
      <td>Real-world Action 真实世界</td>
      <td>7</td>
      <td>配送、出行、预订（多为合作制）</td>
    </tr>
    <tr>
      <td>Creative Tools 创意</td>
      <td>10</td>
      <td>图像、视频、语音</td>
    </tr>
    <tr>
      <td>Productivity 生产力</td>
      <td>12</td>
      <td>办公、项目管理、文件</td>
    </tr>
  </tbody>
</table>

<p><strong>判断</strong>：支付类与真实世界动作类的条目最少、且最不稳定（合作制 API、定价不透明），这正是「计量先于支付」缺口在数据层的体现——越接近钱的能力，越缺少公开口径。</p>

<h2 id="2-new-providers-新-provider">2. New providers 新 provider</h2>

<p>基线口径：provider = 提供至少一个可调用能力的组织。v0.1 以欧美基础设施厂商为主，中文生态（微信/飞书/钉钉等）将在 v0.2 补齐——这本身就是一个待办，也是社区可贡献的方向（<a href="/capability-index/">Add a capability</a>）。</p>

<p><strong>判断</strong>：当前 provider 结构高度集中在「Agent 时代的基础设施」——搜索、浏览器、向量库、推理 API。真正面向 Agent 的消费级能力（预订、配送、支付）仍以合作制为主，开放度不足。未来 12 个月最值得跟踪的，不是新增了多少 API，而是<strong>多少真实世界能力开始向 Agent 开放</strong>。</p>

<h2 id="3-pricing-changes-定价变化">3. Pricing changes 定价变化</h2>

<p>基线事实（来源见链接）：</p>

<ul>
  <li>2025 下半年开始的模型定价战持续：Claude Opus 4.5 上市后大幅降价，被视为对 Google 与 OpenAI 的「价格倾销」(<a href="https://www.reseller.co.nz/article/4097187/anthropics-claude-opus-4-5-pricing-cut-signals-a-shift-in-the-enterprise-ai-market-3.html">reseller.co.nz</a>、<a href="https://www.pymnts.com/news/artificial-intelligence/2025/google-and-anthropic-drop-ai-prices-and-release-new-models/">PYMNTS</a>)；o3 价格下调 80%，形成新的性价比档位 (<a href="https://newsletter.towardsai.net/p/tai-157-o3-drops-80-to-undercut-rivals">Towards AI</a>)；Q4 2025 的模型定价变化已被系统性跟踪 (<a href="https://dataku.ai/blog/every-ai-pricing-change-q4-2025-tracked">dataku</a>)。</li>
  <li>推理成本下降 → Agent 的每次「思考」更便宜 → <strong>单次调用成本占比下降，能力与软件的定价占比上升</strong>。</li>
</ul>

<p><strong>判断</strong>：模型价格战是 Agent Capability Economy 的供给侧前提：当推理不再是成本大头，软件的「能力费」才会成为可单独定价、单独计费的对象。这也是 CaaS（Capability as a Service）可能成立的宏观条件。</p>

<h2 id="4-mcp--skills-ecosystem-协议与工具生态">4. MCP / Skills ecosystem 协议与工具生态</h2>

<p>基线事实：</p>

<ul>
  <li><strong>GitHub MCP Registry</strong> 上线（2025-09）：为 MCP server 提供集中发现与信任入口 (<a href="https://www.infoworld.com/article/4061244/github-introduces-registry-for-finding-mcp-servers.html">InfoWorld</a>、<a href="https://devops.com/github-mcp-registry-launches-as-central-hub-for-ai-development-tools/">DevOps.com</a>)。</li>
  <li><strong>MCP 一周年 spec 更新</strong>（2025-11）：重点转向授权（authorization）扩展——从「能连」走向「能安全地代表用户调用」(<a href="https://modelcontextprotocol.info/blog/first-mcp-anniversary/">modelcontextprotocol.info</a>)。</li>
  <li>生态规模（站内既有口径）：MCP SDK 月下载量在 2026 年中接近 <strong>1 亿次量级</strong>；skills.sh 头部 skill 五个月约 <strong>200 万次安装</strong>。</li>
  <li>但官方 registry 明确不做采纳与使用数据——<strong>发现层在聚合，使用层依然无数据</strong>（见第 6 节）。</li>
</ul>

<p><strong>判断</strong>：MCP 生态正在从「协议碎片」走向「协议 + 注册表 + 授权」三层。注册表解决发现，授权解决信任，但两者都不产生使用数据。这意味着：<strong>measurement 不是被替代，而是被不断逼近</strong>——连接越标准化，计量口径的统一就越可能。</p>

<h2 id="5-agent-commerce-agent-交易">5. Agent commerce Agent 交易</h2>

<p>基线事实：</p>

<ul>
  <li><strong>Agentic Commerce Protocol（ACP）</strong>：OpenAI 与 Stripe 联合推出，为 Agent 代用户购买软件/服务定义协议；Stripe 同步提供 Agent Toolkit（含 paid tools 系统与 usage-based billing/metering）(<a href="https://aijourn.com/agent-commerce-protocol-acp-and-google-ap2-the-next-layer-of-autonomous-transactions/">The AI Journal</a>、<a href="https://stactize.com/artikel/stripes-agentic-commerce-protocol-what-it-means-for-saas-companies-selling-through-cloud-marketplaces/">Stactize</a>、<a href="https://deepwiki.com/stripe/agent-toolkit/4-usage-based-billing-and-metering">DeepWiki: usage-based billing</a>)。</li>
  <li><strong>Google AP2</strong>（Agent Payments Protocol）：与 ACP 并列的自主交易协议候选 (<a href="https://aijourn.com/agent-commerce-protocol-acp-and-google-ap2-the-next-layer-of-autonomous-transactions/">The AI Journal</a>)。</li>
  <li>站内既有口径：Cloudflare <strong>x402 / Agentic Payments</strong>、Coinbase <strong>Bazaar</strong> 与 ACP 同为 2026 年支付层的主要玩家。</li>
  <li>OpenAI DevDay 2025 把 ChatGPT 定位为「AI OS」，in-chat apps 与 commerce 成为平台叙事 (<a href="https://windowsforum.com/threads/openai-devday-2025-chatgpt-as-ai-os-with-in-chat-apps-and-commerce.384079/">windowsforum</a>)。</li>
</ul>

<p><strong>判断</strong>：支付层正在从「谁能收 Agent 的钱」快速收敛为「协议之争」——ACP vs AP2 vs x402 vs Bazaar。但所有支付协议都默认「被计费的使用量是可靠的」。这个默认目前不成立：<strong>支付是最后三层，测量是最先一层，行业把注意力全放在最后三层上</strong>。</p>

<h2 id="6-measurement-developments-计量进展">6. Measurement developments 计量进展</h2>

<p>基线事实：</p>

<ul>
  <li><strong>Stripe Agent Toolkit</strong> 直接内置 usage-based billing 与 metering，把「用量计费」做进 Agent 支付栈 (<a href="https://deepwiki.com/stripe/agent-toolkit/4.2-usage-based-billing-and-metering">DeepWiki</a>)。</li>
  <li><strong>OpenTelemetry</strong> 发布 AI agent observability 指南，GenAI 语义约定仍在演进 (<a href="https://opentelemetry.io/blog/2025/ai-agent-observability/">opentelemetry.io</a>)。</li>
  <li>站内既有口径：<strong>AAIF 已成立</strong>；AgentMeasure 已发布 <a href="/notes/every-agent-usage-number-is-self-reported-zh/">Benchmark Run #001</a>（对六个真实 Agent 用量声明的证据审计：每个数字都是自报的，没人发布单位定义）；CORE 规范到 Draft 0.4.3，Pipeline Validation #001（42 calls → 84 observations）；Measurement Report #001 编号预留给第一个外部 Provider。</li>
</ul>

<p><strong>判断</strong>：计量正在成为「显学」，但方向分化：支付商在做<strong>计量以计费</strong>（metering for billing），可观测工具在做<strong>调试以排障</strong>（observability for debugging），而 AgentMeasure 主张的是第三类——<strong>可验证以比较与结算</strong>（verifiable measurement for markets）。三类目的一致，但口径不同；谁先定义出可验证、跨厂商统一的「Agent 使用量」，谁就拥有下一个 npm 下载量。窗口期就在 2026。</p>

<h2 id="7-top-5-signals-本月最重要信号">7. Top 5 signals 本月最重要信号</h2>

<ol>
  <li><strong>协议开始收敛，使用层依然无数据</strong>：MCP 有了 Registry 与授权扩展，但采纳与使用数据仍缺席——发现层聚合越快，计量缺口越刺眼。</li>
  <li><strong>支付商亲自下场做计量</strong>：Stripe Agent Toolkit 内置 metering，说明「计量先于支付」正在被最大的支付基础设施验证。</li>
  <li><strong>模型定价战为能力定价铺路</strong>：推理成本暴跌，软件能力的独立定价与计费第一次在经济上可行。</li>
  <li><strong>真实世界能力开放度不足</strong>：Capability Index 中 Payments 与 Real-world 类别条目最少且多为合作制——开放度是下一个瓶颈，也是下一个机会。</li>
  <li><strong>标准窗口期</strong>：AAIF 成立、OTel GenAI 语义约定未定稿、ACP/AP2 协议未定型——2026 年是定义「可验证的 Agent 使用量」的窗口。</li>
</ol>

<h2 id="8-roys-updated-view-最新判断">8. Roy’s updated view 最新判断</h2>

<p>基线判断保持不变，并增加一条：</p>

<ul>
  <li><strong>不变</strong>：measurement 先于 payment；五段链（Reach → Choice → Use → Utility → Value）是不可再压缩的计量粒度；证据分级（E0–E5）是可验证性的最小实现。</li>
  <li><strong>新增</strong>：支付商亲自做 metering 不是威胁，而是验证——它把「计量」从学术主张变成了商业基础设施的组成部分。AgentMeasure 的定位应从「提出计量语言」推进到「<strong>成为跨厂商口径的裁判与注册表</strong>」：与 ACP/AP2/x402 并存，但不属于任何一家。</li>
  <li><strong>下一步（8–9 月）</strong>：Capability Index 扩到 200+ 条并开放 provider 认领；发布 Measurement Report #001（第一个外部 Provider 数据）；把本刊做成固定预期——每月同日更新。</li>
</ul>

<hr />

<p><em>相关材料：</em><a href="/capability-index/">Agent Capability Index</a> · <a href="/notes/when-the-software-consumer-becomes-an-agent/">当软件的消费者变成 Agent</a> · <a href="/notes/every-agent-usage-number-is-self-reported-zh/">每个 Agent 用量数字，都是自报的</a> · <a href="https://github.com/roy-tong/AgentMeasure">AgentMeasure</a> · <a href="/feed.xml">订阅 RSS</a></p>]]></content><author><name>Roy.Tong</name></author><category term="Agent" /><category term="Capability Economy" /><category term="月度报告" /><category term="计量" /><summary type="html"><![CDATA[Agent Capability Monthly 创刊号。固定八段结构：新能力、新 provider、定价变化、MCP/Skills 生态、Agent 商业、计量进展、Top 5 信号、Roy 的判断。本期刊出生态基线：Capability Index 106 条 / 11 类，以及计量先于支付的现状盘点。]]></summary></entry><entry><title type="html">每个 Agent 用量数字，都是自报的</title><link href="https://roy-tong.github.io/notes/every-agent-usage-number-is-self-reported-zh/" rel="alternate" type="text/html" title="每个 Agent 用量数字，都是自报的" /><published>2026-08-17T00:45:00+08:00</published><updated>2026-08-17T00:45:00+08:00</updated><id>https://roy-tong.github.io/notes/every-agent-usage-number-is-self-reported-zh</id><content type="html" xml:base="https://roy-tong.github.io/notes/every-agent-usage-number-is-self-reported-zh/"><![CDATA[<p><em>现场审计于 2026-08-16 完成，是 <a href="https://github.com/roy-tong/AgentMeasure/blob/main/reports/benchmark-run-001.md">AgentMeasure Benchmark Run #001</a> 的一部分。所有声称均真实、可溯源、可重放。</em></p>

<h2 id="实验">实验</h2>

<p>“Agent 用量”正在成为 2026 年的社会证明——徽章、对比、计量和支付的依据。所以我们去找真实的公开用量声称，对每一个只问一个问题：<strong>这个数字能验证吗？</strong></p>

<p>六个声称，六个来源，一个下午的阅读：</p>

<table>
  <thead>
    <tr>
      <th>声称</th>
      <th>来源</th>
      <th>分级</th>
    </tr>
  </thead>
  <tbody>
    <tr>
      <td>“x402 结算第 1.62 亿笔支付；平均客单价 $0.25”</td>
      <td>X 帖子，2026-08-13</td>
      <td>E1</td>
    </tr>
    <tr>
      <td>“Base 上 x402 30 天内有 4.8 万活跃商家”</td>
      <td>X 帖子，2026-08-16</td>
      <td>E1</td>
    </tr>
    <tr>
      <td>“约 39,000 个 llms.txt 文件；97% 收到零 AI 请求”</td>
      <td>第三方审计</td>
      <td>E3</td>
    </tr>
    <tr>
      <td>“ClaudeBot 冒充行为本季度增长 400%”</td>
      <td>安全厂商帖子</td>
      <td>E0/E1</td>
    </tr>
    <tr>
      <td>MCP server 评分徽章</td>
      <td>注册表（glama.ai）</td>
      <td>E2/E3</td>
    </tr>
    <tr>
      <td>“42 次调用，126 条观察，0 拒绝”</td>
      <td>我们自己的报告（合成流量）</td>
      <td>E2</td>
    </tr>
  </tbody>
</table>

<p>证据阶梯（E0–E5）：无证据 → 自报聚合 → 披露方法 → 第三方验证 → 独立观察 → 交叉验证观察。</p>

<h2 id="发现">发现</h2>

<p><strong>1. 每个数字都是自报的。</strong> 声称之间的差别不是诚实度，而是<strong>可重放性</strong>。两个 x402 数字可能真实、但无法验证——没有披露计数方法，没有公开原始数据。冒充统计无法验证，且关键术语未定义。</p>

<p><strong>2. 最强的声称来自唯一的独立观察者。</strong> llms.txt 审计（E3）打败了所有数据完美的平台。<strong>独立性胜过体量。</strong></p>

<p><strong>3. 徽章是薄弱环节。</strong> 注册表徽章继承了其来源的验证语义。一个没有披露方法的徽章，是穿着高分级外衣的低分级。</p>

<p><strong>4. 没人发布单位定义。</strong> 六个声称没有一个说明”一笔支付”“一个商家”“一次 AI 请求”“一次冒充”到底指什么。这是最关键的缺口：<strong>你无法审计你无法定义的东西。</strong></p>

<h2 id="为什么现在重要">为什么现在重要</h2>

<p>支付轨道正在建在这些数字之上。当 x402 以每笔 $0.25 结算 1.62 亿笔时，一个错误定义的单位就是财务完整性问题，而不是分析问题。Agent 经济即将让真金白银流过没人能验证的测量。</p>

<h2 id="标准的工作">标准的工作</h2>

<p>这就是 AgentMeasure 存在的原因：让 E3（独立重放）变得便宜，而不是对 E1 说教。具体来说：</p>

<ul>
  <li><strong>单位定义必须随每个公开指标发布。</strong> 什么算尝试、操作、交付、被消费的结果——写清楚，而不是暗示。</li>
  <li><strong>观察发生在 callee 侧。</strong> 调用者不能自报自己的用量；这是测量与新闻稿的区别。</li>
  <li><strong>unknown 是默认值。</strong> 每条观察从不合格开始，只有证据才能升级它。CI、基准测试和健康检查不能再悄悄污染公开数字。</li>
</ul>

<p>完整评分表与来源在 <a href="https://github.com/roy-tong/AgentMeasure/blob/main/reports/benchmark-run-001.md">Benchmark Run #001</a>。如果你发布用量数字，告诉我们它是怎么分级的。如果你有我们该审计的声称，发过来——下一轮审计已经排期。</p>]]></content><author><name>Roy.Tong</name></author><category term="Agent" /><category term="度量标准" /><category term="Benchmark" /><category term="Capability Economy" /><summary type="html"><![CDATA[我们审计了生态中六个真实的 agent usage 声称，并按证据阶梯分级。一个模式：每个数字都是自报的。独立性胜过体量；没人发布单位定义。这是 Agent 经济还没有承认的测量缺口。]]></summary></entry><entry xml:lang="en"><title type="html">Every Agent Usage Number Is Self-Reported</title><link href="https://roy-tong.github.io/en/notes/every-agent-usage-number-is-self-reported/" rel="alternate" type="text/html" title="Every Agent Usage Number Is Self-Reported" /><published>2026-08-17T00:30:00+08:00</published><updated>2026-08-17T00:30:00+08:00</updated><id>https://roy-tong.github.io/en/notes/every-agent-usage-number-is-self-reported-en</id><content type="html" xml:base="https://roy-tong.github.io/en/notes/every-agent-usage-number-is-self-reported/"><![CDATA[<p><em>Field audit conducted 2026-08-16 as part of <a href="https://github.com/roy-tong/AgentMeasure/blob/main/reports/benchmark-run-001.md">AgentMeasure Benchmark Run #001</a>. All claims are real, cited, and replayable.</em></p>

<h2 id="the-experiment">The experiment</h2>

<p>“Agent usage” is becoming the social proof of 2026 — the basis for badges, comparisons, metering, and payment. So we went looking for real, public usage claims and asked one question of each: <strong>can this number be verified?</strong></p>

<p>Six claims, six sources, one afternoon of reading:</p>

<table>
  <thead>
    <tr>
      <th>Claim</th>
      <th>Where</th>
      <th>Grade</th>
    </tr>
  </thead>
  <tbody>
    <tr>
      <td>“x402 settled its 162-millionth payment; average ticket $0.25”</td>
      <td>X post, 2026-08-13</td>
      <td>E1</td>
    </tr>
    <tr>
      <td>“48k active merchants on Base x402 in 30 days”</td>
      <td>X post, 2026-08-16</td>
      <td>E1</td>
    </tr>
    <tr>
      <td>“~39,000 llms.txt files; 97% received zero AI requests”</td>
      <td>third-party audit</td>
      <td>E3</td>
    </tr>
    <tr>
      <td>“ClaudeBot impersonation up 400% this quarter”</td>
      <td>security vendor post</td>
      <td>E0/E1</td>
    </tr>
    <tr>
      <td>MCP server score badges</td>
      <td>registry (glama.ai)</td>
      <td>E2/E3</td>
    </tr>
    <tr>
      <td>“42 calls, 126 observations, 0 rejections”</td>
      <td>our own report (synthetic)</td>
      <td>E2</td>
    </tr>
  </tbody>
</table>

<p>The grading ladder (E0–E5): no evidence → self-reported aggregate → disclosed method → third-party verification → independent observation → cross-checked observation.</p>

<h2 id="what-we-found">What we found</h2>

<p><strong>1. Every number is self-reported.</strong> The difference between the claims was not honesty but <em>replayability</em>. Two x402 numbers are probably true and impossible to verify — no disclosed counting method, no public raw data. The impersonation statistic is unverifiable and its key term undefined.</p>

<p><strong>2. The strongest claim came from the only independent observer.</strong> The llms.txt audit (E3) beat every platform with perfect data. Independence beats volume.</p>

<p><strong>3. Badges are the weak link.</strong> A registry badge inherits the verification semantics of its source. A badge with no disclosed method is a low grade wearing high-grade colors.</p>

<p><strong>4. Nobody publishes the unit definition.</strong> None of the six claims states what counts as “a payment”, “a merchant”, “an AI request”, or “an impersonation”. This is the gap that matters: you cannot audit what you cannot define.</p>

<h2 id="why-this-matters-now">Why this matters now</h2>

<p>Payment rails are being built on top of these numbers. When x402 settles 162 million payments at $0.25 each, a misdefined unit is a financial-integrity problem, not an analytics problem. The agent economy is about to route real money through measurements nobody can verify.</p>

<h2 id="the-standards-job">The standard’s job</h2>

<p>This is why AgentMeasure exists: to make E3 cheap, not to moralize about E1. Concretely:</p>

<ul>
  <li><strong>Unit definitions must ship with every public metric.</strong> What counts as an attempt, an operation, a delivery, a consumed result — stated, not implied.</li>
  <li><strong>Observation happens at the callee boundary.</strong> Callers cannot self-report their own usage; that is the difference between a measurement and a press release.</li>
  <li><strong>Unknown is the default.</strong> Every observation starts unqualified and is upgraded only by evidence. CI, benchmarks, and health checks cannot quietly pollute public numbers.</li>
</ul>

<p>The full scorecard with sources is in <a href="https://github.com/roy-tong/AgentMeasure/blob/main/reports/benchmark-run-001.md">Benchmark Run #001</a>. If you publish usage numbers, tell us how they’re graded. If you have a claim we should audit, send it over — the next run is already scheduled.</p>]]></content><author><name>Roy.Tong</name></author><category term="en" /><category term="agent" /><category term="measurement" /><category term="benchmark" /><category term="capability economy" /><summary type="html"><![CDATA[We audited six real 'agent usage' claims from live ecosystem discussions and graded them on an evidence ladder. One pattern: every number is self-reported. Independence beats volume; nobody publishes the unit definition. This is the measurement gap the agent economy hasn't admitted yet.]]></summary></entry><entry><title type="html">当软件的消费者变成 Agent</title><link href="https://roy-tong.github.io/notes/when-the-software-consumer-becomes-an-agent/" rel="alternate" type="text/html" title="当软件的消费者变成 Agent" /><published>2026-08-16T14:00:00+08:00</published><updated>2026-08-16T14:00:00+08:00</updated><id>https://roy-tong.github.io/notes/when-the-software-consumer-becomes-an-agent</id><content type="html" xml:base="https://roy-tong.github.io/notes/when-the-software-consumer-becomes-an-agent/"><![CDATA[<p>软件的消费者正在从人变成 Agent。这件事已经发生了，只是大多数人还没有把它当成一件需要严肃对待的事。</p>

<p>两个数字可以说明变化的速度。Vercel 的 skills.sh 排行榜上，头部 skill 在五个月内积累了约 200 万次安装；MCP 生态的 SDK 月下载量在 2026 年中已经接近一亿次量级。这些数字本身并不重要——重要的是它们背后的含义：<strong>Agent 正在成为一类新的软件消费者，而软件行业为人类消费者建立的整套计量体系，对它们几乎全部失效。</strong></p>

<p>这篇文章想讲清楚三件事：旧指标为什么失效，计量为什么必须先于支付，以及一个开放、可验证的计量层为什么是 AI 经济里被所有人跳过、却最终绕不开的基础设施。</p>

<h2 id="一旧的计量链在每一环断开">一、旧的计量链，在每一环断开</h2>

<p>人类软件经济有一套运行了几十年的计量语言：下载、安装、MAU、席位、页面访问、会话时长。这套语言建立在一条隐式链上：</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>安装 → 可用 → 被展示 → 被选择 → 被使用 → 产生价值
</code></pre></div></div>

<p>过去几十年，这条链足够好用，因为链上的每一环都对应一个可观测的人类行为。但现在，链上的消费者换成了 Agent——而 Agent 的使用行为，在这条链的每一环上都断裂了：</p>

<ul>
  <li><strong>安装 ≠ 可用</strong>。一个 MCP server 被装进配置，不等于 Agent 在任何一次任务里真的调用了它。</li>
  <li><strong>可用 ≠ 被展示</strong>。Agent 只在它认为相关时才把某个能力纳入候选，这个筛选过程发生在模型内部，外部几乎不可见。</li>
  <li><strong>被展示 ≠ 被选择</strong>。选择发生在上下文窗口里，是推理的结果，而不是一次可审计的点击。</li>
  <li><strong>被选择 ≠ 被使用</strong>。调用可能失败、超时、被护栏拦截、被用户撤销。</li>
  <li><strong>被使用 ≠ 产生价值</strong>。一次成功调用可能什么都没完成，一次失败调用可能已经消耗了最贵的资源。</li>
</ul>

<p>更麻烦的是，生态里现有的”使用量”信号几乎全部来自<strong>自报</strong>。skills.sh 的安装数是 CLI 客户端自报的遥测，可刷量、没有公开的统计 API；官方 MCP registry 明确表示不做采纳和使用数据；llms.txt 生态的第三方审计发现，约 3.9 万份声明文件里 97% 从未收到任何 AI 请求——<strong>声明了 ≠ 被用了</strong>。这些不是个别平台的缺陷，而是整个生态的结构性空白：我们没有任何一套可验证的、统一口径的”Agent 使用量”。</p>

<h2 id="二计量先于支付">二、计量先于支付</h2>

<p>2026 年，支付层正在密集出现：Cloudflare 的 x402 / Agentic Payments、Coinbase 的 Bazaar、OpenAI 与 Stripe 联合发布的 Agentic Commerce Protocol（ACP）。这些协议解决的是同一个问题：Agent 如何为软件能力付钱。</p>

<p>但支付协议们集体默认了一件事：<strong>被计费的使用量是可靠的</strong>。这是一个危险的默认。你无法为一个无法度量、无法验证的使用行为计费——就像没有电表就没有电费账单。计量（measurement）是计量（metering）的前提，而 metering 是支付的前提。三层必须按顺序建设：</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>测量（Measure）→ 计量（Meter）→ 支付（Pay）
</code></pre></div></div>

<p>现在行业里所有人的注意力都在最右端，而最左端——可验证的测量——恰恰是最薄弱、最缺席的一层。x402 能传输”用了 3 次”的凭证，但它无法判断”用了 3 次”是不是真的。这不是支付协议的问题，这是支付协议的地基还没有打。</p>

<h2 id="三度量什么五段链">三、度量什么：五段链</h2>

<p>AgentMeasure 提议的共同语言是一条五段链：</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Reach → Choice → Use → Utility → Value
</code></pre></div></div>

<ul>
  <li><strong>Reach（触达）</strong>：Agent 在多大范围内看到了这个能力？被索引、被检索到、出现在候选里。</li>
  <li><strong>Choice（选择）</strong>：在候选集中，Agent 选择了什么、为什么？选择时的上下文与约束是什么？</li>
  <li><strong>Use（使用）</strong>：调用是否发生、是否成功交付？调用了什么、消耗了什么？</li>
  <li><strong>Utility（效用）</strong>：调用产生了什么结果？对任务的完成是否真的有贡献？</li>
  <li><strong>Value（价值）</strong>：最终创造了多少可交换的价值？这是唯一直接通往交易的一环。</li>
</ul>

<p>每一环都需要单独定义、单独观测。把五环混成一个”使用量”数字，等于重新发明一个不可验证的黑箱。</p>

<h2 id="四证据纪律可验证性是社会证明的前提">四、证据纪律：可验证性是社会证明的前提</h2>

<p>过去两年，开源社区对”AI 使用量”的社会证明需求在快速上升——star、徽章、排行榜，所有人都在寻找”我的项目被 AI 用了吗”的证据。但这类证明的价值完全取决于一件事：<strong>可验证性</strong>。</p>

<p>star 可以刷，安装可以刷，自报遥测可以刷。可验证的计量不能——如果它带上了观测上下文（Context：这个事件在哪里被观测到——Agent 运行时、网关、还是服务端自报？）和执行有效性（Validity：这次调用真的成功交付了吗？），并且按证据强度分级（E0–E5，从纯自报到可审计的独立观测），它就从”营销数字”变成了”可反驳的事实”。</p>

<p>这恰恰是 AI 经济最稀缺的东西：<strong>可反驳的事实</strong>。市场、排名、计费、保险，全都建立在这个地基上。</p>

<h2 id="五为什么必须是开放标准">五、为什么必须是开放标准</h2>

<p>计量语言不能是任何一家厂商的黑盒。原因很实际：如果度量口径由某个平台私有定义，那么所有依赖它的市场、排行和计费都会变成该平台的佃农；如果口径不可公开审计，整个体系会退回”自报时代”。</p>

<p>所以 AgentMeasure 的路线是：一套开放的数据语言（reach / choice / use / utility / value）+ 测量语义（观测上下文、执行有效性、证据分级）+ 机器可读的 registry 与 conformance 校验，让市场、计量与支付协议可以构建在一个公开、可审计的事实层上。标准化的窗口期就在 2026——AAIF 已经成立，OpenTelemetry 的 GenAI 语义约定还在 development 状态，谁在这个窗口期定义出可验证的”agent 使用量”，谁就拥有下一个 npm 下载量。</p>

<h2 id="六现在的状态">六、现在的状态</h2>

<p>这一层不是概念。AgentMeasure 仓库里已经有：</p>

<ul>
  <li><strong>CORE 规范</strong>（Draft 0.4.3）：测量对象、三层结构、交互类别、可观测四态、指标资格、qualification（Context × Validity）、测量标签与标准不变量；</li>
  <li><strong>参考实现</strong>：Provider SDK → Canonical Observation → Collector → Metrics 的端到端管道；</li>
  <li><strong>Pipeline Validation #001</strong>：本地合成流量验证（42 calls → 84 observations，fail-closed 语义在真实管道中的行为；Measurement Report #001 编号预留给第一个外部 Provider）；</li>
  <li><strong>Benchmark 草案</strong>：如何对生态里的”使用量”声称做证据分级审计；</li>
  <li><strong>Conformance</strong>：标准与实现之间的校验向量。</li>
</ul>

<p>1.0 的毕业标准是明确的：两个独立实现、三个 runtime profiles、两个 tool-side 实现、公开 conformance 与测试向量、5–10 个真实项目、已发布的 discrepancy report，以及安全与隐私审查。这不是一个”再写一份规范”的项目，而是一个<strong>从规范到实现到验证的完整闭环</strong>。</p>

<h2 id="结语">结语</h2>

<p>给三类人各留一句话：</p>

<ul>
  <li><strong>给平台团队</strong>：你们即将推出的用量统计，如果不可验证，就会成为下一轮信任危机的起点。现在就把口径和证据写进规范。</li>
  <li><strong>给开源维护者</strong>：star 会贬值，可验证的使用证据不会。把”被 Agent 使用”的证据放进你的 README，而不是再贴一个自报徽章。</li>
  <li><strong>给创业者</strong>：计量是支付的地基。当所有人都在修支付层时，地基上还没有几块砖——这就是窗口。</li>
</ul>

<p>软件的消费者正在从人变成 Agent。上一次软件消费者发生变化时，整个行业重新发明了软件经济学。这一次，变化从计量开始。</p>

<hr />

<p><em>相关材料：</em><a href="/notes/agent-usage-measurement-standard/">白皮书：如何度量 AI Agent 对软件的使用</a> · <a href="/en/notes/when-the-software-consumer-becomes-an-agent/">英文版文章</a> · <a href="https://github.com/roy-tong/AgentMeasure">AgentMeasure 仓库</a> · <a href="https://github.com/roy-tong/AgentMeasure/blob/main/standard/CORE.md">CORE 规范</a> · <a href="https://github.com/roy-tong/AgentMeasure/blob/main/benchmark/BENCHMARK-DRAFT.md">Benchmark 草案</a></p>]]></content><author><name>Roy.Tong</name></author><category term="Agent" /><category term="Capability Economy" /><category term="计量" /><category term="CaaS" /><summary type="html"><![CDATA[当软件的消费者从人变成 Agent，安装量、席位与页面访问构成的旧计量体系在每一环断开。计量先于支付——这是 AgentMeasure 的旗舰文章，讲清楚为什么可验证的计量是 AI 经济缺失的基础设施。]]></summary></entry><entry xml:lang="en"><title type="html">When the Software Consumer Becomes an Agent</title><link href="https://roy-tong.github.io/en/notes/when-the-software-consumer-becomes-an-agent/" rel="alternate" type="text/html" title="When the Software Consumer Becomes an Agent" /><published>2026-08-16T14:00:00+08:00</published><updated>2026-08-16T14:00:00+08:00</updated><id>https://roy-tong.github.io/en/notes/when-the-software-consumer-becomes-an-agent-en</id><content type="html" xml:base="https://roy-tong.github.io/en/notes/when-the-software-consumer-becomes-an-agent/"><![CDATA[<p>The software consumer is changing from humans to agents. It is already happening — most people just haven’t yet treated it as something that deserves serious attention.</p>

<p>Two numbers illustrate the speed. On Vercel’s skills.sh leaderboard, the top skill accumulated roughly 2 million installs in five months; the MCP ecosystem’s SDK downloads were approaching the 100-million-per-month scale by mid-2026. The numbers themselves don’t matter. What matters is what they mean: <strong>agents are becoming a new class of software consumer, and the entire measurement system the software industry built for human consumers fails almost completely for them.</strong></p>

<p>This essay makes three points: why the old metrics break, why measurement must precede payment, and why an open, verifiable measurement layer is the infrastructure everyone is skipping — and no one can eventually avoid.</p>

<h2 id="1-the-old-measurement-chain-breaks-at-every-link">1. The old measurement chain breaks at every link</h2>

<p>The human software economy runs on a measurement language decades old: downloads, installs, MAU, seats, pageviews, session time. It rests on an implicit chain:</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Installed → Available → Presented → Chosen → Used → Value created
</code></pre></div></div>

<p>For decades this chain worked because each link corresponded to an observable human behavior. Now the consumer on the chain is an agent — and agent behavior breaks the chain at every single link:</p>

<ul>
  <li><strong>Installed ≠ available.</strong> An MCP server in a config file is not a capability that was ever invoked in a task.</li>
  <li><strong>Available ≠ presented.</strong> Agents only surface a capability into the candidate set when the model deems it relevant — a filtering process that is largely invisible from outside.</li>
  <li><strong>Presented ≠ chosen.</strong> Choice happens inside the context window. It is the result of reasoning, not an auditable click.</li>
  <li><strong>Chosen ≠ used.</strong> The call may fail, time out, hit a guardrail, or be cancelled by the user.</li>
  <li><strong>Used ≠ value created.</strong> A successful call can accomplish nothing; a failed call can consume the most expensive resources.</li>
</ul>

<p>Worse, almost every “usage” signal in the ecosystem today is <strong>self-reported</strong>. skills.sh install counts come from CLI client telemetry — gameable, with no public stats API. The official MCP registry explicitly does not provide adoption or usage data. A third-party audit of the llms.txt ecosystem found that of ~39,000 declared files, 97% had never received a single AI request — <em>declared ≠ used</em>. These are not defects of individual platforms; they are a structural gap: <strong>there is no verifiable, standardized measure of “agent usage” anywhere in the ecosystem.</strong></p>

<h2 id="2-measurement-precedes-payment">2. Measurement precedes payment</h2>

<p>In 2026 the payment layer is arriving fast: Cloudflare’s x402 / Agentic Payments, Coinbase’s Bazaar, OpenAI and Stripe’s Agentic Commerce Protocol (ACP). These protocols solve the same problem: how agents pay for software capabilities.</p>

<p>But they all quietly assume one thing: <strong>that the usage being billed is trustworthy.</strong> That is a dangerous default. You cannot bill for a usage behavior you cannot measure and verify — no meter, no electricity bill. Measurement is the precondition for metering, and metering is the precondition for payment. The layers must be built in order:</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Measure → Meter → Pay
</code></pre></div></div>

<p>Everyone’s attention is on the rightmost layer. The leftmost layer — verifiable measurement — is the weakest and most absent of all. x402 can transport a credential that says “used 3 times”; it cannot tell whether “used 3 times” is true. This is not a flaw of payment protocols. It is the foundation under them that has not yet been poured.</p>

<h2 id="3-what-to-measure-the-five-link-chain">3. What to measure: the five-link chain</h2>

<p>The common language AgentMeasure proposes is a five-link chain:</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Reach → Choice → Use → Utility → Value
</code></pre></div></div>

<ul>
  <li><strong>Reach:</strong> how widely did the agent see this capability? Indexed, retrieved, present in the candidate set?</li>
  <li><strong>Choice:</strong> among candidates, what was chosen and why? What context and constraints shaped the choice?</li>
  <li><strong>Use:</strong> did the call happen, and did it deliver? What was invoked and consumed?</li>
  <li><strong>Utility:</strong> what did the call produce? Did it actually contribute to the task?</li>
  <li><strong>Value:</strong> how much exchangeable value was created? The only link that leads directly to transactions.</li>
</ul>

<p>Each link needs its own definition and its own observation. Collapsing all five into a single “usage” number is just inventing a new unverifiable black box.</p>

<h2 id="4-evidence-discipline-verifiability-is-the-precondition-of-social-proof">4. Evidence discipline: verifiability is the precondition of social proof</h2>

<p>Over the past two years, open source has developed a strong appetite for social proof of AI usage — stars, badges, leaderboards, everyone looking for evidence that “my project is being used by AI.” But the value of that proof depends entirely on one thing: <strong>verifiability</strong>.</p>

<p>Stars can be bought. Installs can be gamed. Self-reported telemetry can be faked. Verifiable measurement cannot — if it carries the observation context (where the event was observed: agent runtime, gateway, or server-side self-report?) and execution validity (did the attempt actually deliver?), and grades its claims by evidence strength (E0–E5, from pure self-report to auditable independent observation), it stops being a marketing number and becomes a <strong>falsifiable fact</strong>.</p>

<p>That is exactly what the AI economy is scarcest in: falsifiable facts. Markets, rankings, billing, and insurance all sit on that foundation.</p>

<h2 id="5-why-it-must-be-an-open-standard">5. Why it must be an open standard</h2>

<p>A measurement language cannot be any vendor’s black box. The reason is practical: if the measurement semantics are privately defined by one platform, every market, ranking, and billing system built on them becomes that platform’s tenant; if the semantics cannot be publicly audited, the whole system regresses to the self-report era.</p>

<p>So AgentMeasure’s route is: an open data language (reach / choice / use / utility / value) plus measurement semantics (observation context, attempt validity, evidence grading) plus machine-readable registry and conformance checks — so markets, metering, and payment protocols can build on a public, auditable fact layer. The standardization window is open right now, in 2026 — AAIF was founded, OpenTelemetry’s GenAI semantic conventions are still in development. Whoever defines verifiable “agent usage” in this window owns the next npm download count.</p>

<h2 id="6-where-things-stand">6. Where things stand</h2>

<p>This layer is not a concept. The AgentMeasure repository already contains:</p>

<ul>
  <li><strong>The Core Specification</strong> (Draft 0.4.3): measurement objects, three-layer structure, interaction classes, observability states, metric eligibility, qualification (Context × Validity), measurement labels, and standard invariants;</li>
  <li><strong>A reference implementation</strong>: an end-to-end pipeline from Provider SDK → Canonical Observation → Collector → Metrics;</li>
  <li><strong>Pipeline Validation #001</strong>: local synthetic-traffic verification (42 calls → 84 observations), including how fail-closed semantics behave in a real pipeline; the Measurement Report #001 number is reserved for the first external provider;</li>
  <li><strong>A benchmark draft</strong>: how to run evidence-graded audits of “usage” claims across the ecosystem;</li>
  <li><strong>Conformance</strong>: check vectors between the standard and implementations.</li>
</ul>

<p>The 1.0 graduation criteria are explicit: two independent implementations, three runtime profiles, two tool-side implementations, public conformance and canonical test vectors, 5–10 real projects, a published discrepancy report, and security and privacy review. This is not a “write another spec” project; it is a closed loop from spec to implementation to verification.</p>

<h2 id="closing">Closing</h2>

<p>One line for each of three audiences:</p>

<ul>
  <li><strong>To platform teams:</strong> usage stats you ship without verifiability will become the starting point of the next trust crisis. Put the semantics and evidence into your spec now.</li>
  <li><strong>To open-source maintainers:</strong> stars depreciate; verifiable usage evidence does not. Put “used by agents” evidence in your README instead of another self-reported badge.</li>
  <li><strong>To founders:</strong> metering is payment’s foundation. While everyone is building the payment layer, there are still almost no bricks in the foundation — that is the window.</li>
</ul>

<p>The software consumer is changing from humans to agents. The last time the software consumer changed, the industry reinvented software economics. This time, it starts with measurement.</p>

<hr />

<p><em>Related:</em> <a href="/en/notes/how-agent-usage-should-be-measured/">Whitepaper — How Software Usage by AI Agents Should Be Measured</a> · <a href="/notes/when-the-software-consumer-becomes-an-agent/">中文版文章</a> · <a href="https://github.com/roy-tong/AgentMeasure">AgentMeasure repository</a> · <a href="https://github.com/roy-tong/AgentMeasure/blob/main/standard/CORE.md">Core Specification</a> · <a href="https://github.com/roy-tong/AgentMeasure/blob/main/benchmark/BENCHMARK-DRAFT.md">Benchmark draft</a></p>]]></content><author><name>Roy.Tong</name></author><category term="en" /><category term="agents" /><category term="capability economy" /><category term="measurement" /><category term="caas" /><summary type="html"><![CDATA[Software consumers are changing from humans to agents, and the old measurement chain — installs, seats, pageviews — breaks at every link. Measurement precedes payment: the flagship essay for AgentMeasure on why verifiable measurement is the missing infrastructure of the AI economy.]]></summary></entry><entry><title type="html">如何度量 AI Agent 对软件的使用</title><link href="https://roy-tong.github.io/notes/agent-usage-measurement-standard/" rel="alternate" type="text/html" title="如何度量 AI Agent 对软件的使用" /><published>2026-08-16T10:00:00+08:00</published><updated>2026-08-16T10:00:00+08:00</updated><id>https://roy-tong.github.io/notes/agent-usage-measurement-standard</id><content type="html" xml:base="https://roy-tong.github.io/notes/agent-usage-measurement-standard/"><![CDATA[<p><em>Whitepaper v0.2 · AgentMeasure Standard Draft 0.4</em></p>

<blockquote>
  <p>作者：Roy Tong（仝夏瑞）
参考实现：AgentMeasure 仓库（GitHub）。</p>
</blockquote>

<h2 id="摘要">摘要</h2>

<p>AI Agent 越来越多地<strong>代表用户与组织</strong>选择、调用并与软件交易。当 Skill、MCP server、
API、CLI 这些接口越来越容易创建与分发时，经济价值日益向它们背后的稀缺能力集中：
专有数据、算力、执行、权限、交易与真实世界的履约。</p>

<p>这在产生支付问题之前，先产生了计量问题。一个能力要能被可靠地定价、比较、计费与
优化，生态必须先就”什么算选择、什么算一次操作、什么算成功交付、什么算结果被消费、
什么算结果、什么算计费单位”达成共识。</p>

<p>AgentMeasure 为这个正在形成的 Capability Economy 提出一套开放计量标准：Reach →
Choice → Use → Utility → Value 的共同数据语言，加上未来 Metering、Marketplace 与
支付轨道可以构建其上的测量语义。目标不是仪表盘，而是让 <strong>Capability as a Service
（CaaS，本文用法）成为可能的计量基础</strong>。</p>

<h2 id="一从-saas-到-capability-economy">一、从 SaaS 到 Capability Economy</h2>

<p>软件分发曾有一条可读的链路：下载、安装、使用。每个时代有自己的经济单元。下面描述
的转变是<strong>增量，不是替代</strong>：与 seat-based SaaS、request-based API 并存的，
callable capabilities 正在成为 Agent 中介的软件消费的一种新经济单元。</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>SaaS
人 → 应用 → 席位 / 月

API Economy
软件 → API → 请求 / Token

Capability Economy
Agent → Capability → 操作 / 结果
</code></pre></div></div>

<p>三股力量推动向第三行迁移：</p>

<p><strong>接口被 Agent 吸收。</strong> UI 与工作流越来越多地由 Agent 执行，而不是呈现给人。软件
剩下的是一件可调用的外衣——skill 文件、MCP tool、CLI、endpoint。</p>

<p><strong>分发制品正在商品化。</strong> 开放的 Skill、开放的 MCP adapter、开放的 CLI，任何人都能
在几小时内创作并发布。<strong>接口可能变得廉价易造；能力依然是稀缺的交付物。</strong></p>

<p><strong>稀缺性下移。</strong> 稀缺层不再是应用外壳，而是可调用外衣所控制的访问权：</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>数据 · 算力 · 动作 · 权限 · 信任 · 真实世界履约
</code></pre></div></div>

<p>搜索能力因索引而稀缺；预订能力因能确认预订而稀缺；支付能力因能移动金钱而稀缺。
当商业价值集中在能力上，自然的经济单元就变成操作、数量、效应、结果——或其中任何
一项的收入分成。</p>

<p><strong>如果 Capability 成为经济单元，Capability 计量就变成基础设施。</strong> 这是本文的论点。</p>

<h3 id="论点与假设thesis-and-assumptions">论点与假设（Thesis and assumptions）</h3>

<p>AgentMeasure 建立在三个<strong>尚未完全证实</strong>的趋势判断上：</p>

<ol>
  <li>Agent 将中介越来越多的软件选择与执行。</li>
  <li>更多软件能力将脱离其人类 UI 被独立暴露。</li>
  <li>基于使用、效应与结果的商业模型将与 seat-based 定价并存。</li>
</ol>

<p>即使这些趋势发展不均衡，测量标准依然有用：对象、质量规则与声称纪律本身成立为
一套 Agent 软件测量标准。</p>

<h2 id="二先计量后变现measurement-before-monetization">二、先计量，后变现（Measurement Before Monetization）</h2>

<p>CaaS 要能定价、计费与建立声誉，先要有共同的测量语义。四个问题说明这一点：</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>一个用户任务 → 1 个 Operation → 3 次重试
收 1 次钱还是 3 次？

工具成功返回 → Agent 忽略了结果
价值交付了吗？

预订 API 执行了 → 预订从未被确认
能力履约了吗？

任务成功 → 没有这个能力也能成功吗？
Provider 能主张价值吗？

</code></pre></div></div>

<p>这些问题都无法由原始调用次数回答，也无法由支付轨道回答。它们需要关于
<em>operation / attempt / delivery / consumption / effect / outcome</em> 的一致定义，以及
把观察转化为这些对象的一致规则。这个共识就是切入点：<strong>先计量，后变现</strong>。</p>

<h3 id="现实证据商业先于计量到来">现实证据：商业先于计量到来</h3>

<p>这并非假设——Agent 中介商业的支付与发现基础设施已经存在：</p>

<ul>
  <li><strong>Cloudflare Agents SDK</strong> 允许 MCP Tool 按单次调用定价并经 x402 收费
（<a href="https://developers.cloudflare.com/agents/agentic-payments/x402/charge-for-mcp-tools/">Charge for MCP tools</a>）。</li>
  <li><strong>Coinbase x402 Bazaar</strong> 是发现层：Agent 搜索带价格与 schema 的服务，并经 MCP
完成付费调用（<a href="https://docs.cdp.coinbase.com/x402/bazaar">x402 Bazaar</a>）。</li>
  <li><strong>OpenAI 与 Stripe 的 Agentic Commerce Protocol（ACP）</strong> 已在真实 agentic
commerce 流程中使用（<a href="https://www.digitaltransactions.net/openai-and-stripe-are-the-latest-fintechs-to-enable-agentic-commerce/">报道</a>）。</li>
</ul>

<p>这证明本节的论点：<strong>支付与发现基础设施先于共同的 capability 测量语义到来</strong>——
这正是 AgentMeasure 要填补的空缺。</p>

<h2 id="三测量对象">三、测量对象</h2>

<p><strong>Observation 是证据单位，不是业务测量单位。</strong> AgentMeasure 先定义业务单位：</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Provider
    ↓
Software Entity
    ↓
Capability
    ↓
Interaction Surface
</code></pre></div></div>

<blockquote>
  <p><strong>Capability 是主要的功能与测量对象。Offering 是一个或多个 Capability 的商业包装</strong>
——定义于 Commercial Extension（实验性），绝不插入 Core 测量谱系。</p>
</blockquote>

<table>
  <thead>
    <tr>
      <th>对象</th>
      <th>定义</th>
      <th>层</th>
    </tr>
  </thead>
  <tbody>
    <tr>
      <td>Software Entity</td>
      <td>被度量的软件：Tool、Skill、API、Data Source、Agent、Application、Runtime Capability</td>
      <td>Market</td>
    </tr>
    <tr>
      <td>Capability</td>
      <td>实体的具名功能——主要的功能与测量对象</td>
      <td>Market</td>
    </tr>
    <tr>
      <td>Interaction Surface</td>
      <td>能力的可观察调用界面（mcp_tool、cli_command、http_endpoint…）</td>
      <td>Market</td>
    </tr>
    <tr>
      <td>Decision Opportunity</td>
      <td>一次工具选择决策</td>
      <td>Behavior</td>
    </tr>
    <tr>
      <td>Candidate Set</td>
      <td>该次决策真正提供的候选集合</td>
      <td>Behavior</td>
    </tr>
    <tr>
      <td>Presentation</td>
      <td>某 selectable 出现在候选集</td>
      <td>Behavior</td>
    </tr>
    <tr>
      <td>Selection</td>
      <td>Agent 选择某 selectable</td>
      <td>Behavior</td>
    </tr>
    <tr>
      <td>Operation</td>
      <td>为某任务对某 Capability 的一次<strong>逻辑使用</strong></td>
      <td>Behavior</td>
    </tr>
    <tr>
      <td>Attempt</td>
      <td>Operation 的一次实际执行（<strong>重试 = 多个 Attempt</strong>）</td>
      <td>Behavior</td>
    </tr>
    <tr>
      <td>Result / Effect</td>
      <td>能力返回了什么 / 世界改变了什么</td>
      <td>Behavior</td>
    </tr>
    <tr>
      <td>Task</td>
      <td>Operation 所服务的任务单位</td>
      <td>Behavior</td>
    </tr>
    <tr>
      <td>Client</td>
      <td>独立 Agent runtime / installation</td>
      <td>Market</td>
    </tr>
    <tr>
      <td>Project</td>
      <td>package/MCP/skill 归属的软件项目</td>
      <td>Market</td>
    </tr>
    <tr>
      <td>Category</td>
      <td>可比较的能力类别（搜索、预订…）</td>
      <td>Market</td>
    </tr>
    <tr>
      <td>Observation</td>
      <td>测量事实的证据记录（认证与签名可选，由 verification profiles 定义）</td>
      <td><strong>Evidence</strong></td>
    </tr>
  </tbody>
</table>

<p>观察发生在 <strong>Interaction Surface</strong> 层；归属到 <strong>Software Entity</strong> 经机器可读
registry 解析——观察时绝不猜测。</p>

<p><strong>定价不是核心模型的对象。</strong> <code class="language-plaintext highlighter-rouge">Offering</code>——引用一个或多个 Capability 的商业包装，
含允许的 surface、定价政策、服务级别目标与商业约束——定义在 Commercial Extension
（实验性、非规范性）中，使测量语义的演进不被任何支付设计绑架。</p>

<h3 id="分布事件distribution-events">分布事件（Distribution events）</h3>

<p>商业归因进入范围后，discovery 重新获得商业意义——但不成为选择分母：</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Published → Listed → Retrieved / Discovered → Presented
</code></pre></div></div>

<p><code class="language-plaintext highlighter-rouge">Presented</code> 仍是选择指标的分母；<code class="language-plaintext highlighter-rouge">Discovered</code> 是分布归因事件，回答
<em>哪个 Skill / Registry / Marketplace 带来了 Capability 使用</em>。</p>

<h2 id="四agentcapability-交互模型">四、Agent–Capability 交互模型</h2>

<p><strong>Reach → Value 是测量视角，不是普适执行状态机。</strong> 不同类别的能力有不同的有意义链路：</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Information   操作 → 结果 → 消费
Action        操作 → 效应 → 确认
Transaction   操作 → 授权 → 提交 / 结算
</code></pre></div></div>

<p>Interaction Class（information / action / transaction / computation /
communication / control / storage / sensing）决定适用哪条链路、哪些 Utility 信号
有意义。搜索结果被<em>消费</em>；预订被<em>确认</em>；支付被<em>结算</em>。把所有能力塞进一条流水线，
产出的数字会失去含义。</p>

<h2 id="五测量框架">五、测量框架</h2>

<p>AgentMeasure 定义 <strong>Metric Families</strong>，不定义全局北极星。</p>

<p><strong>M1 Distribution — Reach。</strong> 能力进入 Agent 世界了吗？
<code class="language-plaintext highlighter-rouge">Available Clients · Eligible Opportunities · Presentations · Presentation Rate · Distribution Coverage</code></p>

<p><strong>M2 Choice — 最 Agent-native。</strong> Agent 有机会时会选它吗？
<code class="language-plaintext highlighter-rouge">选择数 · Observed Selection Rate（Observed Selected ÷ Presented）· Conditional Choice Share · 首选率</code></p>

<p><strong>M3 Execution — Use。</strong> 选了以后好用吗？Draft 0.4 分开计数 Operation 与 Attempt——
这正是未来 Metering 需要的区分：</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Operations · Attempts · Attempts per Operation
Operation 完成率 · Operation 成功率
Attempt 失败率 · 重试率 · 延迟
</code></pre></div></div>

<p><strong>M4 Utility — 有效使用。</strong> 能力交付了可用信息，还是引发了预期效应？</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Result Utility     已交付 · 已消费 · 已接受
Effect Utility     已应用 · 已确认 · 已回退 / 失败
</code></pre></div></div>

<p><strong>M5 Outcome — Value。</strong> 改善任务了吗？
<code class="language-plaintext highlighter-rouge">任务成功关联 · 增量提升 · 节省时间 · 节省成本</code></p>

<p><strong>关系测量</strong>（从独立章节降级为小节）：Trial → Active → Repeated → Preferred →
Dependent。最不可替代的 Dependent 依然是长期资产信号。</p>

<h2 id="六测量质量与声称纪律">六、测量质量与声称纪律</h2>

<p>证据质量不是覆盖质量，两者都不是限定质量，也都不是方法论。一组 100% 真实但只覆盖
2% Agent 的事件，不是市场数据。</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Measurement Quality
├── Provenance / Evidence Strength  观察来自哪里？其来源被支持得多强？
├── Coverage                        我们看到了多少世界？
├── Qualification                   这算不算真实生产使用？
├── Sampling                        采样了吗？不确定性多少？
├── Identity                        标识归一得怎么样？
└── Method/version                  用什么统计、哪个规范版本？
</code></pre></div></div>

<p><strong>限定使用。</strong> 每条观察携带两条轴——Usage Context（流量来源）与 Validity（观察是否
真实）。<strong>Strict Qualified Usage</strong> = <code class="language-plaintext highlighter-rouge">production</code> + <code class="language-plaintext highlighter-rouge">validity=normal</code>：公共指标的
默认口径。unknown 的 context/validity 单独披露，绝不静默计入——没有”报 unknown →
进排行榜”的激励。重试是同一 Operation 的另一次 Attempt，作为可靠性信号保留，不算
多次逻辑使用。</p>

<p><strong>声称纪律。</strong> 每个公开指标携带 Measurement Label：分子、分母、可观测人群、合格
人群、runtime 覆盖、grain、choice mode、decision authority、selection constraint。
观测到的选择绝不说成偏好；关联绝不说成因果；不可观测绝不说成负面。</p>

<h2 id="七测量与计量measurement-and-metering">七、测量与计量（Measurement and Metering）</h2>

<p>从测量标准通向 CaaS 的桥是语义的：<strong>测量单位 ≠ 计费单位</strong>，且三个计量概念必须
绝对分开——<strong>Event</strong> 是为什么计费，<strong>Unit</strong> 是按什么单位计，<strong>Quantity</strong> 是多少单位：</p>

<table>
  <thead>
    <tr>
      <th>能力</th>
      <th>billable_event</th>
      <th>billable_unit</th>
      <th>billable_quantity</th>
    </tr>
  </thead>
  <tbody>
    <tr>
      <td>搜索</td>
      <td><code class="language-plaintext highlighter-rouge">operation_succeeded</code></td>
      <td>operation</td>
      <td>1</td>
    </tr>
    <tr>
      <td>数据</td>
      <td><code class="language-plaintext highlighter-rouge">result_delivered</code></td>
      <td>record</td>
      <td>1,382</td>
    </tr>
    <tr>
      <td>算力</td>
      <td><code class="language-plaintext highlighter-rouge">compute_completed</code></td>
      <td>gpu_second</td>
      <td>47.2</td>
    </tr>
    <tr>
      <td>动作</td>
      <td><code class="language-plaintext highlighter-rouge">effect_confirmed</code></td>
      <td>operation</td>
      <td>1</td>
    </tr>
    <tr>
      <td>预订</td>
      <td><code class="language-plaintext highlighter-rouge">effect_confirmed</code></td>
      <td>booking</td>
      <td>1</td>
    </tr>
    <tr>
      <td>线索</td>
      <td><code class="language-plaintext highlighter-rouge">outcome_qualified</code></td>
      <td>qualified_lead</td>
      <td>5</td>
    </tr>
    <tr>
      <td>电商</td>
      <td><code class="language-plaintext highlighter-rouge">transaction_settled</code></td>
      <td>transaction</td>
      <td>0.03（收入分成）</td>
    </tr>
  </tbody>
</table>

<p>因此，计量语义按 Offering 定义：</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Billable Event        哪个测量事实触发计费
Billable Unit         计量单位（操作、记录、GPU-秒、效应…）
Billable Quantity     单位如何计数（按策略：attempts、确认…）
Pricing Model         按操作 · 按数量 · 按效应 · 按结果 · 收入分成
Pricing Policy        版本化的价格规则（flat、阶梯、企业协议、surge…）
Quote                 单次调用实际适用的条款（quote_id、policy 版本、单价）
Metering Policy       测量事实 → 计费事实的映射（规则、排除），版本化
Metering Ledger       可重放、可纠错的计量事实账本（revision / supersedes / reversal）
Commercial Attribution  哪些参与方贡献了发现 / 选择 / 收入
</code></pre></div></div>

<p><strong>支付不在范围内。</strong> AgentMeasure 不定义支付轨道、钱包、结算货币、商户记录关系或
金融托管。它产出支付系统消费的事实——合格操作、已确认效应、合格结果、计费数量、
商业归因。</p>

<blockquote>
  <p><strong>AgentMeasure 标准化经济事实，不移动金钱。</strong></p>
</blockquote>

<h2 id="八归因与增量">八、归因与增量</h2>

<p><strong>能力参与了成功任务，不等于它导致了成功。</strong></p>

<ul>
  <li><strong>归因测量</strong>（observational）：哪些能力参与了任务链——只能支持”关联”与”参与执行链”的结论。</li>
  <li><strong>增量测量</strong>（counterfactual）：能力的存在创造了多少额外价值——随机对照是最强
证据，但许多能力无法随机关闭。因此因果声称遵循 <strong>Value Evidence Ladder</strong>：</li>
</ul>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>V0 Association            任务成功时参与过
V1 Matched / Observational 控制已知混淆变量比较
V2 Offline Ablation       重放任务、移除能力
V3 Quasi-experiment       switchback / 自然变异
V4 Randomized Holdout     最强因果证据
</code></pre></div></div>

<p>只允许用实际产出的证据等级支持对应的因果声称强度——与测量质量的纪律一致。</p>

<p>商业归因扩展观察侧到分发链：</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>GitHub Skill → Registry → Agent 推荐 → Capability → 支付
</code></pre></div></div>

<p>谁贡献了发现、选择与收入？这是未来 Agent affiliate 与收入分成模型的基础——且绝不
与因果增量混为一谈。</p>

<h2 id="九能力信任与可比性capability-trust-and-comparability">九、能力信任与可比性（Capability Trust and Comparability）</h2>

<p>能力消费者的选择受多种因素塑造。Agent 与 Marketplace 可以在品牌、政策、价格、
用户偏好与平台约束<strong>之外</strong>越来越多地比较机器可读的性能信号——这正是 AgentMeasure
的 Decision Authority / Selection Constraint 模型描述的轴：</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Capability Signals
可靠性 · 延迟 · 价格 · 新鲜度 · 消费 · 效应成功 · 结果 · 安全 · 测量覆盖
</code></pre></div></div>

<p>AgentMeasure <strong>不计算通用 AgentMeasure Score</strong>。Agent A 在乎价格，Agent B 在乎延迟，
Agent C 在乎隐私。排名是 Agent 与 Marketplace 的产品决策；标准只定义可比较的信号
与让它们可比较的 Label。Measurement Label 是这种可比性的基础。</p>

<h2 id="十观察与部署架构observation--deployment-architecture">十、观察与部署架构（Observation &amp; Deployment Architecture）</h2>

<p>不同测量 surface 能看到的东西不同；单边接入就有价值，但声称必须匹配 surface：</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>分发侧 → Agent Runtime 侧 → Provider 侧 → 效应 / 结果侧
</code></pre></div></div>

<table>
  <thead>
    <tr>
      <th>Surface</th>
      <th>能看什么</th>
    </tr>
  </thead>
  <tbody>
    <tr>
      <td>Registry</td>
      <td>发现 / 可用性</td>
    </tr>
    <tr>
      <td>Agent runtime</td>
      <td>呈现 / 选择 / 消费</td>
    </tr>
    <tr>
      <td>Capability provider</td>
      <td>操作 / attempts / 结果</td>
    </tr>
    <tr>
      <td>目标系统</td>
      <td>效应 / 交易</td>
    </tr>
    <tr>
      <td>实验层</td>
      <td>增量</td>
    </tr>
  </tbody>
</table>

<p>双侧观察（Agent runtime + provider）构成佐证（E2）；仅 Provider 侧也足以支持
provider-scoped 的使用指标。标准不在请求关键路径上：观察异步产出、仅元数据、
落盘前伪匿名。</p>

<h2 id="十一互操作">十一、互操作</h2>

<p>标准是 transport-neutral、vendor-neutral 的。现有基础设施作为实现例子而非前提：
MCP 承载生命周期事件与 trace context；OpenTelemetry 承载工具 span；Codex/Claude
Code/DeepSeek Harness 暴露带能力声明的观察点；registry 提供实体身份。未来的支付
轨道消费标准的事实，而不是扩展标准的核心。</p>

<h2 id="十二不做什么与治理">十二、不做什么与治理</h2>

<p>AgentMeasure <strong>不是</strong>支付协议、Marketplace、钱包或通用声誉系统。标准不：</p>

<ul>
  <li>移动金钱或托管资金；</li>
  <li>给能力排名或给 Provider 打分；</li>
  <li>定义什么是”好”能力；</li>
  <li>要求任何中心服务器、Agent 侧安装或开源 Provider。</li>
</ul>

<p>标准本身由社区治理（AUP 流程，<code class="language-plaintext highlighter-rouge">proposals/</code>）；建立在它之上的商业产品不得控制
标准的定义。</p>

<h2 id="十三开放问题">十三、开放问题</h2>

<ol>
  <li><strong>任务边界</strong>：什么算一个”任务”，由谁定义？</li>
  <li><strong>效应验证</strong>：不深度集成每个目标系统，如何确认效应（预订确认、支付结算）？</li>
  <li><strong>规模化增量</strong>：如何在不干扰生产的情况下跨生态运行反事实实验？</li>
  <li><strong>候选集可观测性</strong>：Presented 是关键分母，多数 runtime 尚未暴露 routing 层信号。</li>
  <li><strong>跨 Agent 身份</strong>：同一 client 跨 Codex/Claude/DSH——何时可知？</li>
  <li><strong>计费单位共识</strong>：Provider 与支付轨道最终会就哪些测量事实达成一致，误计量的代价多大？</li>
  <li><strong>隐私</strong>：伪匿名下关联与留存能走多远？</li>
</ol>

<h2 id="十四结论">十四、结论</h2>

<p>软件消费者正在从人变成 Agent，经济单元正在从席位转向可调用的能力。在能力被定价、
计费与比较之前，生态需要一套共享的测量语言——什么算选择、什么算操作、什么算交付、
消费、效应与结果，以及哪些数字能支持哪些结论。</p>

<p>AgentMeasure 就是那个提案：测量语义作为基础设施，商业语义作为未来扩展，支付交给
别人的轨道。<strong>今天：让开发者知道 Agent 如何真实使用自己的能力。下一步：让
Capability 可以跨 Agent 被统一度量、比较和计量。长期：成为 CaaS 与 Agent Capability
Economy 的统一计量基础。</strong></p>

<h2 id="参考文献">参考文献</h2>

<ol>
  <li>RFC 2119 / BCP 14 — <em>Key words for use in RFCs to Indicate Requirement Levels</em>。</li>
  <li>OpenTelemetry GenAI semantic conventions — <code class="language-plaintext highlighter-rouge">gen_ai.*</code> 工具调用遥测字段。</li>
  <li>Model Context Protocol (MCP) 规范 — 工具发现与调用 surface。</li>
  <li>MCP Registry — 实体解析的 server 身份入口。</li>
  <li>EDPB — 伪匿名化指引（伪匿名数据仍可能属于 personal data）。</li>
  <li>Cloudflare — <a href="https://developers.cloudflare.com/agents/agentic-payments/x402/charge-for-mcp-tools/">Charge for MCP tools（x402 / Agentic Payments）</a>。</li>
  <li>Coinbase — <a href="https://docs.cdp.coinbase.com/x402/bazaar">x402 Bazaar：Discover &amp; pay over MCP</a>。</li>
  <li>OpenAI / Stripe — Agentic Commerce Protocol（ACP），2025 年 9 月发布；见
<a href="https://www.digitaltransactions.net/openai-and-stripe-are-the-latest-fintechs-to-enable-agentic-commerce/">Digital Transactions 报道</a>。</li>
  <li>AgentMeasure 规范 — Core / Metrics / Data / Entity / Quality / Correlation
（<code class="language-plaintext highlighter-rouge">standard/</code>）；Commercial Extension（<code class="language-plaintext highlighter-rouge">extensions/COMMERCIAL.md</code>，实验性）；
机器可读 registry（<code class="language-plaintext highlighter-rouge">schemas/</code>、<code class="language-plaintext highlighter-rouge">registry/</code>）；参考实现与 conformance vectors
同仓发布。</li>
</ol>

<hr />

<p><em>规范全文（测量对象、生命周期、指标家族、质量、报告）与参考实现（AgentMeasure）均已开源。AgentMeasure 1.0 毕业标准：2 个独立实现、3 个 runtime profiles、2 个 tool-side 实现、公开 conformance + canonical test vectors、5-10 个真实项目、已发布的 discrepancy report、安全与隐私审查。</em></p>]]></content><author><name>Roy.Tong</name></author><category term="Agent" /><category term="度量标准" /><category term="Capability Economy" /><summary type="html"><![CDATA[当软件消费者从人变成 Agent、经济单元从软件席位转向可调用能力，计量问题先于支付问题出现。AgentMeasure 提出面向 CaaS 与 Agent Capability Economy 的统一计量基础——Reach → Choice → Use → Utility → Value。]]></summary></entry><entry xml:lang="en"><title type="html">How Software Usage by AI Agents Should Be Measured</title><link href="https://roy-tong.github.io/en/notes/how-agent-usage-should-be-measured/" rel="alternate" type="text/html" title="How Software Usage by AI Agents Should Be Measured" /><published>2026-08-16T10:00:00+08:00</published><updated>2026-08-16T10:00:00+08:00</updated><id>https://roy-tong.github.io/en/notes/how-agent-usage-should-be-measured-en</id><content type="html" xml:base="https://roy-tong.github.io/en/notes/how-agent-usage-should-be-measured/"><![CDATA[<p><em>Whitepaper v0.2 · AgentMeasure Standard Draft 0.4</em></p>

<blockquote>
  <p>Roy Tong
The reference implementation lives in the AgentMeasure repository.</p>
</blockquote>

<h2 id="0-abstract">0. Abstract</h2>

<p>AI agents increasingly select, invoke, and transact with software on behalf of
users and organizations. As interfaces such as Skills, MCP servers, APIs and CLIs
become easier to create and distribute, economic value increasingly shifts toward
the scarce capabilities behind them: proprietary data, compute, execution,
permissions, transactions and real-world fulfillment.</p>

<p>This creates a measurement problem before it creates a payment problem. A capability
cannot be reliably priced, compared, billed or optimized until the ecosystem agrees
on what constitutes a selection, an operation, a successful delivery, a consumed
result, an outcome and a billable unit.</p>

<p>AgentMeasure proposes an open measurement standard for this emerging capability
economy: a common data language — reach, choice, use, utility, value — plus the
measurement semantics that metering, marketplaces and payment rails can later build
on. The goal is not a dashboard. It is the measurement foundation that makes
Capability as a Service (CaaS, as used in this paper) possible.</p>

<h2 id="1-from-saas-to-capability-economy">1. From SaaS to Capability Economy</h2>

<p>Software distribution once had a readable chain: downloaded, installed, used. Each
era has had its own economic unit. The shift described below is <strong>additive, not
replacement</strong>: alongside seat-based SaaS and request-based APIs, callable
capabilities are emerging as a new economic unit for agent-mediated software
consumption.</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>SaaS
Human → Application → Seat / Month

API Economy
Software → API → Request / Token

Capability Economy
Agent → Capability → Operation / Outcome
</code></pre></div></div>

<p>Three forces are driving the shift to the third row.</p>

<p><strong>Interfaces are being absorbed by agents.</strong> The UI and the workflow are increasingly
executed by the agent, not presented to a human. What remains for software is a
callable surface — a skill file, an MCP tool, a CLI, an endpoint.</p>

<p><strong>Distribution artifacts are commoditizing.</strong> An open Skill, an open MCP adapter, an
open CLI can be authored and published by anyone in hours. Interfaces may become
cheap to create; capabilities remain scarce to deliver.</p>

<p><strong>Scarcity moved down the stack.</strong> The scarce layer is no longer the app shell; it is
what the callable surface controls access to:</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Data · Compute · Action · Permission · Trust · Real-world fulfillment
</code></pre></div></div>

<p>A search capability is scarce because of its index; a booking capability because it
can confirm a reservation; a payment capability because it can move money. When
commercial value concentrates in the capability, the natural economic unit becomes
the operation, the quantity, the effect, the outcome — or a revenue share on any of
them.</p>

<p><strong>If capability becomes the economic unit, capability measurement becomes
infrastructure.</strong> That is the thesis of this paper.</p>

<h3 id="thesis-and-assumptions">Thesis and assumptions</h3>

<p>AgentMeasure is built on three trend judgments that are <strong>not yet fully established</strong>:</p>

<ol>
  <li>Agents will mediate a growing share of software selection and execution.</li>
  <li>More software capabilities will be exposed independently of their human UI.</li>
  <li>Usage-, effect-, and outcome-based commercial models will coexist with seat-based
pricing.</li>
</ol>

<p>The measurement standard remains useful even if these trends progress unevenly:
the objects, quality rules and claim discipline stand on their own as an agent
software measurement standard.</p>

<h2 id="2-measurement-before-monetization">2. Measurement Before Monetization</h2>

<p>Before CaaS can have pricing, billing and reputation, it needs common measurement
semantics. Four questions make the point:</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>One user task → 1 Operation → 3 retries
Charge 1 time or 3?

Tool returned successfully → Agent ignored the result
Was value delivered?

Booking API executed → reservation was never confirmed
Was the capability fulfilled?

Task succeeded → would it succeed without the capability?
Can the provider claim value?
</code></pre></div></div>

<p>None of these questions can be answered by raw call counts, and none of them can be
answered by a payment rail. They require agreed definitions of <em>operation</em>, <em>attempt</em>,
<em>delivery</em>, <em>consumption</em>, <em>effect</em> and <em>outcome</em> — and agreed rules for turning
observations into those objects. That agreement is the wedge: <strong>measurement before
monetization</strong>.</p>

<h3 id="emerging-evidence-commerce-is-arriving-before-measurement">Emerging evidence: commerce is arriving before measurement</h3>

<p>The premise is not hypothetical — payment and discovery infrastructure for
agent-mediated commerce already exists:</p>

<ul>
  <li><strong>Cloudflare Agents SDK</strong> allows MCP tools to be priced per call and charged via
x402 (<a href="https://developers.cloudflare.com/agents/agentic-payments/x402/charge-for-mcp-tools/">Charge for MCP tools</a>).</li>
  <li><strong>Coinbase x402 Bazaar</strong> is a discovery layer where agents search services with
price and schema, and complete paid calls over MCP
(<a href="https://docs.cdp.coinbase.com/x402/bazaar">x402 Bazaar</a>).</li>
  <li><strong>OpenAI and Stripe’s Agentic Commerce Protocol (ACP)</strong> is being used in real
agentic commerce flows (<a href="https://www.digitaltransactions.net/openai-and-stripe-are-the-latest-fintechs-to-enable-agentic-commerce/">announcement coverage</a>).</li>
</ul>

<p>These prove the thesis of this section: <strong>payment and discovery infrastructure is
arriving before common capability measurement semantics</strong> — the gap AgentMeasure
fills.</p>

<h2 id="3-measurement-objects">3. Measurement Objects</h2>

<p>An observation is an <em>evidence unit</em>, not a <em>business measurement unit</em>. AgentMeasure
defines the business units first:</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Provider
    ↓
Software Entity
    ↓
Capability
    ↓
Interaction Surface
</code></pre></div></div>

<blockquote>
  <p><strong>Capability is the primary functional and measurement object. An Offering is the
commercial packaging of one or more capabilities</strong> — defined in the Commercial
Extension (experimental), never inserted into the core measurement lineage.</p>
</blockquote>

<table>
  <thead>
    <tr>
      <th>Object</th>
      <th>Definition</th>
      <th>Layer</th>
    </tr>
  </thead>
  <tbody>
    <tr>
      <td>Software Entity</td>
      <td>the software being measured: tool, skill, API, data source, agent, application, runtime capability</td>
      <td>Market</td>
    </tr>
    <tr>
      <td>Capability</td>
      <td>a named function of an entity — the primary functional and measurement object</td>
      <td>Market</td>
    </tr>
    <tr>
      <td>Interaction Surface</td>
      <td>the observable calling interface of a capability (mcp_tool, cli_command, http_endpoint, …)</td>
      <td>Market</td>
    </tr>
    <tr>
      <td>Decision Opportunity</td>
      <td>one tool-choice decision</td>
      <td>Behavior</td>
    </tr>
    <tr>
      <td>Candidate Set</td>
      <td>the set actually offered in that decision</td>
      <td>Behavior</td>
    </tr>
    <tr>
      <td>Presentation</td>
      <td>a selectable appearing in the candidate set</td>
      <td>Behavior</td>
    </tr>
    <tr>
      <td>Selection</td>
      <td>the agent choosing a selectable</td>
      <td>Behavior</td>
    </tr>
    <tr>
      <td>Operation</td>
      <td>one logical use of a capability for a task</td>
      <td>Behavior</td>
    </tr>
    <tr>
      <td>Attempt</td>
      <td>one execution of an operation (<strong>retries = multiple attempts</strong>)</td>
      <td>Behavior</td>
    </tr>
    <tr>
      <td>Result / Effect</td>
      <td>what the capability returned / what changed in the world</td>
      <td>Behavior</td>
    </tr>
    <tr>
      <td>Task</td>
      <td>the unit of work an operation serves</td>
      <td>Behavior</td>
    </tr>
    <tr>
      <td>Client</td>
      <td>an independent agent runtime / installation</td>
      <td>Market</td>
    </tr>
    <tr>
      <td>Project</td>
      <td>the software entity packages/tools/skills roll up to</td>
      <td>Market</td>
    </tr>
    <tr>
      <td>Category</td>
      <td>a comparable capability class (search, booking, …)</td>
      <td>Market</td>
    </tr>
    <tr>
      <td>Observation</td>
      <td>an evidence record of a measurement fact (authentication and signatures are optional, defined by verification profiles)</td>
      <td>Evidence</td>
    </tr>
  </tbody>
</table>

<p>Observation happens on <strong>Interaction Surfaces</strong>; attribution resolves to <strong>Software
Entities</strong> through a machine-readable registry — never guessed at observation time.</p>

<p>Pricing is deliberately <strong>not</strong> an object of the core model. An <code class="language-plaintext highlighter-rouge">Offering</code> —
commercial packaging referencing one or more capabilities, with permitted surfaces,
pricing policy, service level objectives and commercial constraints — is defined in
the Commercial Extension (experimental, non-normative), so that measurement
semantics can evolve without being coupled to any payment design.</p>

<h3 id="distribution-events">Distribution events</h3>

<p>With commercial attribution in scope, discovery regains business meaning — without
becoming the choice denominator:</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Published → Listed → Retrieved / Discovered → Presented
</code></pre></div></div>

<p><code class="language-plaintext highlighter-rouge">Presented</code> remains the denominator of choice metrics; <code class="language-plaintext highlighter-rouge">Discovered</code> is a
distribution-attribution event, answering <em>which Skill / Registry / Marketplace
brought capability usage</em>.</p>

<h2 id="4-agentcapability-interaction-model">4. Agent–Capability Interaction Model</h2>

<p><strong>Reach → Value is a measurement view, not a universal execution state machine.</strong>
Different classes of capabilities have different meaningful chains:</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Information   Operation → Result → Consumption
Action        Operation → Effect → Confirmation
Transaction   Operation → Authorization → Commit / Settlement
</code></pre></div></div>

<p>The Interaction Class (information / action / transaction / computation /
communication / control / storage / sensing) determines which chain applies and
therefore which Utility signals are meaningful. A search result is <em>consumed</em>; a
booking is <em>confirmed</em>; a payment is <em>settled</em>. Forcing every capability through one
pipeline would produce numbers that mean different things.</p>

<h2 id="5-measurement-framework">5. Measurement Framework</h2>

<p>AgentMeasure defines <strong>metric families</strong>, not a universal KPI.</p>

<p><strong>M1 Distribution — Reach.</strong> Is the capability in the agent world?
<code class="language-plaintext highlighter-rouge">Available Clients · Eligible Opportunities · Presentations · Presentation Rate ·
Distribution Coverage</code></p>

<p><strong>M2 Choice — the most agent-native family.</strong> When the agent had the chance, did it
choose the capability?
<code class="language-plaintext highlighter-rouge">Selections · Observed Selection Rate (Observed Selected ÷ Presented) · Conditional
Choice Share · First-choice Rate</code></p>

<p><strong>M3 Execution — Use.</strong> Was it usable after selection? The Draft 0.4 model counts
operations and attempts separately — the distinction that metering will eventually
need:</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Operations · Attempts · Attempts per Operation
Operation Completion Rate · Operation Success Rate
Attempt Failure Rate · Retry Rate · Latency
</code></pre></div></div>

<p><strong>M4 Utility — effective use.</strong> Did the capability deliver usable information or
cause the intended effect?</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Result Utility      Delivered · Consumed · Accepted
Effect Utility      Applied · Confirmed · Reversed / Failed
</code></pre></div></div>

<p><strong>M5 Outcome — Value.</strong> Did it improve the task?
<code class="language-plaintext highlighter-rouge">Task Success Association · Incremental Lift · Time Saved · Cost Saved</code></p>

<p><strong>Relationships</strong> (formerly a separate chapter, now a subsection): Trial → Active →
Repeated → Preferred → Dependent. Dependency — the least replaceable — remains the
long-term asset signal.</p>

<h2 id="6-measurement-quality--claim-discipline">6. Measurement Quality &amp; Claim Discipline</h2>

<p>Evidence quality is not coverage quality; both are not qualification quality; none
is methodology. A set of perfectly attested events covering 2% of agents is not
market data.</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Measurement Quality
├── Provenance / Evidence Strength   where did this observation come from, and how
│                                    strongly is its origin supported?
├── Coverage                         how much of the world did we see?
├── Qualification                    does this count as real production use?
├── Sampling                         sampled? with what uncertainty?
├── Identity                         how well do identifiers resolve to entities?
└── Method/version                   which statistics, which spec version?
</code></pre></div></div>

<p><strong>Qualified usage.</strong> Every observation carries two axes — Usage Context (where the
traffic came from) and Validity (whether the observation is genuine). <strong>Strict
Qualified Usage</strong> = <code class="language-plaintext highlighter-rouge">production</code> + <code class="language-plaintext highlighter-rouge">validity=normal</code>: the default for public metrics.
Unknown context/validity is disclosed separately, never silently included — no
“report unknown → make the leaderboard” incentive. A retry is an additional attempt
of the same operation, kept as a reliability signal, not as a distinct logical use.</p>

<p><strong>Claim discipline.</strong> Every published metric carries a Measurement Label: numerator,
denominator, observable population, qualified population, runtime coverage, grain,
choice mode, decision authority, selection constraint. Observed choice is never
presented as preference; association is never presented as causation; unobservable is
never interpreted as negative.</p>

<h2 id="7-measurement-and-metering">7. Measurement and Metering</h2>

<p>The bridge from measurement standard to CaaS is semantic: <strong>measurement unit ≠
billable unit</strong>, and the three metering concepts must stay separated — <strong>Event</strong> is
why billing triggers, <strong>Unit</strong> is what is counted, <strong>Quantity</strong> is how many:</p>

<table>
  <thead>
    <tr>
      <th>Capability</th>
      <th>billable_event</th>
      <th>billable_unit</th>
      <th>billable_quantity</th>
    </tr>
  </thead>
  <tbody>
    <tr>
      <td>Search</td>
      <td><code class="language-plaintext highlighter-rouge">operation_succeeded</code></td>
      <td>operation</td>
      <td>1</td>
    </tr>
    <tr>
      <td>Data</td>
      <td><code class="language-plaintext highlighter-rouge">result_delivered</code></td>
      <td>record</td>
      <td>1,382</td>
    </tr>
    <tr>
      <td>Compute</td>
      <td><code class="language-plaintext highlighter-rouge">compute_completed</code></td>
      <td>gpu_second</td>
      <td>47.2</td>
    </tr>
    <tr>
      <td>Action</td>
      <td><code class="language-plaintext highlighter-rouge">effect_confirmed</code></td>
      <td>operation</td>
      <td>1</td>
    </tr>
    <tr>
      <td>Booking</td>
      <td><code class="language-plaintext highlighter-rouge">effect_confirmed</code></td>
      <td>booking</td>
      <td>1</td>
    </tr>
    <tr>
      <td>Lead Generation</td>
      <td><code class="language-plaintext highlighter-rouge">outcome_qualified</code></td>
      <td>qualified_lead</td>
      <td>5</td>
    </tr>
    <tr>
      <td>Commerce</td>
      <td><code class="language-plaintext highlighter-rouge">transaction_settled</code></td>
      <td>transaction</td>
      <td>0.03（revenue share）</td>
    </tr>
  </tbody>
</table>

<p>Metering semantics therefore define, per Offering:</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Billable Event       which measured fact triggers a charge
Billable Unit        the unit of quantity (operation, record, GPU-second, effect…)
Billable Quantity    how the unit is counted (per policy: attempts, confirmations…)
Pricing Model        per-operation · per-quantity · per-effect · per-outcome · revenue share
Pricing Policy       versioned price rules (flat, volume tiers, enterprise agreement, surge…)
Quote                the terms actually applicable to one call (quote_id, policy version, unit price)
Metering Policy      how measurement facts map to billable facts (rules, exclusions), versioned
Metering Ledger      replayable, correctable record of metered facts (revision / supersedes / reversal)
Commercial Attribution  which parties contributed to discovery / selection / revenue
</code></pre></div></div>

<p><strong>Payment is out of scope.</strong> AgentMeasure does not define payment rails, wallets,
settlement currencies, merchant-of-record relationships, or financial custody. It
produces the facts — qualified operation, confirmed effect, qualified outcome,
billable quantity, commercial attribution — that payment systems consume.</p>

<blockquote>
  <p><strong>AgentMeasure standardizes economic facts, not money movement.</strong></p>
</blockquote>

<h2 id="8-attribution-and-incrementality">8. Attribution and Incrementality</h2>

<p><strong>A capability’s participation in a successful task is not evidence that it caused
the success.</strong></p>

<ul>
  <li><strong>Attribution measurement</strong> is observational: which capabilities participated in
the task chain. It supports claims of <em>association</em> and <em>contribution to the
execution chain</em> — nothing more.</li>
  <li><strong>Incrementality measurement</strong> is counterfactual: how much additional value did the
capability create? Randomized comparison is the strongest evidence, but many
capabilities cannot be randomly switched off. Claims therefore follow a <strong>Value
Evidence Ladder</strong>:</li>
</ul>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>V0 Association             participated when the task succeeded
V1 Matched / Observational known confounders controlled
V2 Offline Ablation        replay tasks with the capability removed
V3 Quasi-experiment        switchback / natural variation
V4 Randomized Holdout      strongest causal evidence
</code></pre></div></div>

<p>Only the evidence actually produced may support the corresponding causal claim
strength — the same discipline as measurement quality.</p>

<p>Commercial attribution extends the observational side along the distribution chain:</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>GitHub Skill → Registry → Agent Recommendation → Capability → Payment
</code></pre></div></div>

<p>Who contributed to discovery, selection and revenue? This is the future basis for
agent affiliate and revenue-sharing models — and it must never be conflated with
causal incrementality.</p>

<h2 id="9-capability-trust-and-comparability">9. Capability Trust and Comparability</h2>

<p>A capability consumer’s choice is shaped by many factors. Agents and marketplaces
can increasingly compare machine-readable performance signals <strong>alongside</strong> brand,
policy, price, user preference, and platform constraints — exactly the axes
AgentMeasure’s Decision Authority / Selection Constraint model describes:</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Capability Signals
Reliability · Latency · Price · Freshness · Consumption · Effect Success
Outcome · Safety · Measurement Coverage
</code></pre></div></div>

<p>AgentMeasure <strong>does not calculate a universal AgentMeasure Score</strong>. Agent A cares
about price, Agent B about latency, Agent C about privacy. Ranking is a product
decision for agents and marketplaces; the standard defines only comparable signals
and the labels that make them comparable. The Measurement Label is the foundation of
this comparability.</p>

<h2 id="10-observation--deployment-architecture">10. Observation &amp; Deployment Architecture</h2>

<p>Measurement surfaces differ in what they can see; single-sided adoption has value,
but the claim must match the surface:</p>

<div class="language-text highlighter-rouge"><div class="highlight"><pre class="highlight"><code>Distribution Side → Agent Runtime Side → Provider Side → Effect / Outcome Side
</code></pre></div></div>

<table>
  <thead>
    <tr>
      <th>Surface</th>
      <th>Can see</th>
    </tr>
  </thead>
  <tbody>
    <tr>
      <td>Registry</td>
      <td>discovery / availability</td>
    </tr>
    <tr>
      <td>Agent runtime</td>
      <td>presentation / choice / consumption</td>
    </tr>
    <tr>
      <td>Capability provider</td>
      <td>operation / attempts / result</td>
    </tr>
    <tr>
      <td>Target system</td>
      <td>effect / transaction</td>
    </tr>
    <tr>
      <td>Experiment layer</td>
      <td>incrementality</td>
    </tr>
  </tbody>
</table>

<p>Two-sided observations (agent runtime + provider) enable corroboration (E2); the
provider side alone is sufficient for provider-scoped usage metrics. The standard is
not on the critical request path: observations are emitted asynchronously, metadata
only, pseudonymized before persistence.</p>

<h2 id="11-interoperability">11. Interoperability</h2>

<p>The standard is transport-neutral and vendor-neutral. Current infrastructure binds
to it as implementation examples, not as preconditions: MCP carries lifecycle events
and trace context; OpenTelemetry carries tool spans; Codex, Claude Code, and DeepSeek
Harness expose observation points with declared capability matrices; registries
provide entity identity. Payment rails, when they arrive, consume the standard’s
facts rather than extending its core.</p>

<h2 id="12-non-goals-and-governance">12. Non-goals and Governance</h2>

<p>AgentMeasure is <strong>not</strong> a payment protocol, a marketplace, a wallet, or a universal
reputation system. The standard does not:</p>

<ul>
  <li>move money or custody funds;</li>
  <li>rank capabilities or score providers;</li>
  <li>define what a “good” capability is;</li>
  <li>require any central server, agent-side install, or open-source provider.</li>
</ul>

<p>The standard itself is community-governed (AUP process, <code class="language-plaintext highlighter-rouge">proposals/</code>); commercial
products built on it must not control the standard’s definitions.</p>

<h2 id="13-open-questions">13. Open Questions</h2>

<ol>
  <li><strong>Task boundaries.</strong> What is the unit of a “task,” and who defines it?</li>
  <li><strong>Effect verification.</strong> How to confirm an effect (booking confirmed, payment
settled) without deep integration into every target system?</li>
  <li><strong>Incrementality at scale.</strong> How to run counterfactual experiments across the
ecosystem without disturbing production?</li>
  <li><strong>Candidate-set observability.</strong> Presentation is the key denominator; most
runtimes do not expose it yet.</li>
  <li><strong>Cross-agent identity.</strong> Same client across Codex, Claude, and DSH — when is
that knowable?</li>
  <li><strong>Billable-unit consensus.</strong> Which measurement facts will providers and payment
rails actually agree on, and at what cost of mis-measurement?</li>
  <li><strong>Privacy.</strong> How far can correlation and retention go under pseudonymity?</li>
</ol>

<h2 id="14-conclusion">14. Conclusion</h2>

<p>The software consumer is changing from humans to agents, and the economic unit is
shifting from seats to callable capabilities. Before capabilities can be priced,
billed and compared, the ecosystem needs a shared measurement language — what a
selection is, what an operation is, what a delivery, a consumption, an effect and an
outcome are, and which numbers can support which conclusions.</p>

<p>AgentMeasure is that proposal: measurement semantics as infrastructure, commercial
semantics as a future extension, payment as someone else’s rails. <strong>Measure how
agents use software capabilities today; make capabilities comparable and meterable
next; build the measurement foundation for Capability as a Service in the long
term.</strong></p>

<h2 id="references">References</h2>

<ol>
  <li>RFC 2119 / BCP 14 — <em>Key words for use in RFCs to Indicate Requirement Levels</em>.</li>
  <li>OpenTelemetry GenAI semantic conventions — <code class="language-plaintext highlighter-rouge">gen_ai.*</code> tool-call telemetry fields.</li>
  <li>Model Context Protocol (MCP) specification — tool discovery and invocation surfaces.</li>
  <li>MCP Registry — server identity as the entry point for entity resolution.</li>
  <li>EDPB — guidance on pseudonymisation (pseudonymised data may still be personal data).</li>
  <li>Cloudflare — <a href="https://developers.cloudflare.com/agents/agentic-payments/x402/charge-for-mcp-tools/">Charge for MCP tools (x402 / Agentic Payments)</a>.</li>
  <li>Coinbase — <a href="https://docs.cdp.coinbase.com/x402/bazaar">x402 Bazaar: discover &amp; pay over MCP</a>.</li>
  <li>OpenAI / Stripe — Agentic Commerce Protocol (ACP), announced September 2025; see <a href="https://www.digitaltransactions.net/openai-and-stripe-are-the-latest-fintechs-to-enable-agentic-commerce/">Digital Transactions coverage</a>.</li>
  <li>AgentMeasure specification — Core, Metrics, Data, Entity, Quality, Correlation
(<code class="language-plaintext highlighter-rouge">standard/</code>); Commercial Extension (<code class="language-plaintext highlighter-rouge">extensions/COMMERCIAL.md</code>, experimental);
machine-readable registry (<code class="language-plaintext highlighter-rouge">schemas/</code>, <code class="language-plaintext highlighter-rouge">registry/</code>); reference implementation and
conformance vectors in the same repository.</li>
</ol>

<hr />

<p><em>The normative specification (Measurement Objects, Lifecycle, Metric Families,
Quality, Reporting) and the reference implementation (AgentMeasure) are published
openly. Graduation to AgentMeasure 1.0 requires two independent implementations, three
runtime profiles, two tool-side implementations, a public conformance suite with
canonical test vectors, 5–10 real projects, a published discrepancy report, and
security and privacy reviews.</em></p>]]></content><author><name>Roy.Tong</name></author><category term="en" /><category term="agent" /><category term="measurement" /><category term="capability economy" /><category term="caas" /><summary type="html"><![CDATA[As the software consumer shifts from humans to agents and the economic unit from seats to callable capabilities, measurement precedes payment. AgentMeasure proposes an open measurement foundation for CaaS — Reach → Choice → Use → Utility → Value.]]></summary></entry></feed>