Project report / GitHub evidence

STATE-Bench Model Card

这是可索引项目报告证据页:它保留 STATE-Bench Model Card 的源材料入口、机制线索和限制提醒;正文仍需 reader/editor 与 academic public-copy review 后才能当作最终结论引用。

STATE-Bench Model Card

FieldValue
Repositorymicrosoft/STATE-Bench
CategoryStateful Agent Memory Benchmark
Stars / forks snapshot25 / 3
LanguagePython
LicenseMIT
Raw captureraw-github/microsoft_state-bench.md
Updated byhourly public metadata update, 2026-05-25

1. Role in Self Evolve

STATE-Bench 是 Microsoft 发布的 stateful agent task evaluation benchmark,用三类企业任务评估 memory 是否改善 agent 的可靠性、效率和多步执行。

2. Working Principle

enterprise task suite -> sandbox database/tools/user simulator -> stateful agent execution -> deterministic assertions -> memory impact metrics

3. Evidence Path

web GitHub page observed 41 commits, MIT license, Python 100% stack, release v0.5.0 latest May 22 2026, 25 stars and 3 forks; README states 450 enterprise tasks across travel, customer support, and shopping assistant domains with sandbox database, tools, simulated user, and procedure/state assertions. Shell GitHub API access remained blocked by DNS and local gh auth was invalid, so this card treats the current snapshot as web-observed rather than API-verified.

4. Teaching Use

Use this card to explain Stateful Agent Memory Benchmark in the raw -> classification -> project card -> site/report pipeline. The reading path is: raw capture -> classification row -> public site card -> project report -> aggregate GitHub analysis.

5. Limits

当前未克隆源码,未运行 benchmark、SDK examples、skill install flows、memory experiments、agent evolution loops 或 production deployments;star/fork/commit 快照来自公开 GitHub 页面文本或可见页面片段。