Skip to content

Commit 95fe806

Browse files
Record Daksh benchmarker outreach
1 parent 8c8f574 commit 95fe806

5 files changed

Lines changed: 67 additions & 0 deletions

File tree

marketing/README.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -164,6 +164,8 @@ Launch and outreach materials for Tree Ring Memory.
164164
adapter PR packet and validation notes.
165165
- `aleksei-agent-memory-benchmark-pr.md`: Aleksei Agent Memory Benchmark Tree
166166
Ring adapter PR packet and validation notes.
167+
- `daksh-agent-memory-benchmarker-pr.md`: Daksh Jain Agent Memory Benchmarker
168+
Tree Ring backend PR packet and validation notes.
167169
- `master-ai-finder-submission.md`: Master AI Finder free directory submission
168170
packet and accepted response notes.
169171
- `ghimiresunil-top-ai-tools-pr.md`: Top AI Tools PR packet, validation notes,
Lines changed: 62 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,62 @@
1+
# Daksh Agent Memory Benchmarker PR
2+
3+
Date: 2026-07-08
4+
5+
Status: submitted as upstream PR #1.
6+
7+
URL: https://github.com/dakshjain-1616/agent-memory-benchmarker/pull/1
8+
9+
Evidence comment: https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4917005318
10+
11+
## Fit
12+
13+
Daksh Jain's Agent Memory Benchmarker compares memory backends across common
14+
factual recall and contradiction detection tasks. Tree Ring Memory fits as an
15+
optional local backend because it exposes write, recall, and clear behavior
16+
through the public `tree-ring` CLI without requiring cloud credentials.
17+
18+
## Submission
19+
20+
The PR adds an optional Tree Ring Memory backend:
21+
22+
- `agent_memory_benchma/backends/tree_ring_backend.py` implements the local
23+
CLI-backed backend.
24+
- `tree_ring` is registered only when `tree-ring` is on `PATH` or
25+
`TREE_RING_BIN` points to a binary, so default installs retain the original
26+
backend set.
27+
- Each backend instance uses an isolated temporary Tree Ring root by default.
28+
- `TREE_RING_ROOT` can point maintainers at an explicit root; in that mode,
29+
clear removes only memories the backend instance added.
30+
- `TREE_RING_PROJECT` controls the Tree Ring project name.
31+
- Search uses direct recall plus a query-derived fallback so benchmark queries
32+
can recover fact-oriented entries without using expected answers.
33+
- README usage docs describe the optional backend and environment variables.
34+
- Tests were updated to keep the default registry stable while also accepting
35+
the optional Tree Ring backend when installed.
36+
37+
## Validation
38+
39+
- `.venv/bin/python -m compileall agent_memory_benchma`
40+
- `env -u TREE_RING_BIN PATH=/usr/bin:/bin .venv/bin/python -m pytest tests/test_backends.py::test_backend_registry_contains_all tests/test_benchmarker.py::TestBackendRegistry -q`
41+
- `TREE_RING_BIN=/Users/lazy/Projects/Tree_Ring_Memory/target/debug/tree-ring .venv/bin/python -m pytest tests/test_backends.py::test_backend_registry_contains_all tests/test_benchmarker.py::TestBackendRegistry -q`
42+
- Direct Tree Ring backend smoke: add, query, and clear passed; query returned
43+
`Alice likes cerulean blue.` with score `0.72`.
44+
- `TREE_RING_BIN=/Users/lazy/Projects/Tree_Ring_Memory/target/debug/tree-ring .venv/bin/python demo.py --mock --backends tree_ring --tasks factual_recall contradiction_detection --no-pdf --output-dir outputs-tree-ring`
45+
46+
Local demo result with the mock evaluator:
47+
48+
- Factual recall accuracy: 0.334
49+
- Contradiction detection accuracy: 0.205
50+
- Mean accuracy: 0.269
51+
- Average latency was about 30.8ms for factual recall and 23.2ms for
52+
contradiction detection.
53+
54+
These are recorded as smoke evidence for the submitted adapter, not as public
55+
leaderboard claims.
56+
57+
## GitHub State
58+
59+
- Fork: `TerminallyLazy/agent-memory-benchmarker`
60+
- Branch: `add-tree-ring-backend`
61+
- Commit: `ec0b2fe12ae10fc0bce2e353ac144bdcde625b2d`
62+
- PR state at submission: open, ready, mergeable, no status checks reported.

marketing/outreach-crm.csv

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -331,3 +331,4 @@ Vectorize Agent Memory Benchmark PR #25,3,submitted,yes,https://github.com/vecto
331331
AMBIENT Benchmark Tree Ring adapter PR #5,3,submitted,yes,https://github.com/H-XX-D/ambient-benchmark/pull/5,none,marketing/hxxd-ambient-benchmark-pr.md,monitor maintainer response,Adds Tree Ring Memory as an optional tree-ring-cli adapter with isolated roots JSON remember/recall provenance mapping policy-refusal handling and optional matrix/prereq wiring; no-dependency smoke syntax diff prereq probe and real Tree Ring focused matrix passed; PR ready mergeable with no checks reported; evidence comment https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4916634939.
332332
Lobu Agent Memory Benchmark PR #1,3,submitted,yes,https://github.com/lobu-ai/agent-memory-benchmark/pull/1,none,marketing/lobu-agent-memory-benchmark-pr.md,monitor maintainer response,Adds Tree Ring Memory as an optional public-CLI benchmark adapter with isolated roots tag-based benchmark provenance stopword-window query retry policy-refusal handling and longmemeval-oracle-10 smoke config; py_compile Bun typecheck diff check and real Tree Ring smoke passed with 95.0% retrieval recall; PR ready mergeable with no checks reported; evidence comment https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4916736562.
333333
Aleksei Agent Memory Benchmark PR #1,3,submitted,yes,https://github.com/AlekseiMarchenko/agent-memory-benchmark/pull/1,none,marketing/aleksei-agent-memory-benchmark-pr.md,monitor maintainer response,Adds Tree Ring Memory as a local CLI provider adapter with temp-root isolation cleanup query-derived fallback recall and tracked amb-results-tree-ring; npm ci build test diff check and real Tree Ring layer all run passed with Layer 1 61 Layer 2 40 and Layer 3 48.6 at 25 distractors; PR ready mergeable with no checks reported; evidence comment https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4916894140.
334+
Daksh Agent Memory Benchmarker PR #1,3,submitted,yes,https://github.com/dakshjain-1616/agent-memory-benchmarker/pull/1,none,marketing/daksh-agent-memory-benchmarker-pr.md,monitor maintainer response,Adds Tree Ring Memory as an optional local CLI backend with temp-root isolation explicit-root guarded clear query-derived fallback recall registry gating docs and tests; compileall restricted-PATH registry tests Tree Ring enabled registry tests direct add query clear smoke and mock demo passed with mean accuracy 0.269; PR ready mergeable with no checks reported; evidence comment https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4917005318.

marketing/outreach-queue.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -175,6 +175,7 @@ posted unless the post exists publicly and the URL is recorded here.
175175
| AMBIENT Benchmark Tree Ring adapter PR | Submitted | https://github.com/H-XX-D/ambient-benchmark/pull/5 | Adds Tree Ring Memory as an optional `tree-ring-cli` adapter with isolated roots, JSON `remember`/`recall`, provenance mapping, policy-refusal handling, and optional matrix/prereq wiring; no-dependency smoke, syntax, diff, prereq probe, and real Tree Ring focused matrix passed; PR is ready, mergeable, and reports no checks; evidence comment: https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4916634939. |
176176
| Lobu Agent Memory Benchmark PR | Submitted | https://github.com/lobu-ai/agent-memory-benchmark/pull/1 | Adds Tree Ring Memory as an optional public-CLI benchmark adapter with isolated roots, tag-based benchmark provenance, stopword-window query retry, and policy-refusal handling; py_compile, Bun typecheck, diff check, and real Tree Ring `longmemeval-oracle-10` smoke passed with 95.0% retrieval recall; PR is ready, mergeable, and reports no checks; evidence comment: https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4916736562. |
177177
| Aleksei Agent Memory Benchmark PR | Submitted | https://github.com/AlekseiMarchenko/agent-memory-benchmark/pull/1 | Adds Tree Ring Memory as an optional local CLI provider adapter with temp-root isolation, cleanup, query-derived fallback recall, CLI/export/docs wiring, and tracked `amb-results-tree-ring` output; npm ci, build, test, diff check, and real Tree Ring layer-all run passed with Layer 1 61/100, Layer 2 40/100, and Layer 3 48.6/100 at 25 distractors; PR is ready, mergeable, and reports no checks; evidence comment: https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4916894140. |
178+
| Daksh Agent Memory Benchmarker PR | Submitted | https://github.com/dakshjain-1616/agent-memory-benchmarker/pull/1 | Adds Tree Ring Memory as an optional local CLI backend with temp-root isolation, explicit-root guarded clear, query-derived fallback recall, registry gating, docs, and tests; compileall, restricted-PATH registry tests, Tree Ring enabled registry tests, direct add/query/clear smoke, and mock demo passed with mean accuracy 0.269; PR is ready, mergeable, and reports no checks; evidence comment: https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4917005318. |
178179
| BigAI Awesome AI Memory PR | Submitted | https://github.com/bigai-nlco/Awesome-AI-Memory/pull/2 | Adds Tree Ring Memory to System Architecture in a survey-backed AI memory directory; duplicate PR/issue search, repo link, and diff whitespace checks passed; PR is mergeable and reports no checks; evidence comment: https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4910961825. |
179180
| Kongshan Agent Memory Frameworks Research PR | Submitted | https://github.com/kongshan001/agent-memory-frameworks-research/pull/1 | Adds Tree Ring Memory to Chinese agent-memory framework research as a local-first memory lifecycle layer; duplicate PR/issue search, repo and launch-page links, public fact checks, and diff whitespace checks passed; PR is mergeable and reports no checks; evidence comment: https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4910995877. |
180181
| AlexWang Awesome Agent Memory PR | Submitted | https://github.com/AlexWang959/Awesome-Agent-Memory/pull/2 | Adds Tree Ring Memory to the 2026 Paper / Project table as a GitHub project for local-first agent memory lifecycle work; duplicate PR/issue search, table-shape check, and diff whitespace passed; PR is mergeable and reports no checks; evidence comment: https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4911129545. |

marketing/submission-ledger.csv

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -333,3 +333,4 @@ Vectorize Agent Memory Benchmark PR #25,submitted,GitHub account,https://github.
333333
AMBIENT Benchmark Tree Ring adapter PR #5,submitted,GitHub account,https://github.com/H-XX-D/ambient-benchmark/pull/5,marketing/hxxd-ambient-benchmark-pr.md,none,monitor maintainer response,https://github.com/H-XX-D/ambient-benchmark/pull/5,Adds Tree Ring Memory as an optional tree-ring-cli adapter with isolated Tree Ring roots JSON remember/recall provenance mapping policy-refusal handling and optional matrix/prereq wiring; fork TerminallyLazy/ambient-benchmark branch add-tree-ring-adapter commit c51423c; no-dependency smoke syntax diff prereq probe and real Tree Ring focused matrix passed; PR ready mergeable with no checks reported; evidence comment https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4916634939.
334334
Lobu Agent Memory Benchmark PR #1,submitted,GitHub account,https://github.com/lobu-ai/agent-memory-benchmark/pull/1,marketing/lobu-agent-memory-benchmark-pr.md,none,monitor maintainer response,https://github.com/lobu-ai/agent-memory-benchmark/pull/1,Adds Tree Ring Memory as an optional public-CLI benchmark adapter with isolated roots tag-based benchmark provenance stopword-window query retry policy-refusal handling and a longmemeval-oracle-10 smoke config; fork TerminallyLazy/agent-memory-benchmark-1 branch add-tree-ring-adapter commit 46388ce; py_compile Bun typecheck diff check and real Tree Ring smoke passed with 95.0% retrieval recall; PR ready mergeable with no checks reported; evidence comment https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4916736562.
335335
Aleksei Agent Memory Benchmark PR #1,submitted,GitHub account,https://github.com/AlekseiMarchenko/agent-memory-benchmark/pull/1,marketing/aleksei-agent-memory-benchmark-pr.md,none,monitor maintainer response,https://github.com/AlekseiMarchenko/agent-memory-benchmark/pull/1,Adds Tree Ring Memory as a local CLI provider adapter with temp-root isolation cleanup query-derived fallback recall and tracked amb-results-tree-ring; fork TerminallyLazy/agent-memory-benchmark-aleksei branch add-tree-ring-adapter commit 9357ab3; npm ci build test diff check and real Tree Ring layer all run passed with Layer 1 61 Layer 2 40 and Layer 3 48.6 at 25 distractors; PR ready mergeable with no checks reported; evidence comment https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4916894140.
336+
Daksh Agent Memory Benchmarker PR #1,submitted,GitHub account,https://github.com/dakshjain-1616/agent-memory-benchmarker/pull/1,marketing/daksh-agent-memory-benchmarker-pr.md,none,monitor maintainer response,https://github.com/dakshjain-1616/agent-memory-benchmarker/pull/1,Adds Tree Ring Memory as an optional local CLI backend with temp-root isolation explicit-root guarded clear query-derived fallback recall registry gating docs and tests; fork TerminallyLazy/agent-memory-benchmarker branch add-tree-ring-backend commit ec0b2fe; compileall restricted-PATH registry tests Tree Ring enabled registry tests direct add query clear smoke and mock demo passed with mean accuracy 0.269; PR ready mergeable with no checks reported; evidence comment https://github.com/TerminallyLazy/Tree-Ring-Memory/issues/26#issuecomment-4917005318.

0 commit comments

Comments
 (0)