Benchmarks
Numbers you can reproduce.
Every chart on this page comes from an open harness. CognoDB wins by 1-3 orders of magnitude on cold start, memory, and writes. Neo4j leads on warm centralized traversal. We don't hide our losses.
Token Efficiency
Prompt tokens per query (2K entities)
lower is betterFull-context dump
202,285 tok
Full-context dump
202,285 tok
CognoDB graph retrieval
2,668 tok
CognoDB graph retrieval
2,668 tok
Token reduction
98.7%
vs full-context baseline
Saved per query
~199,617
tokens avoided
Saved per 1K queries
~$599
at $3 / 1M input tokens
Scaling behavior
Flat
tokens bound by neighborhood
Reproduce: python bench/token_benchmark.py. Uses the real GPT-4 tokenizer (tiktoken) on a synthetic knowledge graph.
Cold start to first query (ms)
lower is betterCognoDB in-mem
7 ms
CognoDB in-mem
7 ms
CognoDB local
411 ms
CognoDB local
411 ms
MongoDB 7
1,608 ms
MongoDB 7
1,608 ms
Neo4j 5
17,051 ms
Neo4j 5
17,051 ms
Idle resident memory (MB)
lower is betterCognoDB in-mem
14.5 MB
CognoDB in-mem
14.5 MB
CognoDB local
18.1 MB
CognoDB local
18.1 MB
MongoDB 7
183 MB
MongoDB 7
183 MB
Neo4j 5
3,500 MB
Neo4j 5
3,500 MB
Write throughput (ops/sec)
higher is betterCognoDB in-mem
5,588/s
CognoDB in-mem
5,588/s
CognoDB local
2,875/s
CognoDB local
2,875/s
Neo4j 5
803/s
Neo4j 5
803/s
MongoDB 7
346/s
MongoDB 7
346/s
3-hop traversal p50 (ms) · Neo4j leads
lower is betterMongoDB
1.69 ms
MongoDB
1.69 ms
Neo4j 5
3.03 ms
Neo4j 5
3.03 ms
CognoDB in-mem
27.56 ms
CognoDB in-mem
27.56 ms
CognoDB local
108.43 ms
CognoDB local
108.43 ms
Summary scorecard
| Dimension | CognoDB | Neo4j | MongoDB | Winner |
|---|---|---|---|---|
| Cold start | 🟢 7 ms | 🔴 17 s | 🟡 1.6 s | CognoDB |
| Idle memory | 🟢 ~15 MB | 🔴 ~3.5 GB | 🟡 183 MB | CognoDB |
| Write throughput | 🟢 5,588/s | 🔴 803/s | 🔴 346/s | CognoDB |
| Warm traversal | 🟡 28 ms | 🟢 3 ms | 🟢 1.7 ms | Neo4j/Mongo |
| Warm aggregation | 🟡 78 ms | 🟢 16 ms | 🟡 34 ms | Neo4j |
| Single-binary deploy | 🟢 Yes | 🔴 No | 🔴 No | CognoDB |
| Graph-per-agent | 🟢 Trivial | 🔴 Prohibitive | 🟡 Awkward | CognoDB |
Reproduce: ./bench/run.sh. Hardware varies; the orders-of-magnitude gaps don't.