Lians vs Mem0: benchmark and audit controls.
LoCoMo: Lians reports 92.9%; Mem0 reports 92.5%. Settings differ. A separate test covers five audit-critical invariants.
Credit first
Where mem0 is genuinely strong.
Mem0 offers strong developer experience, open source, hosted service, and a respected benchmark harness. It is a solid default for consumer personalization.
Recall quality · LOCOMO · run 2026-07-09
Current reported top-200 results: Lians 92.9, Mem0 92.5.
Regulated-memory eval · last run 2026-07-04
The five invariants.
| Regulated invariant | Lians | mem0 |
|---|---|---|
| Stale revision suppressed | pass | fail |
| Point-in-time (as-of) recall | pass | absent |
| Provable erasure (crypto-shred + cert) | pass | partial |
| Lookahead / backtest guard | pass | absent |
| Audit-state snapshot at T | pass | absent |
| Score (pass = 1, partial = ½) | 5.0 / 5 | 0.5 / 5 |
Where the lanes diverge
Different jobs, different guarantees.
Mem0 accumulates revisions and resolves updates with an LLM. It lacks event-time modeling, as-of recall, and proof-producing deletion.
The honest recommendation
Which should you pick?
Choose Mem0 for consumer personalization. Choose Lians when someone may ask what the agent knew at a past moment.
Open methodology
Mem0 has a public right of reply.
We asked Mem0 to review the configuration, evidence, and scoring in public. If a default behavior, documented capability, or result is wrong, we will rerun the adapter and correct this page.