Skip to content

Roadmap

Christian Pojoni edited this page Apr 27, 2026 · 2 revisions

Roadmap

Karta roadmap is experiment-driven. Main goal: push long-horizon memory quality beyond 90% on BEAM-style tasks by improving write-time organization, retrieval, and background reasoning.

Current baseline

  • Day 2 baseline: 51.3%.
  • P0 foundation fixes: 53.0%.
  • P1 retrieval fixes: 61.6%.
  • Target: 90%+.

High-priority retrieval work

Benchmark debug logging

Add JSONL per-question logs with full answers, rubric scores, retrieved notes, query mode, contradiction injection, timing, and dream count.

Structured temporal metadata

Store real source timestamps and turn indexes so temporal/event-ordering queries can reason over conversation order rather than ingestion time.

Contradiction force-retrieval

When a contradiction dream or contradiction-linked note is retrieved, fetch both source sides and inject them into synthesis context.

Query-type router

Classify queries into modes such as Standard, Recency, Breadth, Computation, Temporal, and Existence. Tune retrieval parameters per mode.

Better abstention behavior

Reduce false abstentions by weakening synthesis-level refusal and relying on retrieval/reranker gates plus natural-language uncertainty.

Other experiments

  • Episode narrative ordering.
  • Temporal chain links.
  • Ghost query paraphrase expansion.
  • Hybrid keyword search / SQLite FTS5.
  • Contradiction magnet links at write time.
  • Meta-instruction pinning.
  • Two-pass retrieval on abstention.

Rule

Every roadmap item should map to a benchmark failure mode and be validated against BEAM or deterministic synthetic regression tests.

Memory Layer Gaps

Priority gaps if Karta should fully match the Memory Layer / Graphify direction:

  1. Graphify-style ingestion: repo/document scanner, deterministic extractors, code entities.
  2. Generic graph query MCP tools: node/neighbor/path/subgraph queries.
  3. Graph export/import: GraphML, JSON-LD, DOT.
  4. Hypergraph support: multi-way relation model.
  5. Formal ontology adapters: RDF/OWL/SPARQL optional layer.
  6. Multimodal ingestion: PDF/OCR/audio/vision pipelines.

Clone this wiki locally