phase 2 single provider

Phase 2 — Decision Log

Quick decisions during Phase 2. Promote durable choices to `docs/adr/` when they affect multiple phases.

Phase 2 — Decision Log

Quick decisions during Phase 2. Promote durable choices to docs/adr/ when they affect multiple phases.

DateDecisionRationaleADR
TBDLLM provider abstraction (provider.Provider, registry)Phase 4 multi-provider without rewriting proxy handlersADR-0022 — Pending
TBDOpenAI HTTP client, pooling, retry policyProduction-grade forwarding for first providerADR-0023 — Pending
TBDStreaming dual-write and backpressureReal-time SSE without buffering full body on hot pathADR-0024 — Pending
TBDAuth LRU + bloom filter cacheMeet <20ms proxy overhead under loadADR-0025 — Pending
TBDToken revocation propagation SLACache correctness vs performance (5s Phase 2 target)ADR-0026 — Pending
TBDDirective immutable versioningSafe cache invalidation without lost updatesADR-0027 — Pending
TBDSystem prompt injection orderingDirective precedes caller system messageADR-0028 — Pending
TBDSession and checkpoint data modelFoundation for Phase 3 memory extractionADR-0029 — Pending
TBDClickHouse trace schema and retentionAnalytics backbone without hot-path blockingADR-0030 — Pending
TBDProxy overhead measurement methodologyReproducible p99 benchmark for exit gateADR-0031 — Pending
2026-06-05Auth cache required in Phase 2 (not optional)Phase 2 latency budget impossible with per-request gRPC onlySee phase-1 decisions

Pending decisions (resolve during milestones)

  1. OpenAI API base URL — default https://api.openai.com/v1; document override for Azure in Phase 4.
  2. ClickHouse deployment in dev — compose service vs external; document in ENVIRONMENT_VARIABLES.md at 2.5.2.
  3. E2E smoke OpenAI key — sandbox key in CI secrets vs skipped required check (resolve in 2.6.2).

Log pivots in FINDINGS.md.

← Back to roadmap overview
Edit on GitHub

Last updated on

PreviousPhase 2 — GoalsNextPhase 2 — Risks and Mitigations

On this page

0%