Phase 4 — Goals

Track A — Management API Server

Milestones:

4.A.1 — API server skeleton: FastAPI, auth middleware via gRPC ValidateToken, stable error envelope, SET LOCAL app.org_id per transaction for RLS.
4.A.2 — Organization and user management: Full CRUD. Org suspension propagates to proxy auth cache within 5s. Last-owner-cannot-be-demoted invariant.
4.A.3 — Agent management: 8 endpoints (list/create/get/patch/delete/activate/pause/archive). default_provider and default_model fields.
4.A.4 — Token management: Scoped permission strings, plaintext shown once on creation, optional IP CIDR restriction, revocation via AuthService.RevokeToken.
4.A.5 — Provider credential management (new): Org-scoped, envelope-encrypted credentials. Validate-before-store. Proxy reads via AuthService.GetProviderCredential gRPC. Platform-default fallback.

Acceptance criteria:

Milestones:

4.B.1 — Lua-based atomic hierarchical limiter: Single Lua script checks agent → org → global in one round trip. EVALSHA with NOSCRIPT fallback. Monthly token-spend ceiling post-response.
4.B.2 — Rate limit configuration API: Per-org/agent RPM and token budget overrides. Dashboard usage endpoint.
4.B.3 — Load and correctness benchmark: 200 concurrent goroutines, limit=100: exactly 100 succeed, 100 return 429. Zero over-admission.

Acceptance criteria:

RateLimiter interface signature unchanged (validates Phase 1 interface design)
Concurrency test proves zero over-admission
Fail-open on Redis outage preserved

Milestones:

4.C.1 — Anthropic adapter hardening: Promote Phase 2.5 prototype to production parity. Full SSE dual-write, message-role translation.
4.C.2 — Per-org model routing: Registry.ForOrg(ctx, orgID, model). Allow/deny list in Postgres, cached via bloom→LRU.
4.C.3 — Circuit breaker per provider: Rolling error-rate window (30s, >50% failure trips open). Per-provider isolation. New packages/circuitbreaker.
4.C.4 — Fallback routing (new): On breaker-open, transparently reroute to fallback model. Opt-in per org. X-IBEX-Provider-Fallback header. Traced to ClickHouse.
4.C.5 — Streaming hardening: Slow-client backpressure. Mid-stream Anthropic error event and OpenAI connection drop both produce the same client behavior.

Acceptance criteria:

Golden-fixture parity tests green for both providers in CI
Circuit breaker trips on sustained 60% error rate, half-open probe recovers correctly
Fallback only triggers when org config explicitly enables it (default-off)
No regression in Phase 1–3.5 suites with 2 providers registered

Milestones:

4.D.1 — Dashboard foundation: JWT session + httpOnly refresh. Permission bitmap RBAC. SSE for trace/alert streams. Full nav from UI_UX_GUIDELINES.md §3.
4.D.2 — Trace inspector ("Why did my agent do that?"): 6-section layout per UX spec. Score breakdown per memory with per-category weight vectors.
4.D.3 — Memory browser v2: Flat table + relationship graph view (node-link). GDPR export/delete workflow surfaced in UI.
4.D.4 — Drift alerts and directive management: Alert grouping, severity badges, small-multiples feature drift charts. Directive version timeline, diff viewer, promotion workflow, emergency revoke with MFA.
4.D.5 — Analytics v2 (cost governance): Budget alert configuration. Per-agent spend cap (soft=alert, hard=pause agent). Usage/latency charts retained.

Acceptance criteria:

Milestones:

4.E.1 — Dashboard E2E test suite (Playwright): 6 spec files covering auth, RBAC, agents, memory browser, trace inspector, rate limits, accessibility. All 4 roles tested.
4.E.2 — Multi-provider resilience integration suite: Circuit breaker, half-open probe, fallback routing, mid-stream disconnect tests.
4.E.3 — Phase 4 gap register and exit audit: Severity-tiered (P0–P3), same format as Phase 1 exit audit.

Acceptance criteria: