feat: add activity dashboard and live telemetry

Author: jcaose

bun.lock

@@ -0,0 +1,125 @@
+# Logbook
+
+This branch was backfilled against `master`, which is the default branch in this repo. There is no local `main` branch.
+
+- Branch point: `0ea08fe` (`chore: release v0.7.0`)
+- Backfill window: 2026-03-08 through 2026-03-16
+- Current head at backfill time: `641fb1e` (`Fix Bun streaming request timeouts`)
+- Net branch diff vs `master`: 29 files changed, 2659 insertions, 33 deletions
+
+## 2026-03-08
+
+### Responses API support and model-level routing
+
+Commits:
+
+- `42214b8` `feat: port PR #205 — Responses API support and model-level routing`
+- `b188c93` `fix: address review issues in Responses API implementation`
+- `e408560` `feat: add gpt-5.4 with full level support via Responses API`
+- `26cbf7f` `chore: update bun.lock`
+
+What changed:
+
+- Added OpenAI Responses API endpoints at `/responses` and `/v1/responses`.
+- Added upstream Responses client support in `src/services/copilot/create-responses.ts`.
+- Added translation between chat completions and responses models in `src/routes/chat-completions/responses-translation.ts`.
+- Introduced model-level routing in `src/lib/model-level.ts`, including support for level suffixes and `gpt-5.4`.
+- Updated model listing and routing so Responses-capable models are exposed and handled correctly.
+- Followed up with review fixes and a lockfile refresh.
+
+### Request and session usage logging
+
+Commits:
+
+- `8f115dc` `feat: add per-request and session usage logging`
+- `716170c` `feat: include thinking level in request log`
+- `d77b3aa` `fix: pick up thinking level from reasoning_effort/reasoning.effort fields`
+- `4cb8bca` `fix: pick up reasoning.effort level in responses route`
+
+What changed:
+
+- Added `src/lib/request-log.ts` to centralize request accounting.
+- Extended `src/lib/state.ts` with per-model session usage counters.
+- Logged token usage for chat completions, Anthropic messages, and Responses API flows.
+- Added thinking/reasoning level extraction so usage logs reflect `reasoning_effort` and `reasoning.effort`.
+- Tightened the Responses route so it records reasoning level consistently.
+
+## 2026-03-14
+
+### Opt-in proxy exchange capture
+
+Commits:
+
+- `eac1024` `feat: add opt-in proxy exchange capture`
+- `5647f81` `Merge branch 'feat/proxy-exchange-capture' into dev`
+
+What changed:
+
+- Added `--capture` and `--capture-path` to the `start` command in `src/start.ts`.
+- Added `src/lib/exchange-capture.ts` to persist request/response exchanges as JSONL.
+- Captures include request metadata, upstream IDs, request bodies, response bodies, and token usage across chat, embeddings, messages, and responses routes.
+- Added redaction of sensitive values before persistence.
+- Added automatic gzip compression for older daily capture files under the default capture directory.
+- Added supporting path/state plumbing in `src/lib/paths.ts`, `src/lib/state.ts`, and `src/lib/upstream-trace.ts`.
+- Documented the feature in `README.md` and the RFC at `docs/rfcs/opt-in-proxy-exchange-capture.md`.
+- Added focused test coverage in `tests/exchange-capture.test.ts`.
+
+## 2026-03-16
+
+### SSE forwarding hardening
+
+Commit:
+
+- `9e2a4e6` `Harden SSE stream forwarding`
+
+What changed:
+
+- Added `src/lib/sse.ts` to normalize and forward upstream SSE frames safely.
+- Fixed handling for metadata-only SSE events so events without `data` do not crash or get dropped incorrectly.
+- Hardened streaming behavior in chat completions and responses handlers.
+- Added test coverage in `tests/responses-route-stream.test.ts` and `tests/sse.test.ts`.
+
+### Bun streaming request timeout handling
+
+Commit:
+
+- `641fb1e` `Fix Bun streaming request timeouts`
+
+What changed:
+
+- Added startup-side idle-timeout parsing and validation in `src/start.ts`.
+- Corrected the configurable Bun idle-timeout range to `0-255`.
+- Added `src/lib/request-timeout.ts` to disable Bun request timeouts on streaming requests.
+- Applied per-request timeout disabling for streaming chat completions, Anthropic messages, and Responses API routes.
+- Documented the timeout behavior in `README.md`.
+- Added tests in `tests/request-timeout.test.ts` and `tests/start-idle-timeout.test.ts`.
+
+## 2026-03-17
+
+### Activity dashboard and telemetry hardening
+
+What changed:
+
+- Added a built-in activity dashboard at `/dashboard` with summary cards, quota snapshots, a full-width live log, and a locally served Chart.js history plot.
+- Added a SQLite-backed dashboard telemetry store with backfill from persisted JSONL and gzipped capture files plus an SSE live event stream.
+- Captured telemetry for chat completions, Anthropic messages, Responses API, and embeddings, including completed requests, upstream errors, proxy errors, and client aborts.
+- Changed the history chart to stacked bars by base model so hourly, daily, weekly, and monthly buckets are visible in one plot with a legend.
+- Moved dashboard controls into the history panel and removed the separate by-model pane in favor of the chart breakdown.
+- Replaced the default Hono request logger with `consola` request start/finish lines to align terminal logging with the existing session token logs.
+- Hardened dashboard telemetry persistence so SQLite I/O failures degrade the dashboard store to in-memory mode instead of breaking proxied requests.
+- Added dashboard coverage in `tests/dashboard.test.ts`, including API aggregation, backfill, live stream, and local chart asset checks.
+
+## Commit Trail
+
+- `42214b8` 2026-03-08 `feat: port PR #205 — Responses API support and model-level routing`
+- `b188c93` 2026-03-08 `fix: address review issues in Responses API implementation`
+- `e408560` 2026-03-08 `feat: add gpt-5.4 with full level support via Responses API`
+- `8f115dc` 2026-03-08 `feat: add per-request and session usage logging`
+- `716170c` 2026-03-08 `feat: include thinking level in request log`
+- `d77b3aa` 2026-03-08 `fix: pick up thinking level from reasoning_effort/reasoning.effort fields`
+- `4cb8bca` 2026-03-08 `fix: pick up reasoning.effort level in responses route`
+- `26cbf7f` 2026-03-08 `chore: update bun.lock`
+- `eac1024` 2026-03-14 `feat: add opt-in proxy exchange capture`
+- `5647f81` 2026-03-14 `Merge branch 'feat/proxy-exchange-capture' into dev`
+- `9e2a4e6` 2026-03-16 `Harden SSE stream forwarding`
+- `641fb1e` 2026-03-16 `Fix Bun streaming request timeouts`

logbook.md

@@ -40,6 +40,7 @@
     "*": "bun run lint --fix"
   },
   "dependencies": {
+    "chart.js": "^4.5.1",
     "citty": "^0.1.6",
     "clipboardy": "^5.0.0",
     "consola": "^3.4.2",

package.json

@@ -11,5 +11,6 @@ export const awaitApproval = async () => {
     throw new HTTPError(
       "Request rejected",
       Response.json({ message: "Request rejected" }, { status: 403 }),
+      "proxy",
     )
 }