diff --git a/docs/drift-detection.html b/docs/drift-detection.html index 46903a2..0a9cf79 100644 --- a/docs/drift-detection.html +++ b/docs/drift-detection.html @@ -281,20 +281,92 @@
# Set API keys for providers you want to test
-export OPENAI_API_KEY=sk-...
-export ANTHROPIC_API_KEY=sk-ant-...
-export GOOGLE_API_KEY=AI...
-
-# Run all drift tests
-pnpm test:drift
+
-# Run for a specific provider
-pnpm test:drift -- --grep "OpenAI Chat"
+
+ - Daily CI validation against real APIs. Know immediately when provider behavior changes - break your fixtures. -
+Fixtures stay accurate as providers evolve. Fixes ship before your tests break.
- aimock's drift detection runs daily against live provider APIs. When response formats - change, you know immediately — not when your tests break in production. + LLM providers change their response formats without warning. aimock catches it within 24 + hours and ships the fix before your tests break.
- Daily CI hits actual OpenAI, Anthropic, Gemini endpoints to capture current response - formats. + Daily CI hits actual OpenAI, Anthropic, Gemini endpoints to detect response format + changes.
- Compares real responses against aimock's fixture format. Schema changes are caught - instantly. + Response schemas are validated against aimock's builders. Any drift is flagged + automatically.
- Drift detected → PR opened → fixtures, skills, and docs updated - automatically. Zero manual effort. + Drift detected → fixtures, builders, skills, and docs updated → PR shipped. + Always current, within a day.