Skip to content

docs: clarify circuit breakers do not handle concurrency - #1151

Merged
akhilmmenon merged 3 commits into
mainfrom
enhancement/AIRSAIGW-568042
Nov 9, 2026
Merged

akhilmmenon merged 3 commits into
mainfrom
enhancement/AIRSAIGW-568042

Conversation

@akhilmmenon

@akhilmmenon akhilmmenon commented Nov 2, 2026 •

Copy link
Copy Markdown
Member

Summary

  • Adds a "Circuit Breakers and Concurrency" section and an intro note to the Circuit Breaker doc (both product/ and aigw/product/ copies).
  • Explains that circuit breakers are failure-based, not a concurrency control, and that concurrency in a config + fallback setup is outside their scope.
  • Points users to rate limits, load balancing and fallbacks for managing load.

Ref

Asana: https://app.asana.com/1/11915891072957/project/1218257019223874/task/1219806424568042

@mintlify

mintlify Bot commented Nov 2, 2026 •

Copy link
Copy Markdown
Contributor

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated
portkey-docs 🟢 Ready View Preview Nov 9, 2026, 10:07 AM

💡 Tip: Enable Automations to automatically generate PRs for you.

Copilot AI balanced review requested due to automatic review settings November 2, 2026 11:15
@akhilmmenon akhilmmenon self-assigned this Nov 2, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Approval recommended

No active review issues require resolution for the circuit-breaker documentation clarification.

No open issues 🎉

What changed in this PR

Clarifies in both Portkey and Prisma AIRS documentation that circuit breakers respond to failures, not concurrent request counts.

Changes:

  • Adds an introductory note and a dedicated concurrency section.
  • Explains how load-related failures, such as configured 429 responses, can trigger a circuit breaker.
  • Links to rate limits, load balancing, and fallbacks for managing load.
File Description
product/​ai-gateway/​circuit-breaker.mdx Explains circuit breaker concurrency limits and links to load-management controls.
aigw/​product/​ai-gateway/​circuit-breaker.mdx Mirrors the clarification with Prisma AIRS-specific documentation links.

Review effort: Balanced

@akhilmmenon akhilmmenon closed this Nov 4, 2026
@akhilmmenon akhilmmenon reopened this Nov 4, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Approval recommended

No active review issues are reported for the circuit-breaker documentation clarifications.

No open issues 🎉

Review effort: Balanced

@itsthusharashenoi itsthusharashenoi left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me.

@akhilmmenon
akhilmmenon merged commit 95e2574 into main Nov 9, 2026
4 checks passed

This branch was successfully deployed

1 active deployment
staging — e922b419 Deployed Nov 9, 2026 by mintlify[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants