feat(ai-gateway): Forward proxy support#5264
Open
tomek-labuk wants to merge 12 commits into
Open
Conversation
✅ Deploy Preview for kongdeveloper ready!
To edit notification comments on pull requests, go to your Netlify project configuration. |
Contributor
There was a problem hiding this comment.
Pull request overview
Adds documentation for routing outbound Kong AI Gateway plugin traffic through a configured forward proxy (proxy_config), including a new reference page, cross-links, and a new AI Proxy Advanced example.
Changes:
- Added a new AI Gateway reference page describing forward proxy behavior, configuration, and limitations.
- Updated the AI Gateway landing page and Forward Proxy Advanced plugin page to cross-link the new reference.
- Added a “Forward proxy support” section to multiple AI plugin docs plus a new AI Proxy Advanced example for proxying inference traffic.
Reviewed changes
Copilot reviewed 17 out of 17 changed files in this pull request and generated 2 comments.
Show a summary per file
| File | Description |
|---|---|
| app/ai-gateway/forward-proxy.md | New reference page documenting proxy_config forward proxy support and behavior. |
| app/_landing_pages/ai-gateway.yaml | Adds a deployment-checklist link and a capability card for forward proxy support. |
| app/_kong_plugins/forward-proxy/index.md | Adds related resource link to AI Gateway forward proxy support docs. |
| app/_kong_plugins/ai-proxy-advanced/index.md | Adds a new examples group and includes the forward proxy support snippet. |
| app/_kong_plugins/ai-proxy-advanced/examples/forward-proxy.yaml | New plugin example showing proxy_config for inference traffic. |
| app/_kong_plugins/ai-semantic-cache/index.md | Adds “Forward proxy support” section via include. |
| app/_kong_plugins/ai-semantic-prompt-guard/index.md | Adds “Forward proxy support” section via include. |
| app/_kong_plugins/ai-semantic-response-guard/index.md | Adds “Forward proxy support” section via include. |
| app/_kong_plugins/ai-rag-injector/index.md | Adds “Forward proxy support” section via include. |
| app/_kong_plugins/ai-prompt-compressor/index.md | Adds “Forward proxy support” section via include. |
| app/_kong_plugins/ai-sanitizer/index.md | Adds “Forward proxy support” section via include. |
| app/_kong_plugins/ai-aws-guardrails/index.md | Adds “Forward proxy support” section via include. |
| app/_kong_plugins/ai-azure-content-safety/index.md | Adds “Forward proxy support” section via include. |
| app/_kong_plugins/ai-lakera-guard/index.md | Fixes code fence formatting and adds “Forward proxy support” section via include. |
| app/_kong_plugins/ai-gcp-model-armor/index.md | Adds “Forward proxy support” section via include. |
| app/_kong_plugins/ai-custom-guardrail/index.md | Adds “Forward proxy support” section via include. |
| app/_includes/ai-gateway/forward-proxy.md | New reusable snippet describing forward proxy support and linking to the reference page. |
Comments suppressed due to low confidence (3)
app/ai-gateway/forward-proxy.md:99
- Typo: "plugin plugin" is duplicated; remove the extra "plugin".
The Forward Proxy Advanced plugin plugin takes over the request before the balancer phase runs, which works for standard Kong Services but not with behavior that {{site.ai_gateway}} depends on: upstream load balancing, health check reporting, retries, WebSocket upgrades, and HTTP/2 request bodies.
app/ai-gateway/forward-proxy.md:202
- This page links to
/how-to/route-ai-proxy-advanced-traffic-through-forward-proxy/, but that how-to doesn't exist in the repo; add the how-to in this PR or update/remove the link to avoid a broken link.
For a complete local setup with a running forward proxy, full decK configuration, and validation steps, see [Route AI Proxy Advanced traffic through a forward proxy](/how-to/route-ai-proxy-advanced-traffic-through-forward-proxy/).
app/ai-gateway/forward-proxy.md:55
- New reference pages should be added to the AI Gateway documentation index for discoverability; add
/ai-gateway/forward-proxy/toapp/_indices/ai-gateway.yaml.
## What is forward proxy support?
| - konnect-api | ||
| - kic | ||
|
|
||
| TODO: confirm the minimum Gateway version with engineering before publishing. |
| - "[{{site.ai_gateway}} resource sizing guidelines](/ai-gateway/resource-sizing-guidelines-ai/): Review recommended resource allocation guidelines for {{site.ai_gateway}}." | ||
| - "[Deployment topologies](/gateway/deployment-topologies/): Learn about the different ways to deploy {{ site.base_gateway }}." | ||
| - "[Hosting options](/gateway/topology-hosting-options/): Decide where you want to host your Data Plane nodes, and whether you want Kong to host them or host them yourself." | ||
| - "[Route AI Proxy Advanced traffic through a forward proxy](/how-to/route-ai-proxy-advanced-traffic-through-forward-proxy/): Configure a local forward proxy and validate that {{site.ai_gateway}} traffic traverses it." |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
PR Title
Use the format
feat/fix/chore(Product): Title, for example:feat(mesh): Add transparent proxy upgrade guidefix(gateway): Correct decK example in rate limiting how-tochore(ai-gateway): Bump plugin schemachore(platform): Fix issue templaterelease: Kong Gateway 3.14Description
Fixes #4863
Adds the integrated forward proxy support for AIGW 2.0
Preview Links
Checklist
descriptionentry in frontmatter.