Skip to content

feat(ai-guard): enable tag probabilities test#6698

Open
manuel-alvarez-alvarez wants to merge 2 commits intomainfrom
malvarez/ai-guard-tag-probs-java
Open

feat(ai-guard): enable tag probabilities test#6698
manuel-alvarez-alvarez wants to merge 2 commits intomainfrom
malvarez/ai-guard-tag-probs-java

Conversation

@manuel-alvarez-alvarez
Copy link
Copy Markdown
Member

Motivation

Next version of the java tracer will expose tag probabilities in the SDK responses.

Changes

Enables the related tests in the java tracer.

Workflow

  1. ⚠️ Create your PR as draft ⚠️
  2. Work on you PR until the CI passes
  3. Mark it as ready for review
    • Test logic is modified? -> Get a review from RFC owner.
    • Framework is modified, or non obvious usage of it -> get a review from R&P team

🚀 Once your PR is reviewed and the CI green, you can merge it!

🛟 #apm-shared-testing 🛟

Reviewer checklist

  • Anything but tests/ or manifests/ is modified ? I have the approval from R&P team
  • A docker base image is modified?
    • the relevant build-XXX-image label is present
  • A scenario is added, removed or renamed?

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 8, 2026

CODEOWNERS have been resolved as:

manifests/java.yml                                                      @DataDog/asm-java @DataDog/apm-java
utils/build/docker/java/spring-boot/src/main/java/com/datadoghq/system_tests/springboot/ai_guard/AIGuardController.java  @DataDog/apm-java @DataDog/asm-java @DataDog/system-tests-core

@datadog-prod-us1-6
Copy link
Copy Markdown

datadog-prod-us1-6 bot commented Apr 10, 2026

⚠️ Tests

Fix all issues with BitsAI or with Cursor

⚠️ Other Violations

🧪 1 Test failed

tests.ai_guard.test_ai_guard_sdk.Test_Tag_Probabilities.test_tag_probabilities[spring-boot] from system_tests_suite   View in Datadog   (Fix with Cursor)
AssertionError: 'tag_probs' not found in '{'action': 'DENY', 'reason': 'Rule matches: destructive-tool-call', 'tags': ['destructive-tool-call'], 'sds': []}'
assert 'tag_probs' in {'action': 'DENY', 'reason': 'Rule matches: destructive-tool-call', 'sds': [], 'tags': ['destructive-tool-call']}

self = <tests.ai_guard.test_ai_guard_sdk.Test_Tag_Probabilities object at 0x7f21482d38f0>

    def test_tag_probabilities(self):
        """Test AI Guard returns and stores tag probabilities.
        Verifies the SDK response exposes tag probabilities and the ai_guard meta struct keeps the
        same probability map received from the AI Guard REST API.
        """
...

ℹ️ Info

No other issues found (see more)

❄️ No new flaky tests detected

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 7751078 | Docs | Datadog PR Page | Was this helpful? React with 👍/👎 or give us feedback!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants