Skip to content

LLMObs annotationContext params are incorrect #34672

@dylanmoz

Description

@dylanmoz

Documentation Page

https://docs.datadoghq.com/llm_observability/instrumentation/sdk/?tab=nodejs#annotating-auto-instrumented-spans

Issue Description

Image

The document arguments do not include the prompt field.

Under prompt tracking, the field is included in the example, but the shape is incorrect, chat_template is not a allowed field

https://docs.datadoghq.com/llm_observability/instrumentation/sdk/?tab=nodejs#prompt-tracking

https://github.com/DataDog/dd-trace-js/blob/7dad226373cb171e896418dd0f5ca55df312fc3f/index.d.ts#L3356

Also, the link to hallucination doesn't go to a specific anchor: https://docs.datadoghq.com/llm_observability/evaluations/managed_evaluations/?tab=openai#hallucination

Image

@urseberry

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions