Skip to content

[libneuronxla] Add support for PJRT_Client_CreateUninitializedBuffer #1302

@steeve

Description

@steeve

Describe the feature

Sadly it's not possible to use PJRT_Client_CreateUninitializedBuffer.
Still doesn't work on libneuronxla-2.2.8201.0+f46ac1ef

Use Case

This is very useful when creating KV caches.

Proposed Solution

Implement PJRT_Client_CreateUninitializedBuffer using nrt_tensor_allocate, should be fairly trivial ?

Other Information

No response

Acknowledgements

  • I may be able to implement this feature request

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions