Describe the feature
Sadly it's not possible to use PJRT_Client_CreateUninitializedBuffer.
Still doesn't work on libneuronxla-2.2.8201.0+f46ac1ef
Use Case
This is very useful when creating KV caches.
Proposed Solution
Implement PJRT_Client_CreateUninitializedBuffer using nrt_tensor_allocate, should be fairly trivial ?
Other Information
No response
Acknowledgements
Describe the feature
Sadly it's not possible to use
PJRT_Client_CreateUninitializedBuffer.Still doesn't work on
libneuronxla-2.2.8201.0+f46ac1efUse Case
This is very useful when creating KV caches.
Proposed Solution
Implement
PJRT_Client_CreateUninitializedBufferusingnrt_tensor_allocate, should be fairly trivial ?Other Information
No response
Acknowledgements