Skip to content

Owning DeviceBufferRef in KV Cache Manager#146

Merged
copybara-service[bot] merged 1 commit into
mainfrom
test_934398982
Jun 22, 2026
Merged

Owning DeviceBufferRef in KV Cache Manager#146
copybara-service[bot] merged 1 commit into
mainfrom
test_934398982

Conversation

@copybara-service

@copybara-service copybara-service Bot commented Jun 18, 2026

Copy link
Copy Markdown

Owning DeviceBufferRef in KV Cache Manager

@google-cla

google-cla Bot commented Jun 18, 2026

Copy link
Copy Markdown

Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

View this failed invocation of the CLA check for more information.

For the most up to date status, view the checks section at the bottom of the pull request.

@copybara-service copybara-service Bot changed the title TorchTPU can allocate a new buffer when MaterializeAndReturn is called. Fix dangling pointer for PyTorch view tensors in async operations by keeping materialized PjRtBuffer alive via DeviceBufferRef. Jun 18, 2026
@copybara-service copybara-service Bot force-pushed the test_934398982 branch 2 times, most recently from d6f8293 to 8b4702e Compare June 20, 2026 19:58
@copybara-service copybara-service Bot changed the title Fix dangling pointer for PyTorch view tensors in async operations by keeping materialized PjRtBuffer alive via DeviceBufferRef. Owning DeviceBufferRef in KV Cache Manager Jun 20, 2026
@copybara-service copybara-service Bot force-pushed the test_934398982 branch 5 times, most recently from a685f79 to c2504f8 Compare June 22, 2026 17:32
PiperOrigin-RevId: 936139591
@copybara-service copybara-service Bot merged commit ba7751b into main Jun 22, 2026
@copybara-service copybara-service Bot deleted the test_934398982 branch June 22, 2026 17:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant