Skip to content

feat: implement StreamManager for gRPC subscription management #985

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
thlorenz wants to merge 75 commits into
base: master
Choose a base branch
from
+2,095 −395
Draft

feat: implement StreamManager for gRPC subscription management #985

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
75 commits
Select commit Hold shift + click to select a range
9973fb2
chore: add persub limit option to pubsub config
thlorenz Feb 6, 2026
93cf550
feat: initial pool impl using pubsub client trait
thlorenz Feb 6, 2026
0c21aa8
chore: extract pubsub connection to separate module
thlorenz Feb 6, 2026
43d9b7a
test: add mock PubsubConnection and make pool generic
thlorenz Feb 6, 2026
bb2b31d
chore: account sub tests for pool
thlorenz Feb 7, 2026
f220952
test: add comprehensive tests for pubsub pool account and program sub…
thlorenz Feb 7, 2026
50a86bd
chore: fix overkill and incomplete error conversion
thlorenz Feb 7, 2026
4512806
chore: prevent multi connection creation race condition
thlorenz Feb 7, 2026
29158ee
chore: reconnect pubsub pool on recovery
thlorenz Feb 7, 2026
ec5073a
refactor: extract subscribe logic to helper method
thlorenz Feb 7, 2026
a37d798
chore: harden pubsub reconnect to ensure all existing subs are closed
thlorenz Feb 9, 2026
5c4a206
feat: add pubsub_client_connections_gauge metric
thlorenz Feb 9, 2026
5c98860
fix: fmt
thlorenz Feb 9, 2026
0179218
Merge branch 'master' into thlorenz/websocket-pool-conections
thlorenz Feb 9, 2026
58089c8
tmp: dial down max subs per connection
thlorenz Feb 10, 2026
6bb8e0d
chore: fix unsub bug
thlorenz Feb 10, 2026
02f3dd8
chore: subscriptions fn returns hashset
thlorenz Feb 11, 2026
b8ba3e7
chore: subs union
thlorenz Feb 11, 2026
72ce021
chore: introducing union/intersection
thlorenz Feb 12, 2026
4dd13c0
chore: laser client has access to shared subscriptions
thlorenz Feb 12, 2026
4d823e7
chore: all clients return subs (instead option)
thlorenz Feb 12, 2026
06a4f67
chore: optimize set intersection method for submux
thlorenz Feb 12, 2026
c3d5329
feat: reconciler considers union vs. intersection of subscriptions
thlorenz Feb 12, 2026
230328f
chore: test reconciler
thlorenz Feb 12, 2026
5e1668a
chore: move previously existint reconciler tests to same module
thlorenz Feb 12, 2026
4047bdc
chore: fix bug in reconciler logic
thlorenz Feb 12, 2026
940db38
chore: no more reconciliation outside reconciler
thlorenz Feb 12, 2026
cc75e15
Merge branch 'master' into thlorenz/websocket-pool-conections
thlorenz Feb 12, 2026
35e31a8
chore: fmt + lint
thlorenz Feb 12, 2026
5253d66
chore: remove subscription_count method
thlorenz Feb 12, 2026
bf4a759
Merge branch 'thlorenz/websocket-pool-conections' into thlorenz/pool+…
thlorenz Feb 12, 2026
41f2040
Merge branch 'master' into thlorenz/websocket-pool-conections
thlorenz Feb 13, 2026
b8df74e
Merge branch 'master' into thlorenz/pool+better-reconciler
thlorenz Feb 13, 2026
0e3810d
chore: fmt
thlorenz Feb 13, 2026
46f1a1c
Merge branch 'thlorenz/websocket-pool-conections' into thlorenz/pool+…
thlorenz Feb 13, 2026
cdee786
fix: lint
thlorenz Feb 13, 2026
2d280a5
fix: fmt
thlorenz Feb 13, 2026
7ec483a
chore: fix coderabbits
thlorenz Feb 13, 2026
d401b8c
chore: fix import
thlorenz Feb 13, 2026
d7bd7a9
chore: remove read/write lock with potential race condition
thlorenz Feb 13, 2026
db8480d
ci: attempt to fix protoc discovery
thlorenz Feb 13, 2026
c41ddb4
tmp: remove non-problemeatic workflows for quicker triaging
thlorenz Feb 13, 2026
2afd9a1
ci: bust cache
thlorenz Feb 13, 2026
486e44d
Merge branch 'master' into thlorenz/websocket-pool-conections
thlorenz Feb 13, 2026
ec54854
Merge branch 'master' into thlorenz/pool+better-reconciler
thlorenz Feb 13, 2026
e3b3f04
Revert "tmp: remove non-problemeatic workflows for quicker triaging"
thlorenz Feb 13, 2026
0aeb168
Merge branch 'thlorenz/websocket-pool-conections' into thlorenz/pool+…
thlorenz Feb 13, 2026
a0a8fd8
chore: abstract stream factory to later test stream management
thlorenz Feb 13, 2026
5d58665
chore: make StreamFactory proper generic to avoid perf overhead
thlorenz Feb 16, 2026
00ff5c8
refactor: extract stream management into StreamManager
thlorenz Feb 16, 2026
ea5f62c
chore: prep new account subscribe
thlorenz Feb 16, 2026
c99b2fc
chore: initial tests
thlorenz Feb 16, 2026
64eff4e
chore: pass initial set of tests
thlorenz Feb 16, 2026
cca4244
chore: add remaining tests (not passing)
thlorenz Feb 16, 2026
2df5ea6
feat: initial impl to get all tests to pass
thlorenz Feb 16, 2026
2ea0e9c
chore: minor cleanup
thlorenz Feb 16, 2026
bf48eee
chore: minor cleanup and clarifications
thlorenz Feb 17, 2026
b2990a6
chore: prep to include handle in subscribe return
thlorenz Feb 17, 2026
613768e
chore: stream handle test integration
thlorenz Feb 17, 2026
67ba602
Merge branch 'master' into thlorenz/pool+better-reconciler+grpc-gener…
thlorenz Feb 17, 2026
da4c6e7
chore: operate on full streams with handles
thlorenz Feb 17, 2026
38f5a12
chore: remove unnecessary phantom data
thlorenz Feb 19, 2026
93bb3ac
chore: current subs updated via write to channel
thlorenz Feb 19, 2026
fabc155
chore: adding retry logic to sub write
thlorenz Feb 19, 2026
a0c6116
chore: bubble errors from account_subscribe
thlorenz Feb 19, 2026
c8fd9da
chore: minor clarification
thlorenz Feb 19, 2026
26a6f51
chore: program subs reuse stream via handle write
thlorenz Feb 19, 2026
558a1ae
chore: support account sub from_slot in stream manager
thlorenz Feb 19, 2026
e7e9188
chore: initial stream manager integration with some problems
thlorenz Feb 19, 2026
84bfa2b
chore: single subscriptions source in stream manager
thlorenz Feb 19, 2026
ceeaafd
chore: separate handles from streams to allow polling streammap
thlorenz Feb 19, 2026
45d7261
chore: add next_update tests
thlorenz Feb 19, 2026
22414b3
chore: fmt
thlorenz Feb 19, 2026
e940542
chore: remove dead_code
thlorenz Feb 19, 2026
6f95bd6
Merge branch 'master' into thlorenz/grpc-generational
thlorenz Feb 19, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading