Add outbox-json protocol with per-row topic dispatch for Kafka sinks POC#4340

Open

benmeadowcroft wants to merge 16 commits intopingcap:masterfrom

benmeadowcroft:outbox-support

Commits on Mar 13, 2026

config,api: add outbox-json protocol and sink.outbox config
benmeadowcroft
committed
eventrouter,columnselector: support row-topic column placeholders
benmeadowcroft
committed
kafka,pulsar: route rows by row topic and track discovered topics
benmeadowcroft
committed
codec,kafka: add outbox encoder and header propagation
benmeadowcroft
committed
eventrouter,columnselector: avoid perf issues when not using column values, improved logs
benmeadowcroft
committed
integration_tests: add integration tests for outbox functionality with Kafka
benmeadowcroft
committed
codec: removed unnecessary fallback output
benmeadowcroft
committed
sink, config: Address failed Docstring Coverage check by adding additional comments
benmeadowcroft
committed
sink, config: centralized handling of outbox-json required columns to address review comments
benmeadowcroft
committed
codec: Invoke callback when non-insert rows are skipped

benmeadowcroft
and
coderabbitai[bot]
committed
codec: small defensive code improvement

benmeadowcroft
and
coderabbitai[bot]
committed
eventrouter, sink: avoid per-row topic and partition lookups for static rules
benmeadowcroft
committed
sink: evict stale discoveredRowTopics after 30 minutes
benmeadowcroft
committed
config: normalize and validate outbox-json columns in config
benmeadowcroft
committed
eventrouter, sink: scope checkpoint fanout correctly
benmeadowcroft
committed
config: refactor outbox column normalization and validation logic
benmeadowcroft
committed