[kafka] Transcode mapped raw and string records to Arrow - #4285

Draft

gyang94 wants to merge 11 commits into

apache:mainfrom

gyang94:codex/kafka-raw-string-transcode

Commits on Sep 16, 2026

[kafka] Add request dispatch and transport framework

gyang94
and
codex
committed
7f42619
[kafka] Complete dispatcher futures when error mapping fails

gyang94
and
codex
committed
c557efc
[kafka] Serve ApiVersions from registered capabilities

gyang94
and
codex
committed
5742b36

Commits on Sep 17, 2026

[kafka] Define DDL table mapping for Kafka compatibility

gyang94
and
codex
committed
d72a3bc
[kafka] Route qualified topics and streamline field projections

gyang94
and
codex
committed
4361fa1
[kafka] Use the DDL table contract in Metadata

gyang94
and
codex
committed
ce3759e
[kafka] Discover qualified topics and isolate missing databases

gyang94
and
codex
committed
988918e
[kafka] Add independently testable Produce protocol handling

gyang94
and
codex
committed
e27aff8
[kafka] Validate Produce batch offsets and stream compressed records

gyang94
and
codex
committed
ff27c55
[kafka] Transcode mapped raw and string records to Arrow

gyang94
and
codex
committed
21276e0
[kafka] Stream record transcoding and reuse owned payloads

gyang94
and
codex
committed
04a9093