Skip to content

feat: add Parquet reader for Iceberg-backed CloudEvent retrieval#56

Open
zer0stars wants to merge 1 commit intomainfrom
iceberg
Open

feat: add Parquet reader for Iceberg-backed CloudEvent retrieval#56
zer0stars wants to merge 1 commit intomainfrom
iceberg

Conversation

@zer0stars
Copy link
Member

Summary

  • Add parquetreader package: reads CloudEvents from Parquet files on S3 using Arrow/Parquet libraries with row-offset support
  • Update eventrepo to resolve parquet_path#row_offset index keys and fetch events from Parquet files instead of individual S3 objects

Companion to DIMO-Network/dps#55

Test plan

  • Unit tests for parquetreader pass
  • Integration test fetching events with parquet-backed index keys
  • Verify backward compatibility with existing S3 individual-object index keys

Made with Cursor

@zer0stars zer0stars force-pushed the iceberg branch 6 times, most recently from ca5e370 to cdac11b Compare February 17, 2026 19:30
Co-authored-by: Cursor <cursoragent@cursor.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

Comments