Skip to content

Conversation

@paultiq
Copy link

@paultiq paultiq commented Dec 17, 2025

Fixes #5759

This PR maps string_views to strings and binary_views to binary so that to_substrait will no longer raise ArrowNotImplementedError when constructing the substrait.

Vortex supports expressions over views and Arrow compute doesn't, but to_substrait raises ArrowNotImplementedError based on Arrow compute kernels... regardless of the backend.

I, Paul Timmins <paul@iqmo.com>, hereby add my Signed-off-by to this commit: 8ae0c04

Signed-off-by: Paul Timmins <paul@iqmo.com>
@connortsui20 connortsui20 requested a review from danking December 17, 2025 23:26
@codecov
Copy link

codecov bot commented Dec 17, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 82.03%. Comparing base (e7e1748) to head (3107e20).
⚠️ Report is 20 commits behind head on develop.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Copy link
Contributor

@danking danking left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is great and we should merge! Can you follow up with a test that writes and reads through DuckDB a Vortex file containing strings? I think paultiq included one at one point in one of his GitHub issues.

@paultiq
Copy link
Author

paultiq commented Dec 18, 2025

@danking Do you want that test case in this PR or a separate? Happy to do either.

@danking
Copy link
Contributor

danking commented Dec 18, 2025

Separate is fine! Sorry I referred to you in the third person! GitHub mobile UI had me turned around haha

  I, Paul Timmins <paul@iqmo.com>, hereby add my Signed-off-by to this commit: de97c5b

  Signed-off-by: Paul Timmins <paul@iqmo.com>
I, Paul Timmins <paul@iqmo.com>, hereby add my Signed-off-by to this commit: de97c5b
I, Paul Timmins <paul@iqmo.com>, hereby add my Signed-off-by to this commit: 5214824

Signed-off-by: Paul Timmins <paul@iqmo.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Arrow Expressions on Vortex Datasets raise ArrowNotImplementedError on string_views

2 participants