Fix: Schema projection order mismatch from table/file schema

[brancz]

Looks like I only solved a subset of the issue with #5436

The test I added failed before the fix.

[brancz]

Coincidentally, this is now the same strategy as what the parquet opener does:

Map file schema to logical schema: https://github.com/apache/datafusion/blob/769f36732a284cec3d549bfcda50cb67684fb5dc/datafusion/datasource-parquet/src/opener.rs#L242
Project: https://github.com/apache/datafusion/blob/769f36732a284cec3d549bfcda50cb67684fb5dc/datafusion/datasource-parquet/src/opener.rs#L319

[codspeed-hq]

CodSpeed Performance Report

Merging #5541 will improve performances by 17.18%

_{Comparing polarsignals:projection (3ad77de) with develop (da6873b)}

Summary

⚡ 5 improvements
✅ 1473 untouched
⏩ 235 skipped¹

Benchmarks breakdown

	Benchmark	BASE	HEAD	Change
⚡	slice_arrow_buffer[1024]	397.8 ns	339.4 ns	+17.18%
⚡	slice_arrow_buffer[128]	397.8 ns	339.4 ns	+17.18%
⚡	slice_arrow_buffer[16384]	397.8 ns	339.4 ns	+17.18%
⚡	slice_arrow_buffer[2048]	397.8 ns	339.4 ns	+17.18%
⚡	slice_arrow_buffer[65536]	397.8 ns	339.4 ns	+17.18%

Footnotes

1. 235 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

[codecov]

Codecov Report

❌ Patch coverage is 98.33333% with 1 line in your changes missing coverage. Please review.
✅ Project coverage is 85.43%. Comparing base (fe4c81b) to head (3ad77de).
⚠️ Report is 7 commits behind head on develop.

Files with missing lines	Patch %	Lines
vortex-datafusion/src/persistent/opener.rs	98.33%	1 Missing ⚠️

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[asubiotto]

LGTM

[asubiotto]

cc @a10y @AdamGS in case you want to take a look

[a10y]

@brancz I think there are still issues here, see this simple example: #5550

Hoping to fix all of these edge cases as part of #5406