feat: implement framework to support multiple pyspark benchmarks [WIP]

[andygrove]

Which issue does this PR close?

Closes #.

Rationale for this change

Make it easy to add new PySpark benchmarks.

What changes are included in this PR?

How are these changes tested?

[codecov-commenter]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 59.49%. Comparing base (f09f8af) to head (bcf04bb).
⚠️ Report is 845 commits behind head on main.

Additional details and impacted files

@@             Coverage Diff              @@
##               main    #3080      +/-   ##
============================================
+ Coverage     56.12%   59.49%   +3.36%     
- Complexity      976     1381     +405     
============================================
  Files           119      167      +48     
  Lines         11743    15552    +3809     
  Branches       2251     2581     +330     
============================================
+ Hits           6591     9252    +2661     
- Misses         4012     5002     +990     
- Partials       1140     1298     +158     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.