-
Notifications
You must be signed in to change notification settings - Fork 1.5k
Open
Labels
Description
Describe the bug, including details regarding any error messages, version, and platform.
Version 1.13.1, used by Spark 3.5:
parquet-java/parquet-hadoop/src/main/java/org/apache/parquet/hadoop/ParquetFileReader.java
Line 548 in db41831
| throw new RuntimeException(filePath + " is not a Parquet file (length is too low: " + fileLen + ")"); |
used to show the parquet file path: Cause: java.lang.RuntimeException: file:/tmp/spark-37..../00000000000000000000.checkpoint.parquet is not a Parquet file (length is too low: 10)
In version 1.15.2, used by Spark 4:
parquet-java/parquet-hadoop/src/main/java/org/apache/parquet/hadoop/ParquetFileReader.java
Line 584 in 859eac1
| throw new RuntimeException(filePath + " is not a Parquet file (length is too low: " + fileLen + ")"); |
The error message says: Cause: java.lang.RuntimeException: io.delta.kernel.defaults.internal.parquet.ParquetIOUtils$1@63d4ffeb is not a Parquet file (length is too low: 10)
Component(s)
No response