Skip to content

The error message "is not a Parquet file" doesn't show the Parquet path anymore #3354

@felipepessoto

Description

@felipepessoto

Describe the bug, including details regarding any error messages, version, and platform.

Version 1.13.1, used by Spark 3.5:

throw new RuntimeException(filePath + " is not a Parquet file (length is too low: " + fileLen + ")");

used to show the parquet file path: Cause: java.lang.RuntimeException: file:/tmp/spark-37..../00000000000000000000.checkpoint.parquet is not a Parquet file (length is too low: 10)

In version 1.15.2, used by Spark 4:

throw new RuntimeException(filePath + " is not a Parquet file (length is too low: " + fileLen + ")");

The error message says: Cause: java.lang.RuntimeException: io.delta.kernel.defaults.internal.parquet.ParquetIOUtils$1@63d4ffeb is not a Parquet file (length is too low: 10)

Component(s)

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions