FAILED_READ_FILE error class

  • Article

SQLSTATE: KD001

Error while reading file <path>.

Could not read footer. Please ensure that the file is in either ORC or Parquet format.

If not, please convert it to a valid format. If the file is in the valid format, please check if it is corrupt.

If it is, you can choose to either ignore it or fix the corruption.

DBR_FILE_NOT_EXIST

<hint>

FAILED_CONVERT_PARQUET_COLUMN

Possible cause: Parquet column cannot be converted.

FILE_NOT_EXIST

File does not exist. It is possible the underlying files have been updated.

You can explicitly invalidate the cache in Spark by running 'REFRESH TABLE tableName' command in SQL or by recreating the Dataset/DataFrame involved.

If disk cache is stale or the underlying files have been removed, you can invalidate disk cache manually by restarting the cluster.

NO_HINT

PARQUET_COLUMN_DATA_TYPE_MISMATCH

Data type mismatches when reading Parquet column <column>. Expected Spark type <expectedType>, actual Parquet type <actualType>.