Troubleshoot common sharing issues in Delta Sharing

  • Article

The following sections describe common errors that might occur when you try to access data in a share.

Resource limit exceeded errors

Issue: Your query on a shared table returns the error RESOURCE_LIMIT_EXCEEDED.

You may see either of these errors:

  • "RESOURCE_LIMIT_EXCEEDED","message":"The table metadata size exceeded limits"
  • "RESOURCE_LIMIT_EXCEEDED","message":"The number of files in the table to return exceeded limits, consider contact your provider to optimize the table"

Possible causes: There are limits on the number of files in metadata allowed for a shared table.

Recommended fix: To learn how to resolve either of these issues, see RESOURCE_LIMIT_EXCEEDED error when querying a Delta Sharing table in the Databricks Knowledge Base.

Vacuumed data file issue

Issue: You see an error message that throws a "404 The specified [path|key] does not exist" exception.

Spark error examples:

java.lang.Throwable: HTTP request failed with status: HTTP/1.1 404 The specified path does not exist.

or

HTTP request failed with status: HTTP/1.1 404 Not Found <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>NoSuchKey</Code><Message>The specified key does not exist.</Message>

Possible cause: Typically you see this error because the data file corresponding to the pre-signed URL is vacuumed in the shared table and the data file belongs to a historical table version.

Workaround: Query the latest snapshot.

Storage network configuration issue

Issue: You see an error message that throws an SSLCertVerificationError.

Spark error example:

ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1006)

Possible cause: Typically you see this error because there is a network restriction on the storage location of the shared table or volume.

Recommended fix: In the storage provider interface, allow access to the storage location by allowing the client IP in the storage account firewall settings.