Review Delta Lake table details with describe detail

  • Article

You can retrieve detailed information about a Delta table (for example, number of files, data size) using DESCRIBE DETAIL.

DESCRIBE DETAIL '/data/events/'

DESCRIBE DETAIL eventsTable

For Spark SQL syntax details, see DESCRIBE DETAIL.

See the Delta Lake API documentation for Scala/Java/Python syntax details.

Detail schema

The output of this operation has only one row with the following schema.

Note

The columns you see depend on the Databricks Runtime version that you are using and the table features that you've enabled.

Column Type Description
format string Format of the table, that is, delta.
id string Unique ID of the table.
name string Name of the table as defined in the metastore.
description string Description of the table.
location string Location of the table.
createdAt timestamp When the table was created.
lastModified timestamp When the table was last modified.
partitionColumns array of strings Names of the partition columns if the table is partitioned.
numFiles long Number of the files in the latest version of the table.
sizeInBytes int The size of the latest snapshot of the table in bytes.
properties string-string map All the properties set for this table.
minReaderVersion int Minimum version of readers (according to the log protocol) that can read the table.
minWriterVersion int Minimum version of writers (according to the log protocol) that can write to the table.
statistics map with string keys Additional table-level statistics.
tableFeatures array of strings A list of the table features supported by the table. See How does Azure Databricks manage Delta Lake feature compatibility?.
clusteringColumns array of strings The columns being used for liquid clustering. See Use liquid clustering for Delta tables

Below is an example of what the output looks like:

+------+--------------------+------------------+-----------+--------------------+--------------------+-------------------+----------------+--------+-----------+----------+----------------+----------------+
|format|                  id|              name|description|            location|           createdAt|       lastModified|partitionColumns|numFiles|sizeInBytes|properties|minReaderVersion|minWriterVersion|
+------+--------------------+------------------+-----------+--------------------+--------------------+-------------------+----------------+--------+-----------+----------+----------------+----------------+
| delta|d31f82d2-a69f-42e...|default.deltatable|       null|file:/Users/tuor/...|2020-06-05 12:20:...|2020-06-05 12:20:20|              []|      10|      12345|        []|               1|               2|
+------+--------------------+------------------+-----------+--------------------+--------------------+-------------------+----------------+--------+-----------+----------+----------------+----------------+