Databricks Runtime 5.5 Extended Support (EoS)

  • Article

Note

Support for this Databricks Runtime version has ended. For the end-of-support date, see End-of-support history. For all supported Databricks Runtime versions, see Databricks Runtime release notes versions and compatibility.

Databricks released this version in July 2021. It is supported through December 2021.

Databricks Runtime 5.5 Extended Support is intended for customers who are on the soon-to-be-unsupported Databricks Runtime 5.5 LTS but are unable to migrate to Databricks Runtime 7.x or 8.x. Databricks Runtime 5.5 Extended Support uses Ubuntu 18.04.5 LTS instead of the deprecated Ubuntu 16.04.6 LTS distribution used in the original Databricks Runtime 5.5. Ubuntu 16.04 reached end of life on April 1, 2021.

Databricks continues to recommend that you migrate your workloads to Databricks Runtime 7.x or 8.x as soon as you can to get the benefits of Apache Spark 3.x and the many new features and improvements built into these newer runtimes.

For migration information, see Databricks Runtime 7.x migration guide (EoS).

These release notes list the differences between Databricks Runtime 5.5 Extended Support and the original Databricks Runtime 5.5. For all other details about this release, see the release note for the original Databricks Runtime 5.5 LTS (EoS).

Differences between Databricks Runtime 5.5 Extended Support and Databricks Runtime 5.5

The following environment details and libraries are different from those in Databricks Runtime 5.5.

System environment

  • Operating System: Ubuntu 18.04.5 LTS
  • Java: Zulu 8.54.0.21-CA-linux64 (build 1.8.0_292-b10)
  • Python2: Python 2.7.17
  • Python3: Python 3.6.9

Python2 libraries

  • cffi upgraded from 1.7.0 to 1.12.2
  • cryptography upgraded from 1.5 to 2.6.1
  • docutils upgraded from 0.14 to 0.17.1
  • futures upgraded from 3.2.0 to 3.3.0
  • llvmlite upgraded from 0.13.0 to 0.28.0
  • numba upgraded from 0.28.1 to 0.43.1
  • psycopg2 upgraded from 2.6.2 to 2.7.5
  • PyGObject upgraded from 3.20.0 to 3.26.1
  • PyOpenSSL upgraded from 16.0.0 to 19.0.0
  • setuptools upgraded from 41.0.1 to 44.1.1
  • wheel upgraded from 0.33.4 to 0.36.2
  • asn1crypto 0.24.0
  • keyring 10.6.0
  • keyrings.alt 3.0
  • pycairo 1.16.2
  • pycrypto 2.6.1
  • pyxdg 0.25
  • SecretStorage 2.3.1

Python3 libraries

  • cffi upgraded from 1.7.0 to 1.12.2
  • cryptography upgraded from 1.5 to 2.6.1
  • docutils upgraded from 0.14 to 0.17.1
  • llvmlite upgraded from 0.13.0 to 0.28.0
  • numba upgraded from 0.28.1 to 0.43.1
  • psycopg2 upgraded from 2.6.2 to 2.7.5
  • PyGObject upgraded from 3.20.0 to 3.26.1
  • PyOpenSSL upgraded from 16.0.0 to 19.0.0
  • python-apt upgraded from 1.1.0 to 1.6.5
  • ssh-import-id upgraded from 5.5 to 5.7
  • wheel upgraded from 0.33.4 to 0.36.2
  • asn1crypto 1.4.0
  • enum34 removed
  • pycurl removed

R libraries

  • foreign upgraded from 0.8-70 to 0.8-71
  • Rserve upgraded from 1.8-6 to 1.8-8