Databricks Runtime 18 LTS 机器学习版

本页包含用于 机器学习 的 Databricks Runtime 18 LTS 的统一发行说明。 它整合了 Databricks Runtime 18 LTS 发布周期中提供的所有特定于 ML 的库更新和改进。

Databricks Runtime 18 LTS ML 基于 Databricks Runtime 18 LTS 构建。 有关 Databricks Runtime 18 中的新增功能(包括 Apache Spark MLlib 和 SparkR)的信息,请参阅 Databricks Runtime 18 LTS 发行说明。

新功能和改进

库更新包括:

  • CUDA 更新到 12.9
  • flash_attn 2.8.3
  • keras 3.12.0
  • langchain 1.0.3
  • mlflow-skinny 3.8.1
  • openai 2.7.0
  • 火炬 2.9.0
  • torchvision 0.24.0
  • transformers 4.57.1
  • triton 3.5.0
  • xgboost 3.1.1

系统环境

Databricks Runtime 18 ML 中的系统环境不同于 Databricks Runtime 18,如下所示。

  • 对于 GPU 群集,Databricks Runtime ML 包含以下 NVIDIA GPU 库:
    • CUDA 12.9
    • cublas 12.9.1.4-1
    • cusolver 11.7.5.82
    • cupti 12.9.79
    • cusparse 12.5.10.65
    • cuDNN 9.10.2.21
    • NCCL 2.27.5

Libraries

以下部分列出了 Databricks Runtime 18 ML 中包含的库,这些库不同于 Databricks Runtime 18 中包含的库。

顶层库

Databricks Runtime 18 ML 包含以下顶级 库:

Python库

Databricks Runtime 18 ML 使用 virtualenv 进行Python包管理,并包括许多常用的 ML 包。

若要在本地Python虚拟环境中重现 Databricks Runtime ML Python 环境,请下载适用于 CPU 群集的 requirements-cpu-18.txt,或者下载适用于 GPU 群集的 requirements-gpu-18.txt。 然后运行 pip install -r requirements-<cpu|gpu>-18.txt。 此命令安装 Databricks Runtime ML 使用的所有开源库,但不安装 Databricks 开发的库。

CPU 群集上的 Python 库

Library 版本 Library 版本 Library 版本
absl-py 2.3.1 accelerate 1.11.0 aiohappyeyeballs 2.4.4
aiohttp 3.11.10 aiohttp-cors 0.8.1 aiosignal 1.2.0
alembic 1.17.1 annotated-doc 0.0.4 annotated-types 0.7.0
anyio 4.7.0 argon2-cffi 21.3.0 argon2-cffi-bindings 21.2.0
arro3-core 0.6.5 arrow 1.3.0 asttokens 3.0.0
astunparse 1.6.3 async-lru 2.0.4 attrs 24.3.0
audioread 3.1.0 autocommand 2.2.2 azure-common 1.1.28
azure-core 1.36.0 azure-cosmos 4.3.1 azure-identity 1.20.0
azure-mgmt-core 1.6.0 azure-mgmt-web 8.0.0 azure-storage-blob 12.27.1
azure-storage-file-datalake 12.22.0 babel 2.16.0 backports.tarfile 1.2.0
bcrypt 4.3.0 beautifulsoup4 4.12.3 black 24.10.0
bleach 6.2.0 blinker 1.7.0 blis 0.7.11
boto3 1.40.45 botocore 1.40.45 brotli 1.2.0
cachetools 5.5.1 catalogue 2.0.10 certifi 2025.4.26
cffi 1.17.1 chardet 4.0.0 charset-normalizer 3.3.2
circuitbreaker 2.1.3 click 8.1.8 cloudpathlib 0.23.0
cloudpickle 3.0.0 cmdstanpy 1.3.0 colorful 0.5.8
colorlog 6.10.1 comm 0.2.1 confection 0.1.5
contourpy 1.3.1 cramjam 2.11.0 cryptography 44.0.1
cycler 0.11.0 cymem 2.0.12 Cython 3.1.5
dacite 1.9.2 databricks-agents 1.9.1 databricks-feature-engineering 0.13.0.1
databricks-sdk 0.67.0 dataclasses-json 0.6.7 datasets 4.3.0
dbl-tempo 0.1.26 dbus-python 1.3.2 debugpy 1.8.11
decorator 5.1.1 deepspeed 0.18.1 defusedxml 0.7.1
deltalake 1.1.4 Deprecated 1.2.18 dill 0.3.8
distlib 0.3.9 dm-tree 0.1.9 docstring-to-markdown 0.11
einops 0.8.1 evaluate 0.4.6 executing 1.2.0
facets-overview 1.1.1 Farama-Notifications 0.0.4 fastapi 0.121.2
fastjsonschema 2.21.1 filelock 3.17.0 filetype 1.2.0
Flask 2.2.5 flatbuffers 25.9.23 fonttools 4.55.3
fqdn 1.5.1 frozenlist 1.5.0 fsspec 2023.5.0
gast 0.6.0 gitdb 4.0.11 GitPython 3.1.43
google-api-core 2.28.1 google-auth 2.43.0 google-cloud-core 2.5.0
google-cloud-storage 3.2.0 google-crc32c 1.7.1 google-pasta 0.2.0
google-resumable-media 2.7.2 googleapis-common-protos 1.65.0 graphql-core 3.2.4
greenlet 3.1.1 grpcio 1.67.0 grpcio-status 1.67.0
gymnasium 0.28.1 h11 0.16.0 h5py 3.12.1
hf-xet 1.2.0 hjson 3.1.0 holidays 0.54
httpcore 1.0.9 httplib2 0.20.4 httpx 0.28.1
huggingface-hub 0.36.0 idna 3.7 ImageHash 4.3.1
imageio 2.37.0 imbalanced-learn 0.13.0 importlib_metadata 8.5.0
importlib_resources 6.5.2 inflect 7.3.1 iniconfig 1.1.1
ipyflow-core 0.0.209 ipykernel 6.29.5 ipython 8.30.0
ipython-genutils 0.2.0 ipywidgets 7.8.1 isodate 0.7.2
isoduration 20.11.0 itsdangerous 2.2.0 jaraco.collections 5.1.0
jaraco.context 5.3.0 jaraco.functools 4.0.1 jaraco.text 3.12.1
jax-jumpy 1.0.0 jedi 0.19.2 Jinja2 3.1.6
jiter 0.12.0 jmespath 1.0.1 joblib 1.4.2
joblibspark 0.6.0 json5 0.9.25 jsonpatch 1.33
jsonpointer 3.0.0 jsonschema 4.23.0 jsonschema-specifications 2023.7.1
jupyter 1.1.1 jupyter-console 6.6.3 jupyter-events 0.12.0
jupyter-lsp 2.2.5 jupyter_client 8.6.3 jupyter_core 5.7.2
jupyter_server 2.15.0 jupyter\_server\_terminals 0.5.3 jupyterlab 4.3.4
jupyterlab_pygments 0.3.0 jupyterlab_server 2.27.3 jupyterlab_widgets 1.1.11
keras 3.12.0 kiwisolver 1.4.8 langchain 1.0.3
langchain-core 1.0.4 langchain-openai 1.0.2 langcodes 3.5.0
langgraph 1.0.3 langgraph-checkpoint 3.0.1 langgraph-prebuilt 1.0.4
langgraph-sdk 0.2.9 langsmith 0.4.41 language_data 1.3.0
launchpadlib 1.11.0 lazr.restfulclient 0.14.6 lazr.uri 1.0.6
lazy_loader 0.4 libclang 15.0.6.1 librosa 0.11.0
lightgbm 4.6.0 linkify-it-py 2.0.0 litellm 1.75.9
llvmlite 0.44.0 lz4 4.3.2 Mako 1.3.10
marisa-trie 1.2.0 Markdown 3.8 markdown-it-py 2.2.0
MarkupSafe 3.0.2 marshmallow 3.26.1 matplotlib 3.10.0
matplotlib-inline 0.1.7 mccabe 0.7.0 mdit-py-plugins 0.3.0
mdurl 0.1.0 memray 1.19.1 minify_html 0.18.1
mistune 3.1.2 ml_dtypes 0.5.3 mlflow-skinny 3.8.1
mmh3 5.2.0 more-itertools 10.3.0 mosaicml-streaming 0.13.0
mpmath 1.3.0 msal 1.34.0 msal-extensions 1.3.1
msgpack 1.1.2 multidict 6.1.0 multimethod 1.12
multiprocess 0.70.16 murmurhash 1.0.14 mypy-extensions 1.0.0
namex 0.1.0 nbclient 0.10.2 nbconvert 7.16.6
nbformat 5.10.4 nest-asyncio 1.6.0 networkx 3.4.2
ninja 1.13.0 nltk 3.9.1 nodeenv 1.9.1
notebook 7.3.2 notebook_shim 0.2.4 numba 0.61.0
numpy 2.1.3 nvidia-nccl-cu12 2.28.7 oauthlib 3.2.0
oci 2.163.1 openai 2.7.0 opencensus 0.11.4
opencensus-context 0.1.3 opentelemetry-api 1.38.0 opentelemetry-proto 1.38.0
opentelemetry-sdk 1.38.0 opentelemetry-semantic-conventions 0.59b0 opt_einsum 3.4.0
optree 0.17.0 optuna 3.6.1 optuna-integration 3.6.0
orjson 3.11.4 ormsgpack 1.12.0 overrides 7.4.0
packaging 24.2 pandas 2.2.3 pandocfilters 1.5.0
paramiko 3.5.1 parso 0.8.4 pathspec 0.10.3
patsy 1.0.1 pexpect 4.8.0 phik 0.12.5
pillow 11.1.0 pip 25.0.1 platformdirs 4.3.7
plotly 5.24.1 pluggy 1.5.0 pooch 1.8.2
preshed 3.0.11 prometheus_client 0.21.1 prompt-toolkit 3.0.43
propcache 0.3.1 prophet 1.2.1 proto-plus 1.26.1
protobuf 5.29.4 psutil 5.9.0 psycopg2 2.9.11
ptyprocess 0.7.0 pure-eval 0.2.2 puremagic 1.30
py-cpuinfo 9.0.0 py-spy 0.4.1 pyarrow 21.0.0
pyasn1 0.4.8 pyasn1-modules 0.2.8 pyccolo 0.0.71
pycparser 2.21 pydantic 2.10.6 pydantic_core 2.27.2
pyflakes 3.2.0 Pygments 2.19.1 PyGObject 3.48.2
pyiceberg 0.10.0 PyJWT 2.10.1 PyNaCl 1.5.0
pyodbc 5.2.0 pyOpenSSL 25.0.0 pyparsing 3.2.0
pyright 1.1.394 pyroaring 1.0.3 pytesseract 0.3.10
pytest 8.3.5 python-dateutil 2.9.0.post0 python-dotenv 1.2.1
python-editor 1.0.4 python-json-logger 3.2.1 python-lsp-jsonrpc 1.1.2
python-lsp-server 1.12.2 python-snappy 0.7.3 pytoolconfig 1.2.6
pytz 2024.1 PyWavelets 1.8.0 PyYAML 6.0.2
pyzmq 26.2.0 ray 2.37.0 referencing 0.30.2
regex 2024.11.6 requests 2.32.3 requests-toolbelt 1.0.0
rfc3339-validator 0.1.4 rfc3986-validator 0.1.1 rich 13.9.4
rope 1.13.0 rpds-py 0.22.3 rsa 4.9.1
s3transfer 0.14.0 safetensors 0.6.2 scikit-image 0.25.0
scikit-learn 1.6.1 scipy 1.15.3 seaborn 0.13.2
Send2Trash 1.8.2 sentence-transformers 5.1.2 sentencepiece 0.2.1
setuptools 78.1.1 shap 0.49.1 shellingham 1.5.4
six 1.17.0 sklearn-compat 0.1.3 slicer 0.0.8
smart_open 7.5.0 smmap 5.0.0 sniffio 1.3.0
sortedcontainers 2.4.0 soundfile 0.13.1 soupsieve 2.5
soxr 1.0.0 spacy 3.7.5 spacy-legacy 3.0.12
spacy-loggers 1.0.5 SQLAlchemy 2.0.39 sqlparse 0.5.3
srsly 2.5.1 ssh-import-id 5.11 stack-data 0.6.3
stanio 0.5.1 starlette 0.49.3 statsmodels 0.14.4
strictyaml 1.7.3 sympy 1.13.3 tenacity 9.0.0
tensorboard 2.20.0 tensorboard-data-server 0.7.2 tensorboardX 2.6.4
tensorflow 2.20.0 termcolor 3.2.0 terminado 0.17.1
textual 4.0.0 tf_keras 2.20.1 thinc 8.2.4
threadpoolctl 3.5.0 tifffile 2025年2月18日 tiktoken 0.9.0
tinycss2 1.4.0 tokenize_rt 6.1.0 tokenizers 0.22.1
tomli 2.0.1 torch 2.9.0+cpu torcheval 0.0.7
torchvision 0.24.0+cpu tornado 6.5.1 tqdm 4.67.1
traitlets 5.14.3 transformers 4.57.1 typeguard 4.4.2
typer 0.20.0 typer-slim 0.20.0 types-python-dateutil 2.9.0.20251108
typing-inspect 0.9.0 typing_extensions 4.12.2 tzdata 2024.1
uc-micro-py 1.0.1 ujson 5.10.0 unattended-upgrades 0.1
uri-template 1.3.0 urllib3 2.3.0 uvicorn 0.38.0
virtualenv 20.29.3 visions 0.8.1 wadllib 1.3.6
wasabi 1.1.3 wcwidth 0.2.5 weasel 0.4.3
webcolors 25.10.0 webencodings 0.5.1 websocket-client 1.8.0
Werkzeug 3.1.3 whatthepatch 1.0.2 wheel 0.45.1
whenever 0.7.3 widgetsnbextension 3.6.6 wordcloud 1.9.4
wrapt 1.17.0 xgboost 3.1.1 xgboost-ray 0.1.19
xxhash 3.5.0 yapf 0.40.2 yarl 1.18.0
ydata-profiling 4.17.0 zipp 3.21.0 zstandard 0.23.0
zstd 1.5.5.1

GPU 集群上的 Python 库

注释

PyTorch 使用 CUDA PyPI 依赖项提供 CUDA 支持,而不是内置于 Databricks Runtime 18 ML 中的 CUDA 库版本。

Library 版本 Library 版本 Library 版本
absl-py 2.3.1 accelerate 1.11.0 aiohappyeyeballs 2.4.4
aiohttp 3.11.10 aiohttp-cors 0.8.1 aiosignal 1.2.0
annotated-doc 0.0.4 annotated-types 0.7.0 anyio 4.7.0
argon2-cffi 21.3.0 argon2-cffi-bindings 21.2.0 arro3-core 0.6.5
arrow 1.3.0 asttokens 3.0.0 astunparse 1.6.3
async-lru 2.0.4 attrs 24.3.0 audioread 3.1.0
autocommand 2.2.2 azure-common 1.1.28 azure-core 1.36.0
azure-cosmos 4.3.1 azure-identity 1.20.0 azure-mgmt-core 1.6.0
azure-mgmt-web 8.0.0 azure-storage-blob 12.27.1 azure-storage-file-datalake 12.22.0
babel 2.16.0 backports.tarfile 1.2.0 bcrypt 4.3.0
beautifulsoup4 4.12.3 black 24.10.0 bleach 6.2.0
blinker 1.7.0 blis 0.7.11 boto3 1.40.45
botocore 1.40.45 brotli 1.2.0 cachetools 5.5.1
catalogue 2.0.10 certifi 2025.4.26 cffi 1.17.1
chardet 4.0.0 charset-normalizer 3.3.2 circuitbreaker 2.1.3
click 8.1.8 cloudpathlib 0.23.0 cloudpickle 3.0.0
cmdstanpy 1.3.0 colorful 0.5.8 colorlog 6.10.1
comm 0.2.1 confection 0.1.5 contourpy 1.3.1
cramjam 2.11.0 cryptography 44.0.1 cycler 0.11.0
cymem 2.0.12 Cython 3.1.5 dacite 1.9.2
databricks-agents 1.9.1 databricks-feature-engineering 0.13.0.1 databricks-sdk 0.67.0
dataclasses-json 0.6.7 datasets 4.3.0 dbl-tempo 0.1.26
dbus-python 1.3.2 debugpy 1.8.11 decorator 5.1.1
deepspeed 0.18.1 defusedxml 0.7.1 deltalake 1.1.4
Deprecated 1.2.18 dill 0.3.8 distlib 0.3.9
dm-tree 0.1.9 docstring-to-markdown 0.11 einops 0.8.1
evaluate 0.4.6 executing 1.2.0 facets-overview 1.1.1
Farama-Notifications 0.0.4 fastapi 0.121.2 fastjsonschema 2.21.1
filelock 3.17.0 filetype 1.2.0 flash_attn 2.8.3
Flask 2.2.5 flatbuffers 25.9.23 fonttools 4.55.3
fqdn 1.5.1 frozenlist 1.5.0 fsspec 2023.5.0
gast 0.6.0 gitdb 4.0.11 GitPython 3.1.43
google-api-core 2.28.1 google-auth 2.43.0 google-cloud-core 2.5.0
google-cloud-storage 3.2.0 google-crc32c 1.7.1 google-pasta 0.2.0
google-resumable-media 2.7.2 googleapis-common-protos 1.65.0 graphql-core 3.2.4
greenlet 3.1.1 grpcio 1.67.0 grpcio-status 1.67.0
gymnasium 0.28.1 h11 0.16.0 h5py 3.12.1
hf-xet 1.2.0 hjson 3.1.0 holidays 0.54
httpcore 1.0.9 httplib2 0.20.4 httpx 0.28.1
huggingface-hub 0.36.0 idna 3.7 ImageHash 4.3.1
imageio 2.37.0 imbalanced-learn 0.13.0 importlib_metadata 8.5.0
importlib_resources 6.5.2 inflect 7.3.1 iniconfig 1.1.1
ipyflow-core 0.0.209 ipykernel 6.29.5 ipython 8.30.0
ipython-genutils 0.2.0 ipywidgets 7.8.1 isodate 0.7.2
isoduration 20.11.0 itsdangerous 2.2.0 jaraco.collections 5.1.0
jaraco.context 5.3.0 jaraco.functools 4.0.1 jaraco.text 3.12.1
jax-jumpy 1.0.0 jedi 0.19.2 Jinja2 3.1.6
jiter 0.12.0 jmespath 1.0.1 joblib 1.4.2
joblibspark 0.6.0 json5 0.9.25 jsonpatch 1.33
jsonpointer 3.0.0 jsonschema 4.23.0 jsonschema-specifications 2023.7.1
jupyter 1.1.1 jupyter-console 6.6.3 jupyter-events 0.12.0
jupyter-lsp 2.2.5 jupyter_client 8.6.3 jupyter_core 5.7.2
jupyter_server 2.15.0 jupyter\_server\_terminals 0.5.3 jupyterlab 4.3.4
jupyterlab_pygments 0.3.0 jupyterlab_server 2.27.3 jupyterlab_widgets 1.1.11
keras 3.12.0 kiwisolver 1.4.8 langchain 1.0.3
langchain-core 1.0.4 langchain-openai 1.0.2 langcodes 3.5.0
langgraph 1.0.3 langgraph-checkpoint 3.0.1 langgraph-prebuilt 1.0.4
langgraph-sdk 0.2.9 langsmith 0.4.41 language_data 1.3.0
launchpadlib 1.11.0 lazr.restfulclient 0.14.6 lazr.uri 1.0.6
lazy_loader 0.4 libclang 15.0.6.1 librosa 0.11.0
lightgbm 4.6.0 linkify-it-py 2.0.0 litellm 1.75.9
llvmlite 0.44.0 lz4 4.3.2 Mako 1.3.10
marisa-trie 1.2.0 Markdown 3.8 markdown-it-py 2.2.0
MarkupSafe 3.0.2 marshmallow 3.26.1 matplotlib 3.10.0
matplotlib-inline 0.1.7 mccabe 0.7.0 mdit-py-plugins 0.3.0
mdurl 0.1.0 memray 1.19.1 minify_html 0.18.1
mistune 3.1.2 ml_dtypes 0.5.3 mlflow-skinny 3.8.1
mmh3 5.2.0 more-itertools 10.3.0 mosaicml-streaming 0.13.0
mpmath 1.3.0 msal 1.34.0 msal-extensions 1.3.1
msgpack 1.1.2 multidict 6.1.0 multimethod 1.12
multiprocess 0.70.16 murmurhash 1.0.14 mypy-extensions 1.0.0
namex 0.1.0 nbclient 0.10.2 nbconvert 7.16.6
nbformat 5.10.4 nest-asyncio 1.6.0 networkx 3.4.2
ninja 1.13.0 nltk 3.9.1 nodeenv 1.9.1
notebook 7.3.2 notebook_shim 0.2.4 numba 0.61.0
numpy 2.1.3 nvidia-cublas-cu12 12.9.1.4 nvidia-cuda-cupti-cu12 12.9.79
nvidia-cuda-nvrtc-cu12 12.9.86 nvidia-cuda-runtime-cu12 12.9.79 nvidia-cudnn-cu12 9.10.2.21
nvidia-cufft-cu12 11.4.1.4 nvidia-cufile-cu12 1.14.1.1 nvidia-curand-cu12 10.3.10.19
nvidia-cusolver-cu12 11.7.5.82 nvidia-cusparse-cu12 12.5.10.65 nvidia-cusparselt-cu12 0.7.1
nvidia-ml-py 13.580.82 nvidia-nccl-cu12 2.27.5 nvidia-nvjitlink-cu12 12.9.86
nvidia-nvshmem-cu12 3.3.20 nvidia-nvtx-cu12 12.9.79 oauthlib 3.2.0
oci 2.163.1 openai 2.7.0 opencensus 0.11.4
opencensus-context 0.1.3 opentelemetry-api 1.38.0 opentelemetry-proto 1.38.0
opentelemetry-sdk 1.38.0 opentelemetry-semantic-conventions 0.59b0 opt_einsum 3.4.0
optree 0.17.0 optuna 3.6.1 optuna-integration 3.6.0
orjson 3.11.4 ormsgpack 1.12.0 overrides 7.4.0
packaging 24.2 pandas 2.2.3 pandocfilters 1.5.0
paramiko 3.5.1 parso 0.8.4 pathspec 0.10.3
patsy 1.0.1 pexpect 4.8.0 phik 0.12.5
pillow 11.1.0 pip 25.0.1 platformdirs 4.3.7
plotly 5.24.1 pluggy 1.5.0 pooch 1.8.2
preshed 3.0.11 prometheus_client 0.21.1 prompt-toolkit 3.0.43
propcache 0.3.1 prophet 1.2.1 proto-plus 1.26.1
protobuf 5.29.4 psutil 5.9.0 psycopg2 2.9.11
ptyprocess 0.7.0 pure-eval 0.2.2 puremagic 1.30
py-cpuinfo 9.0.0 py-spy 0.4.1 pyarrow 21.0.0
pyasn1 0.4.8 pyasn1-modules 0.2.8 pyccolo 0.0.71
pycparser 2.21 pydantic 2.10.6 pydantic_core 2.27.2
pyflakes 3.2.0 Pygments 2.19.1 PyGObject 3.48.2
pyiceberg 0.10.0 PyJWT 2.10.1 PyNaCl 1.5.0
pyodbc 5.2.0 pyOpenSSL 25.0.0 pyparsing 3.2.0
pyright 1.1.394 pyroaring 1.0.3 pytesseract 0.3.10
pytest 8.3.5 python-dateutil 2.9.0.post0 python-dotenv 1.2.1
python-editor 1.0.4 python-json-logger 3.2.1 python-lsp-jsonrpc 1.1.2
python-lsp-server 1.12.2 python-snappy 0.7.3 pytoolconfig 1.2.6
pytz 2024.1 PyWavelets 1.8.0 PyYAML 6.0.2
pyzmq 26.2.0 ray 2.37.0 referencing 0.30.2
regex 2024.11.6 requests 2.32.3 requests-toolbelt 1.0.0
rfc3339-validator 0.1.4 rfc3986-validator 0.1.1 rich 13.9.4
rope 1.13.0 rpds-py 0.22.3 rsa 4.9.1
s3transfer 0.14.0 safetensors 0.6.2 scikit-image 0.25.0
scikit-learn 1.6.1 scipy 1.15.3 seaborn 0.13.2
Send2Trash 1.8.2 sentence-transformers 5.1.2 sentencepiece 0.2.1
setuptools 78.1.1 shap 0.49.1 shellingham 1.5.4
six 1.17.0 sklearn-compat 0.1.3 slicer 0.0.8
smart_open 7.5.0 smmap 5.0.0 sniffio 1.3.0
sortedcontainers 2.4.0 soundfile 0.13.1 soupsieve 2.5
soxr 1.0.0 spacy 3.7.5 spacy-legacy 3.0.12
spacy-loggers 1.0.5 SQLAlchemy 2.0.39 sqlparse 0.5.3
srsly 2.5.1 ssh-import-id 5.11 stack-data 0.6.3
stanio 0.5.1 starlette 0.49.3 statsmodels 0.14.4
strictyaml 1.7.3 sympy 1.13.3 tenacity 9.0.0
tensorboard 2.20.0 tensorboard-data-server 0.7.2 tensorboardX 2.6.4
tensorflow 2.20.0 termcolor 3.2.0 terminado 0.17.1
textual 4.0.0 tf_keras 2.20.1 thinc 8.2.4
threadpoolctl 3.5.0 tifffile 2025年2月18日 tiktoken 0.9.0
tinycss2 1.4.0 tokenize_rt 6.1.0 tokenizers 0.22.1
tomli 2.0.1 torch 2.9.0+cu129 torcheval 0.0.7
torchvision 0.24.0+cu129 tornado 6.5.1 tqdm 4.67.1
traitlets 5.14.3 transformers 4.57.1 triton 3.5.0
typeguard 4.4.2 typer 0.20.0 typer-slim 0.20.0
types-python-dateutil 2.9.0.20251108 typing-inspect 0.9.0 typing_extensions 4.12.2
tzdata 2024.1 uc-micro-py 1.0.1 ujson 5.10.0
unattended-upgrades 0.1 uri-template 1.3.0 urllib3 2.3.0
uvicorn 0.38.0 virtualenv 20.29.3 visions 0.8.1
wadllib 1.3.6 wasabi 1.1.3 wcwidth 0.2.5
weasel 0.4.3 webcolors 25.10.0 webencodings 0.5.1
websocket-client 1.8.0 Werkzeug 3.1.3 whatthepatch 1.0.2
wheel 0.45.1 whenever 0.7.3 widgetsnbextension 3.6.6
wordcloud 1.9.4 wrapt 1.17.0 xgboost 3.1.1
xgboost-ray 0.1.19 xxhash 3.5.0 yapf 0.40.2
yarl 1.18.0 ydata-profiling 4.17.0 zipp 3.21.0
zstandard 0.23.0 zstd 1.5.5.1

R 软件库

R 库与 Databricks Runtime 18 中的 R 库 相同。

Java 和 Scala 库 (Scala 2.13 群集)

除了 Databricks Runtime 18 中的Java库和 Scala 库,Databricks Runtime 18 ML 还包含以下 JAR:

CPU 群集

群组标识符 工件编号 版本
ml.dmlc xgboost4j-spark_2.13 2.1.3
ml.dmlc xgboost4j_2.13 2.1.3
org.graphframes graphframes_2.13 0.8.4-db1-spark3.5
org.mlflow mlflow-client 2.15.1
org.scala-lang.modules scala-collection-compat_2.13 2.12.0
org.tensorflow spark-tensorflow-connector_2.13 1.15.0

GPU 群集

群组标识符 工件编号 版本
ml.dmlc xgboost4j-spark-gpu_2.13 2.1.3
ml.dmlc xgboost4j-gpu_2.13 2.1.3
org.graphframes graphframes_2.13 0.8.4-db1-spark3.5
org.mlflow mlflow-client 2.15.1
org.scala-lang.modules scala-collection-compat_2.13 2.12.0
org.tensorflow spark-tensorflow-connector_2.13 1.15.0

不支持的版本

Tip

若要查看已终止支持 (EoS) 的 Databricks Runtime 版本的发行说明,请参阅终止支持 Databricks Runtime 发行说明。 EoS Databricks Runtime 版本已停用,可能不会更新。