Databricks Runtime 5.5 LTSDatabricks Runtime 5.5 LTS
Databricks 于 2019 年 7 月发布了此映像。Databricks released this image in July 2019. 2019 年 8 月为其声明了长期支持 (LTS)。It was declared Long Term Support (LTS) in August 2019.
以下发行说明提供了由 Apache Spark 支持的 Databricks Runtime 5.5 的相关信息。The following release notes provide information about Databricks Runtime 5.5, powered by Apache Spark.
新增功能New features
Azure Databricks 上的 Delta Lake 自动优化Delta Lake on Azure Databricks Auto Optimize
现在，将数据写入云存储时，你需要压缩文件以获得最佳 I/O 性能。Today, when you write data into cloud storage, you need to compact files for optimal I/O performance. 你必须考虑正确的文件大小、压缩文件的频率、要使用的群集的大小，等等。You have to worry about the right file size, how often to compact the files, how big a cluster to use, and so on. 为了解决此类问题，我们非常高兴地宣布，通过 Azure Databricks 上的 Delta Lake 进行自动优化的功能正式发布。To address this class of problems, we are excited to announce the general availability of Auto Optimize with Delta Lake on Azure Databricks. 每次写入到 Delta 表期间，我们都会自动确定正确的文件大小并压缩文件，因此你不必为优化存储布局担忧。During every write to Delta tables, we automatically figure out the right file sizes and compact files so that you don’t have to worry about optimizing the storage layout. 在写入期间，如果 auto-optimize 选项为 true，则 Azure Databricks 会自动确定是否需要优化以及是否优化小文件。During writes, if the auto-optimize option is true, Azure Databricks automatically determines if an optimize is required and optimizes the small files. 有关详细信息，请参阅自动优化。For details, see Auto Optimize.
Azure Databricks 上的 Delta Lake 改善了最小值、最大值和计数聚合查询性能Delta Lake on Azure Databricks improved min, max, and count aggregation query performance
通过减少读取的数据量，针对 Azure Databricks 上的 Delta Lake 的最小值、最大值和计数聚合查询的性能得到显着改善。The performance of min, max, and count aggregation queries for Delta Lake on Azure Databricks has been significantly improved by reducing the amount of data that’s read. 这些查询现在使用元数据中的统计信息和分区值来运行，而不是通过扫描数据来这样做。These queries are now run using statistics and partition values in the metadata, rather than scanning the data.
更快的模型推理管道，以及改进的二进制文件数据源和标量迭代器 pandas UDF（公共预览版）Faster model inference pipelines with improved binary file data source and scalar iterator pandas UDF (Public Preview)
机器学习任务，尤其是在图像和视频域中，通常需要对大量文件进行操作。Machine learning tasks, especially in the image and video domain, often have to operate on a large number of files. 我们在 Databricks Runtime 5.4 中提供了二进制文件数据源，用于将任意文件（例如图像）ETL 到 Spark 表中。In Databricks Runtime 5.4, we already made available the binary file data source to help ETL arbitrary files such as images, into Spark tables. 在 Databricks Runtime 5.5 中，我们添加了选项 recursiveFileLookup，用于以递归方式从嵌套的输入目录加载文件。In Databricks Runtime 5.5, we have added an option, recursiveFileLookup, to load files recursively from nested input directories. 请参阅二进制文件。See Binary file.
有了二进制文件数据源，就可以使用标量 pandas UDF 从 Spark 表并行运行模型推理任务。The binary file data source enables you to run model inference tasks in parallel from Spark tables using a scalar pandas UDF. 但是，你可能必须为每个记录批初始化模型，这会带来开销。However, you might have to initialize the model for every record batch, which introduces overhead. 在 Databricks Runtime 5.5 中，我们从 Apache Spark 主节点向后移植了一个新的称为“标量迭代器”的 pandas UDF 类型。In Databricks Runtime 5.5, we backported a new pandas UDF type called “scalar iterator” from Apache Spark master. 使用此方法，只需对模型进行一次初始化，并将模型应用于多个输入批，这可能会使模型（例如 ResNet50）加速 2-3 倍。With it you can initialize a model only once and apply the model to many input batches, which can result in a 2-3x speedup for models like ResNet50. 请参阅序列到标量 UDF。See Series to scalar UDF.
R 笔记本中的机密 APISecrets API in R notebooks
使用机密 API，你可以将机密注入到笔记本中，无需对其进行硬编码。The Secrets API lets you inject secrets into notebooks without hardcoding them. 除了现有的针对 Python 和 Scala 笔记本的支持，此 API 现在还可在 R 笔记本中使用。This API is now available in R notebooks in addition to existing support for Python and Scala notebooks. 可以使用 dbutils.secrets.get 函数获取机密。You can use the dbutils.secrets.get function to obtain secrets. 在将机密输出到笔记本单元格之前，会对其进行修正。Secrets are redacted before printing to a notebook cell.
改进Improvements
- 支持在 Python
foreachBatch中运行 Delta Lake SQL 操作：我们已修复了不能从 Python 中定义的结构化流式处理查询的foreachBatch内部写入到 Delta 表的已知限制。Support for running Delta Lake SQL operations in PythonforeachBatch: We have fixed the known limitation of not being able to write to Delta tables from insideforeachBatchof a Structured Streaming query defined in Python. 这在常见的 Python 流式处理工作负荷中很有用，例如，使用 MERGE 和 foreachBatch 在更新模式下编写流式处理聚合。This is useful in a common Python streaming workloads; for example, Writing streaming aggregates in update mode using MERGE and foreachBatch. - Azure Data Lake Gen2 中存储的 Delta 表的性能：针对 ADLS Gen2 上的 Delta 表的最新版本的检查现在仅检查事务日志的末尾，而不是列出所有可用版本。Performance of Delta tables stored in Azure Data Lake Gen2: The check for the latest version of a Delta table on ADLS Gen2 now only checks the end of the transaction log, rather than listing all available versions. 此优化使
UPDATE成为时间恒定的操作，并显著改进了延迟情况。This optimization makesUPDATEa constant time operation, significantly improving the latency. - 优化
ZORDER BY的可伸缩性：对于非常大的 Delta 表，Z 排序现在使用较小的工作单元，这些单元由高级许可控制管理。Scalability of OptimizeZORDER BY: Z-Ordering on very large Delta tables now uses smaller units of work that are governed by advanced admission control. 此功能可以提高此操作的稳定性，且不会牺牲群集利用率。This feature improves the stability of this operation without sacrificing cluster utilization. - 提高了对包含大量列的表执行的 DML 命令的性能：现在，在
UPDATE、DELETE和MERGE命令中扫描匹配数据时，我们将执行更好的列修剪。Improved performance of DML commands on tables with large number of columns: We now perform better column pruning when scanning for matching data inUPDATE,DELETE, andMERGEcommands. - 支持在 Spark - Synapse Analytics 连接器中安装 VNet + 服务终结点：我们将 ADL Gen2 路径作为临时数据位置 (
.option("tempDir", "abfss://...")) 列入了允许列表，并添加了一个名为useAzureMSI的新选项。如果你的 Synapse Analytics 配置为通过 V2 存储帐户的托管标识进行身份验证，则将使用该选项而非forward_spark_azure_storage_credentials。Support for VNet + Service Endpoints setup in Spark - Synapse Analytics connector: We added ADL Gen2 paths to an allow list as temp data locations (.option("tempDir", "abfss://...")) and added a new option calleduseAzureMSI, to be used instead offorward_spark_azure_storage_credentialsin case your Synapse Analytics is configured to authenticate via Managed Identities to your V2 storage account. - Delta 缓存的自动失效：Delta 缓存现在会自动检测缓存后修改或覆盖的文件。Automatic invalidation for Delta cache: The Delta cache now automatically detects files that have been modified or overwritten after being cached. 所有过时项都将自动失效，并从缓存中逐出。Any stale entries are automatically invalidated and evicted from the cache. 请参阅通过缓存优化性能。See Optimize performance with caching.
- 已将 Python 库轮从 0.33.3 升级到 0.33.4。Upgraded Python library wheel from 0.33.3 to 0.33.4.
- 已将 R 库 nlme 从 3.1-139 升级到 3.1-140。Upgraded R library nlme from 3.1-139 to 3.1-140.
Bug 修复Bug fixes
- 修复了对不运行 Spark 作业的 R 命令的取消操作。Fixed cancellation for R commands that do not run Spark jobs. 以前，可以取消不运行 Spark 作业的 R 命令，但笔记本的状态会丢失；现在，可以取消命令且不会丢失笔记本状态。Previously, R commands that do not run Spark jobs could be cancelled, but the notebooks’ state would be lost; commands can now be cancelled without losing notebook state.
- 删除或移动托管表现在会使缓存的 Delta Lake 日志失效。Dropping or moving a managed table now invalidates the cached Delta Lake log.
- 修复了写入 Delta Lake 检查点可能因
FileAlreadyExistsException而失败的 bug。Fixed a bug that writing Delta Lake checkpoint may fail due toFileAlreadyExistsException. - Scala REPL 现在会设置正确的
-target:jvm-1.8标志，以支持调用那些使用 Java 8 功能的 Java 方法。Scala REPL now sets the proper-target:jvm-1.8flag to support calling Java methods that use Java 8 features.
Apache SparkApache Spark
Databricks Runtime 5.5 包括 Apache Spark 2.4.3。Databricks Runtime 5.5 includes Apache Spark 2.4.3. 此版本包括 Databricks Runtime 5.4（不受支持）中包含的所有 Spark 修复和改进功能，以及对 Spark 进行的下述其他 bug 修复和改进功能：This release includes all Spark fixes and improvements included in Databricks Runtime 5.4 (Unsupported), as well as the following additional bug fixes and improvements made to Spark:
- [SPARK-24695] 允许 UDF 返回 CalendarInterval[SPARK-24695] Allow UDFs to return CalendarInterval
- [SPARK-28056] 为 SCALAR_ITER pandas UDF 添加 docstring/doctest[SPARK-28056] add docstring/doctest for SCALAR_ITER pandas UDF
- [SPARK-28185] 当 Python UDF 提前停止时关闭生成器[SPARK-28185] Closes the generator when Python UDFs stop early
- [SPARK-24703] 对区间乘法的支持[SPARK-24703] Support for interval multiplication
- [SPARK-27018][CORE] 修复 PeriodicCheckpointer 中检查点文件的不正确删除[SPARK-27018][CORE] Fix incorrect removal of checkpointed file in PeriodicCheckpointer
- [SPARK-28127][SQL] TreeNode 的 mapChildren 方法上的宏优化[SPARK-28127][SQL] Micro optimization on TreeNode’s mapChildren method
- [SPARK-26038] 对 long 类型中容纳不下的十进制数字使用 Decimal toScalaBigInt/toJavaBigInteger[SPARK-26038] Decimal toScalaBigInt/toJavaBigInteger for decimals not fitting in long
- [SPARK-26555][SQL] 使 ScalaReflection 子类型检查线程安全[SPARK-26555][SQL] make ScalaReflection subtype checking thread safe
- [SPARK-28081][ML] 处理 word2vec 中的大型 vocab 计数[SPARK-28081][ML] Handle large vocab counts in word2vec
- [SPARK-21882][CORE] OutputMetrics 不能在 saveAsHadoopDataset 函数中正确统计写入的字节数[SPARK-21882][CORE] OutputMetrics doesn’t count written bytes correctly in the saveAsHadoopDataset function
- [SPARK-28030] 将 filePath 转换为二进制文件数据源中的 URI[SPARK-28030] convert filePath to URI in binary file data source
- [SPARK-27803][SQL] [PYTHON] 修复 Python UDF 的列修剪[SPARK-27803][SQL][PYTHON] Fix column pruning for Python UDF
- [SPARK-27917][SQL] CaseWhen 对象的规范形式不正确[SPARK-27917][SQL] canonical form of CaseWhen object is incorrect
- [SPARK-27798][SQL] from_avro 在转换为本地关系时不应产生相同的值[SPARK-27798][SQL] from_avro shouldn’t produces same value when converted to local relation
- [SPARK-27873][SQL] 禁用 enforceSchema 时，不应使用 CSV 标题中的列名称核对 columnNameOfCorruptRecord[SPARK-27873][SQL] columnNameOfCorruptRecord should not be checked with column names in CSV header when disabling enforceSchema
- [SPARK-27907][SQL] 在 0 行的情况下，HiveUDAF 应返回 NULL[SPARK-27907][SQL] HiveUDAF should return NULL in case of 0 rows
- [SPARK-27699][SQL] 部分下推 Parquet/ORC 中的析取谓词[SPARK-27699][SQL] Partially push down disjunctive predicated in Parquet/ORC
- [SPARK-27868][CORE] 套接字服务器积压的更好的默认值和文档。[SPARK-27868][CORE] Better default value and documentation for socket server backlog.
- [SPARK-27869][CORE] 从 UI 中编辑系统属性中的敏感信息[SPARK-27869][CORE] Redact sensitive information in System Properties from UI
- [SPARK-27863][SQL] [BACKPORT-2.4] 元数据文件和临时文件不应计为数据文件[SPARK-27863][SQL][BACKPORT-2.4] Metadata files and temporary files should not be counted as data files
- [SPARK-27657][ML] 修复 ml.util.Instrumentation.logFai… 的日志格式。[SPARK-27657][ML] Fix the log format of ml.util.Instrumentation.logFai…
- [SPARK-27858][SQL] 修复针对联合类型（具有多个非 null 类型）的 Avro 反序列化[SPARK-27858][SQL] Fix for Avro deserialization on union types with multiple non-null types
- [SPARK-27711][CORE] 在任务结束时取消设置 InputFileBlockHolder[SPARK-27711][CORE] Unset InputFileBlockHolder at the end of tasks
- [SPARK-27351][SQL] 对仅包含 null 值的列执行 AggregateEstimation 后出现错误的 outputRows 估计值[SPARK-27351][SQL] Wrong outputRows estimation after AggregateEstimation with only null value column
- [SPARK-27539][SQL] 修复了对包含 null 值的列进行的不准确的聚合 outputRows 估计[SPARK-27539][SQL] Fix inaccurate aggregate outputRows estimation with column containing null values”
- [SPARK-27800][SQL] 修复 BitwiseXor 测试用例的错误答案[SPARK-27800][SQL] Fix wrong answer on BitwiseXor test cases
- [SPARK-27639][SQL] InMemoryTableScan 在 UI 上显示表名称（如果可能）[SPARK-27639][SQL] InMemoryTableScan shows the table name on UI if possible
- [SPARK-27726][CORE] 修复在高负载下使用 InMemoryStore 时 ElementTrackingStore 删除操作的性能[SPARK-27726][CORE] Fix performance of ElementTrackingStore deletes when using InMemoryStore under high loads
- [SPARK-27771][SQL] 为分组函数（cube、rollup、grouping 和 grouping_id）添加 SQL 说明[SPARK-27771][SQL] Add SQL description for grouping functions (cube, rollup, grouping and grouping_id)
- [SPARK-27735][SS] 分析间隔字符串的操作在 SS 中应当不区分大小写[SPARK-27735][SS] Parsing interval string should be case-insensitive in SS
- [SPARK-26856][PYSPARK] Python 对 from_avro 和 to_avro API 的支持[SPARK-26856][PYSPARK] Python support for from_avro and to_avro APIs
- [SPARK-26870][SQL] 由于 Java 兼容性，因此可以将 to_avro/from_avro 移到函数对象中[SPARK-26870][SQL] Move to_avro/from_avro into functions object due to Java compatibility
- [SPARK-26812][SQL] 为联合中的复杂数据类型报告正确的为 Null 性[SPARK-26812][SQL] Report correct nullability for complex datatypes in Union
- [SPARK-27671][SQL] 修复从结构中的嵌套 null 进行强制转换时的错误[SPARK-27671][SQL] Fix error when casting from a nested null in a struct
- [SPARK-27673][SQL] 将
since信息添加到随机表达式、正则表达式和 null 表达式[SPARK-27673][SQL] Addsinceinfo to random, regex, null expressions - [SPARK-27672][SQL] 将
since信息添加到字符串表达式[SPARK-27672][SQL] Addsinceinfo to string expressions - [SPARK-25139][SPARK-18406][CORE] 避免 NonFatals 在 PythonRunner 中终止执行程序[SPARK-25139][SPARK-18406][CORE] Avoid NonFatals to kill the Executor in PythonRunner
- [SPARK-27624][CORE] 修复 CalenderInterval 以正确显示空间隔[SPARK-27624][CORE] Fix CalenderInterval to show an empty interval correctly
- [SPARK-27577][MLLIB] 更正 BinaryClassificationMetrics 中的 downsampled 阈值[SPARK-27577][MLLIB] Correct thresholds downsampled in BinaryClassificationMetrics
- [SPARK-27621][ML] 线性回归 - 验证与训练相关的参数（例如，仅拟合阶段中的损失）[SPARK-27621][ML] Linear Regression - validate training related params such as loss only during fitting phase
- [SPARK-26048][SPARK-24530] 将所有缺失的提交 Cherrypick 到 2.4 发布脚本[SPARK-26048][SPARK-24530] Cherrypick all the missing commits to 2.4 release script
- [SPARK-24935][SQL] 支持在 Hive UDAF 适配器中执行“初始化”->“更新”->“合并”->“完成”[SPARK-24935][SQL] support INIT -> UPDATE -> MERGE -> FINISH in Hive UDAF adapter
维护更新Maintenance updates
请参阅 Databricks Runtime 5.5 维护更新。See Databricks Runtime 5.5 maintenance updates.
系统环境System environment
- 操作系统：Ubuntu 16.04.6 LTSOperating System: Ubuntu 16.04.6 LTS
- Java：1.8.0_252Java: 1.8.0_252
- Scala：2.11.12Scala: 2.11.12
- Python：2.7.12 适用于 Python 2 群集，3.5.2 适用于 Python 3 群集。Python: 2.7.12 for Python 2 clusters and 3.5.2 for Python 3 clusters. 有关详细信息，请参阅 Python 版本。For details, see Python version.
- R：R 版本 3.6.0 (2019-04-26)R: R version 3.6.0 (2019-04-26)
- GPU 群集：安装了以下 NVIDIA GPU 库：GPU clusters: The following NVIDIA GPU libraries are installed:
- Tesla 驱动程序 375.66Tesla driver 375.66
- CUDA 9.0CUDA 9.0
- cuDNN 7.0cuDNN 7.0
备注
尽管 Apache Spark 2.4 支持 Scala 2.12，但 Databricks Runtime 5.5 不支持它。Although Scala 2.12 is supported in Apache Spark 2.4, it is not supported in Databricks Runtime 5.5.
本节内容：In this section:
- 已安装的 Python 库Installed Python libraries
- 已安装的 R 库Installed R libraries
- 已安装的 Java 库和 Scala 库（Scala 2.11 群集版本）Installed Java and Scala libraries (Scala 2.11 cluster version)
已安装的 Python 库Installed Python libraries
| 库Library | 版本Version | 库Library | 版本Version | 库Library | 版本Version |
|---|---|---|---|---|---|
| ansi2htmlansi2html | 1.1.11.1.1 | argparseargparse | 1.2.11.2.1 | backports-abcbackports-abc | 0.50.5 |
| botoboto | 2.42.02.42.0 | boto3boto3 | 1.4.11.4.1 | botocorebotocore | 1.4.701.4.70 |
| brewer2mplbrewer2mpl | 1.4.11.4.1 | certificertifi | 2016.2.282016.2.28 | cfficffi | 1.7.01.7.0 |
| chardetchardet | 2.3.02.3.0 | coloramacolorama | 0.3.70.3.7 | configobjconfigobj | 5.0.65.0.6 |
| 密码系统cryptography | 1.51.5 | cyclercycler | 0.10.00.10.0 | CythonCython | 0.24.10.24.1 |
| decoratordecorator | 4.0.104.0.10 | docutilsdocutils | 0.140.14 | enum34enum34 | 1.1.61.1.6 |
| et-xmlfileet-xmlfile | 1.0.11.0.1 | freetype-pyfreetype-py | 1.0.21.0.2 | funcsigsfuncsigs | 1.0.21.0.2 |
| fusepyfusepy | 2.0.42.0.4 | Futurefutures | 3.2.03.2.0 | ggplotggplot | 0.6.80.6.8 |
| html5libhtml5lib | 0.9990.999 | idnaidna | 2.12.1 | ipaddressipaddress | 1.0.161.0.16 |
| ipythonipython | 2.2.02.2.0 | ipython-genutilsipython-genutils | 0.1.00.1.0 | jdcaljdcal | 1.21.2 |
| Jinja2Jinja2 | 2.82.8 | jmespathjmespath | 0.9.00.9.0 | llvmlitellvmlite | 0.13.00.13.0 |
| lxmllxml | 3.6.43.6.4 | MarkupSafeMarkupSafe | 0.230.23 | matplotlibmatplotlib | 1.5.31.5.3 |
| mpld3mpld3 | 0.20.2 | msgpack-pythonmsgpack-python | 0.4.70.4.7 | ndg-httpsclientndg-httpsclient | 0.3.30.3.3 |
| numbanumba | 0.28.10.28.1 | numpynumpy | 1.11.11.11.1 | openpyxlopenpyxl | 2.3.22.3.2 |
| pandaspandas | 0.19.20.19.2 | pathlib2pathlib2 | 2.1.02.1.0 | patsypatsy | 0.4.10.4.1 |
| pexpectpexpect | 4.0.14.0.1 | picklesharepickleshare | 0.7.40.7.4 | PillowPillow | 3.3.13.3.1 |
| pippip | 19.1.119.1.1 | plyply | 3.93.9 | prompt-toolkitprompt-toolkit | 1.0.71.0.7 |
| psycopg2psycopg2 | 2.6.22.6.2 | ptyprocessptyprocess | 0.5.10.5.1 | py4jpy4j | 0.10.30.10.3 |
| pyarrowpyarrow | 0.8.00.8.0 | pyasn1pyasn1 | 0.1.90.1.9 | pycparserpycparser | 2.142.14 |
| PygmentsPygments | 2.1.32.1.3 | PyGObjectPyGObject | 3.20.03.20.0 | pyOpenSSLpyOpenSSL | 16.0.016.0.0 |
| pyparsingpyparsing | 2.2.02.2.0 | pypngpypng | 0.0.180.0.18 | PythonPython | 2.7.122.7.12 |
| python-dateutilpython-dateutil | 2.5.32.5.3 | python-geohashpython-geohash | 0.8.50.8.5 | pytzpytz | 2016.6.12016.6.1 |
| 请求requests | 2.11.12.11.1 | s3transfers3transfer | 0.1.90.1.9 | scikit-learnscikit-learn | 0.18.10.18.1 |
| scipyscipy | 0.18.10.18.1 | scourscour | 0.320.32 | seabornseaborn | 0.7.10.7.1 |
| setuptoolssetuptools | 41.0.141.0.1 | simplejsonsimplejson | 3.8.23.8.2 | simples3simples3 | 1.01.0 |
| singledispatchsingledispatch | 3.4.0.33.4.0.3 | 6six | 1.10.01.10.0 | statsmodelsstatsmodels | 0.6.10.6.1 |
| tornadotornado | 5.1.15.1.1 | traitletstraitlets | 4.3.04.3.0 | urllib3urllib3 | 1.19.11.19.1 |
| virtualenvvirtualenv | 16.1.016.1.0 | wcwidthwcwidth | 0.1.70.1.7 | wheelwheel | 0.33.40.33.4 |
| wsgirefwsgiref | 0.1.20.1.2 |
已安装的 R 库 Installed R libraries
| 库Library | 版本Version | 库Library | 版本Version | 库Library | 版本Version |
|---|---|---|---|---|---|
| abindabind | 1.4-51.4-5 | askpassaskpass | 1.11.1 | assertthatassertthat | 0.2.10.2.1 |
| backportsbackports | 1.1.31.1.3 | basebase | 3.6.03.6.0 | base64encbase64enc | 0.1-30.1-3 |
| BHBH | 1.69.0-11.69.0-1 | bitbit | 1.1-141.1-14 | bit64bit64 | 0.9-70.9-7 |
| bitopsbitops | 1.0-61.0-6 | blobblob | 1.1.11.1.1 | bootboot | 1.3-201.3-20 |
| brewbrew | 1.0-61.0-6 | callrcallr | 3.2.03.2.0 | carcar | 3.0-23.0-2 |
| carDatacarData | 3.0-23.0-2 | caretcaret | 6.0-826.0-82 | cellrangercellranger | 1.1.01.1.0 |
| chronchron | 2.3-532.3-53 | classclass | 7.3-157.3-15 | clicli | 1.1.01.1.0 |
| cliprclipr | 0.5.00.5.0 | clisymbolsclisymbols | 1.2.01.2.0 | clustercluster | 2.0.82.0.8 |
| codetoolscodetools | 0.2-160.2-16 | colorspacecolorspace | 1.4-11.4-1 | commonmarkcommonmark | 1.71.7 |
| compilercompiler | 3.6.03.6.0 | configconfig | 0.30.3 | crayoncrayon | 1.3.41.3.4 |
| curlcurl | 3.33.3 | data.tabledata.table | 1.12.01.12.0 | datasetsdatasets | 3.6.03.6.0 |
| DBIDBI | 1.0.01.0.0 | dbplyrdbplyr | 1.3.01.3.0 | descdesc | 1.2.01.2.0 |
| devtoolsdevtools | 2.0.12.0.1 | digestdigest | 0.6.180.6.18 | doMCdoMC | 1.3.51.3.5 |
| dplyrdplyr | 0.8.0.10.8.0.1 | ellipsisellipsis | 0.1.00.1.0 | fansifansi | 0.4.00.4.0 |
| forcatsforcats | 0.4.00.4.0 | foreachforeach | 1.4.41.4.4 | foreignforeign | 0.8-710.8-71 |
| forgeforge | 0.2.00.2.0 | fsfs | 1.2.71.2.7 | gbmgbm | 2.1.52.1.5 |
| genericsgenerics | 0.0.20.0.2 | ggplot2ggplot2 | 3.1.03.1.0 | ghgh | 1.0.11.0.1 |
| git2rgit2r | 0.25.20.25.2 | glmnetglmnet | 2.0-162.0-16 | glueglue | 1.3.11.3.1 |
| gowergower | 0.2.00.2.0 | graphicsgraphics | 3.6.03.6.0 | grDevicesgrDevices | 3.6.03.6.0 |
| gridgrid | 3.6.03.6.0 | gridExtragridExtra | 2.32.3 | gsubfngsubfn | 0.70.7 |
| gtablegtable | 0.3.00.3.0 | h2oh2o | 3.22.1.13.22.1.1 | havenhaven | 2.1.02.1.0 |
| hmshms | 0.4.20.4.2 | htmltoolshtmltools | 0.3.60.3.6 | htmlwidgetshtmlwidgets | 1.31.3 |
| httrhttr | 1.4.01.4.0 | hwriterhwriter | 1.3.21.3.2 | hwriterPlushwriterPlus | 1.0-31.0-3 |
| iniini | 0.3.10.3.1 | ipredipred | 0.9-80.9-8 | iteratorsiterators | 1.0.101.0.10 |
| jsonlitejsonlite | 1.61.6 | KernSmoothKernSmooth | 2.23-152.23-15 | labelinglabeling | 0.30.3 |
| latticelattice | 0.20-380.20-38 | lavalava | 1.6.51.6.5 | lazyevallazyeval | 0.2.20.2.2 |
| littlerlittler | 0.3.70.3.7 | lme4lme4 | 1.1-211.1-21 | lubridatelubridate | 1.7.41.7.4 |
| magrittrmagrittr | 1.51.5 | mapprojmapproj | 1.2.61.2.6 | mapsmaps | 3.3.03.3.0 |
| maptoolsmaptools | 0.9-50.9-5 | MASSMASS | 7.3-51.17.3-51.1 | 矩阵Matrix | 1.2-171.2-17 |
| MatrixModelsMatrixModels | 0.4-10.4-1 | memoisememoise | 1.1.01.1.0 | 方法methods | 3.6.03.6.0 |
| mgcvmgcv | 1.8-281.8-28 | mimemime | 0.60.6 | minqaminqa | 1.2.41.2.4 |
| ModelMetricsModelMetrics | 1.2.21.2.2 | munsellmunsell | 0.5.00.5.0 | mvtnormmvtnorm | 1.0-101.0-10 |
| nlmenlme | 3.1-1403.1-140 | nloptrnloptr | 1.2.11.2.1 | nnetnnet | 7.3-127.3-12 |
| numDerivnumDeriv | 2016.8-12016.8-1 | opensslopenssl | 1.31.3 | openxlsxopenxlsx | 4.1.04.1.0 |
| parallelparallel | 3.6.03.6.0 | pbkrtestpbkrtest | 0.4-70.4-7 | pillarpillar | 1.3.11.3.1 |
| pkgbuildpkgbuild | 1.0.31.0.3 | pkgconfigpkgconfig | 2.0.22.0.2 | pkgKittenpkgKitten | 0.1.40.1.4 |
| pkgloadpkgload | 1.0.21.0.2 | plogrplogr | 0.2.00.2.0 | plyrplyr | 1.8.41.8.4 |
| praisepraise | 1.0.01.0.0 | prettyunitsprettyunits | 1.0.21.0.2 | pROCpROC | 1.14.01.14.0 |
| processxprocessx | 3.3.03.3.0 | prodlimprodlim | 2018.04.182018.04.18 | 进度progress | 1.2.01.2.0 |
| protoproto | 1.0.01.0.0 | psps | 1.3.01.3.0 | purrrpurrr | 0.3.20.3.2 |
| quantregquantreg | 5.385.38 | R.methodsS3R.methodsS3 | 1.7.11.7.1 | R.ooR.oo | 1.22.01.22.0 |
| R.utilsR.utils | 2.8.02.8.0 | r2d3r2d3 | 0.2.30.2.3 | R6R6 | 2.4.02.4.0 |
| randomForestrandomForest | 4.6-144.6-14 | rappdirsrappdirs | 0.3.10.3.1 | rcmdcheckrcmdcheck | 1.3.21.3.2 |
| RColorBrewerRColorBrewer | 1.1-21.1-2 | RcppRcpp | 1.0.11.0.1 | RcppEigenRcppEigen | 0.3.3.5.00.3.3.5.0 |
| RcppRollRcppRoll | 0.3.00.3.0 | RCurlRCurl | 1.95-4.121.95-4.12 | readrreadr | 1.3.11.3.1 |
| readxlreadxl | 1.3.11.3.1 | recipesrecipes | 0.1.50.1.5 | rematchrematch | 1.0.11.0.1 |
| remotesremotes | 2.0.22.0.2 | reshape2reshape2 | 1.4.31.4.3 | riorio | 0.5.160.5.16 |
| rlangrlang | 0.3.30.3.3 | RODBCRODBC | 1.3-151.3-15 | roxygen2roxygen2 | 6.1.16.1.1 |
| rpartrpart | 4.1-154.1-15 | rprojrootrprojroot | 1.3-21.3-2 | RserveRserve | 1.8-61.8-6 |
| RSQLiteRSQLite | 2.1.12.1.1 | rstudioapirstudioapi | 0.100.10 | scalesscales | 1.0.01.0.0 |
| sessioninfosessioninfo | 1.1.11.1.1 | spsp | 1.3-11.3-1 | sparklyrsparklyr | 1.0.01.0.0 |
| SparkRSparkR | 2.4.42.4.4 | SparseMSparseM | 1.771.77 | spatialspatial | 7.3-117.3-11 |
| splinessplines | 3.6.03.6.0 | sqldfsqldf | 0.4-110.4-11 | SQUAREMSQUAREM | 2017.10-12017.10-1 |
| statmodstatmod | 1.4.301.4.30 | statsstats | 3.6.03.6.0 | stats4stats4 | 3.6.03.6.0 |
| stringistringi | 1.4.31.4.3 | stringrstringr | 1.4.01.4.0 | survivalsurvival | 2.43-32.43-3 |
| syssys | 3.13.1 | tcltktcltk | 3.6.03.6.0 | TeachingDemosTeachingDemos | 2.102.10 |
| testthattestthat | 2.0.12.0.1 | tibbletibble | 2.1.12.1.1 | tidyrtidyr | 0.8.30.8.3 |
| tidyselecttidyselect | 0.2.50.2.5 | timeDatetimeDate | 3043.1023043.102 | 工具tools | 3.6.03.6.0 |
| usethisusethis | 1.4.01.4.0 | utf8utf8 | 1.1.41.1.4 | utilsutils | 3.6.03.6.0 |
| viridisLiteviridisLite | 0.3.00.3.0 | whiskerwhisker | 0.3-20.3-2 | withrwithr | 2.1.22.1.2 |
| xml2xml2 | 1.2.01.2.0 | xopenxopen | 1.0.01.0.0 | yamlyaml | 2.2.02.2.0 |
| zipzip | 2.0.12.0.1 |
已安装的 Java 库和 Scala 库（Scala 2.11 群集版本）Installed Java and Scala libraries (Scala 2.11 cluster version)
| 组 IDGroup ID | 项目 IDArtifact ID | 版本Version |
|---|---|---|
| antlrantlr | antlrantlr | 2.7.72.7.7 |
| com.amazonawscom.amazonaws | amazon-kinesis-clientamazon-kinesis-client | 1.8.101.8.10 |
| com.amazonawscom.amazonaws | aws-java-sdk-autoscalingaws-java-sdk-autoscaling | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-cloudformationaws-java-sdk-cloudformation | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-cloudfrontaws-java-sdk-cloudfront | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-cloudhsmaws-java-sdk-cloudhsm | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-cloudsearchaws-java-sdk-cloudsearch | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-cloudtrailaws-java-sdk-cloudtrail | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-cloudwatchaws-java-sdk-cloudwatch | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-cloudwatchmetricsaws-java-sdk-cloudwatchmetrics | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-codedeployaws-java-sdk-codedeploy | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-cognitoidentityaws-java-sdk-cognitoidentity | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-cognitosyncaws-java-sdk-cognitosync | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-configaws-java-sdk-config | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-coreaws-java-sdk-core | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-datapipelineaws-java-sdk-datapipeline | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-directconnectaws-java-sdk-directconnect | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-directoryaws-java-sdk-directory | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-dynamodbaws-java-sdk-dynamodb | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-ec2aws-java-sdk-ec2 | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-ecsaws-java-sdk-ecs | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-efsaws-java-sdk-efs | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-elasticacheaws-java-sdk-elasticache | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-elasticbeanstalkaws-java-sdk-elasticbeanstalk | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-elasticloadbalancingaws-java-sdk-elasticloadbalancing | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-elastictranscoderaws-java-sdk-elastictranscoder | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-emraws-java-sdk-emr | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-glacieraws-java-sdk-glacier | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-glueaws-java-sdk-glue | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-iamaws-java-sdk-iam | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-importexportaws-java-sdk-importexport | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-kinesisaws-java-sdk-kinesis | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-kmsaws-java-sdk-kms | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-lambdaaws-java-sdk-lambda | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-logsaws-java-sdk-logs | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-machinelearningaws-java-sdk-machinelearning | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-opsworksaws-java-sdk-opsworks | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-rdsaws-java-sdk-rds | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-redshiftaws-java-sdk-redshift | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-route53aws-java-sdk-route53 | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-s3aws-java-sdk-s3 | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-sesaws-java-sdk-ses | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-simpledbaws-java-sdk-simpledb | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-simpleworkflowaws-java-sdk-simpleworkflow | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-snsaws-java-sdk-sns | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-sqsaws-java-sdk-sqs | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-ssmaws-java-sdk-ssm | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-storagegatewayaws-java-sdk-storagegateway | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-stsaws-java-sdk-sts | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-supportaws-java-sdk-support | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | aws-java-sdk-swf-librariesaws-java-sdk-swf-libraries | 1.11.221.11.22 |
| com.amazonawscom.amazonaws | aws-java-sdk-workspacesaws-java-sdk-workspaces | 1.11.3131.11.313 |
| com.amazonawscom.amazonaws | jmespath-javajmespath-java | 1.11.3131.11.313 |
| com.carrotsearchcom.carrotsearch | hppchppc | 0.7.20.7.2 |
| com.chuusaicom.chuusai | shapeless_2.11shapeless_2.11 | 2.3.22.3.2 |
| com.clearspring.analyticscom.clearspring.analytics | 流 (stream)stream | 2.7.02.7.0 |
| com.databrickscom.databricks | RserveRserve | 1.8-31.8-3 |
| com.databrickscom.databricks | dbml-local_2.11dbml-local_2.11 | 0.5.0-db8-spark2.40.5.0-db8-spark2.4 |
| com.databrickscom.databricks | dbml-local_2.11-testsdbml-local_2.11-tests | 0.5.0-db8-spark2.40.5.0-db8-spark2.4 |
| com.databrickscom.databricks | jets3tjets3t | 0.7.1-00.7.1-0 |
| com.databricks.scalapbcom.databricks.scalapb | compilerplugin_2.11compilerplugin_2.11 | 0.4.15-90.4.15-9 |
| com.databricks.scalapbcom.databricks.scalapb | scalapb-runtime_2.11scalapb-runtime_2.11 | 0.4.15-90.4.15-9 |
| com.esotericsoftwarecom.esotericsoftware | kryo-shadedkryo-shaded | 4.0.24.0.2 |
| com.esotericsoftwarecom.esotericsoftware | minlogminlog | 1.3.01.3.0 |
| com.fasterxmlcom.fasterxml | classmateclassmate | 1.0.01.0.0 |
| com.fasterxml.jackson.corecom.fasterxml.jackson.core | jackson-annotationsjackson-annotations | 2.6.72.6.7 |
| com.fasterxml.jackson.corecom.fasterxml.jackson.core | jackson-corejackson-core | 2.6.72.6.7 |
| com.fasterxml.jackson.corecom.fasterxml.jackson.core | jackson-databindjackson-databind | 2.6.7.12.6.7.1 |
| com.fasterxml.jackson.dataformatcom.fasterxml.jackson.dataformat | jackson-dataformat-cborjackson-dataformat-cbor | 2.6.72.6.7 |
| com.fasterxml.jackson.datatypecom.fasterxml.jackson.datatype | jackson-datatype-jodajackson-datatype-joda | 2.6.72.6.7 |
| com.fasterxml.jackson.modulecom.fasterxml.jackson.module | jackson-module-paranamerjackson-module-paranamer | 2.6.72.6.7 |
| com.fasterxml.jackson.modulecom.fasterxml.jackson.module | jackson-module-scala_2.11jackson-module-scala_2.11 | 2.6.7.12.6.7.1 |
| com.github.fommilcom.github.fommil | jniloaderjniloader | 1.11.1 |
| com.github.fommil.netlibcom.github.fommil.netlib | corecore | 1.1.21.1.2 |
| com.github.fommil.netlibcom.github.fommil.netlib | native_ref-javanative_ref-java | 1.11.1 |
| com.github.fommil.netlibcom.github.fommil.netlib | native_ref-java-nativesnative_ref-java-natives | 1.11.1 |
| com.github.fommil.netlibcom.github.fommil.netlib | native_system-javanative_system-java | 1.11.1 |
| com.github.fommil.netlibcom.github.fommil.netlib | native_system-java-nativesnative_system-java-natives | 1.11.1 |
| com.github.fommil.netlibcom.github.fommil.netlib | netlib-native_ref-linux-x86_64-nativesnetlib-native_ref-linux-x86_64-natives | 1.11.1 |
| com.github.fommil.netlibcom.github.fommil.netlib | netlib-native_system-linux-x86_64-nativesnetlib-native_system-linux-x86_64-natives | 1.11.1 |
| com.github.lubencom.github.luben | zstd-jnizstd-jni | 1.3.2-21.3.2-2 |
| com.github.rwlcom.github.rwl | jtransformsjtransforms | 2.4.02.4.0 |
| com.google.code.findbugscom.google.code.findbugs | jsr305jsr305 | 2.0.12.0.1 |
| com.google.code.gsoncom.google.code.gson | gsongson | 2.2.42.2.4 |
| com.google.guavacom.google.guava | guavaguava | 15.015.0 |
| com.google.protobufcom.google.protobuf | protobuf-javaprotobuf-java | 2.6.12.6.1 |
| com.googlecode.javaewahcom.googlecode.javaewah | JavaEWAHJavaEWAH | 0.3.20.3.2 |
| com.h2databasecom.h2database | h2h2 | 1.3.1741.3.174 |
| com.jcraftcom.jcraft | jschjsch | 0.1.500.1.50 |
| com.jolboxcom.jolbox | bonecpbonecp | 0.8.0.RELEASE0.8.0.RELEASE |
| com.microsoft.azurecom.microsoft.azure | azure-data-lake-store-sdkazure-data-lake-store-sdk | 2.2.82.2.8 |
| com.microsoft.azurecom.microsoft.azure | azure-storageazure-storage | 5.2.05.2.0 |
| com.microsoft.sqlservercom.microsoft.sqlserver | mssql-jdbcmssql-jdbc | 6.2.2.jre86.2.2.jre8 |
| com.ningcom.ning | compress-lzfcompress-lzf | 1.0.31.0.3 |
| com.sun.mailcom.sun.mail | javax.mailjavax.mail | 1.5.21.5.2 |
| com.thoughtworks.paranamercom.thoughtworks.paranamer | paranamerparanamer | 2.82.8 |
| com.trueaccord.lensescom.trueaccord.lenses | lenses_2.11lenses_2.11 | 0.30.3 |
| com.twittercom.twitter | chill-javachill-java | 0.9.30.9.3 |
| com.twittercom.twitter | chill_2.11chill_2.11 | 0.9.30.9.3 |
| com.twittercom.twitter | parquet-hadoop-bundleparquet-hadoop-bundle | 1.6.01.6.0 |
| com.twittercom.twitter | util-app_2.11util-app_2.11 | 6.23.06.23.0 |
| com.twittercom.twitter | util-core_2.11util-core_2.11 | 6.23.06.23.0 |
| com.twittercom.twitter | util-jvm_2.11util-jvm_2.11 | 6.23.06.23.0 |
| com.typesafecom.typesafe | configconfig | 1.2.11.2.1 |
| com.typesafe.scala-loggingcom.typesafe.scala-logging | scala-logging-api_2.11scala-logging-api_2.11 | 2.1.22.1.2 |
| com.typesafe.scala-loggingcom.typesafe.scala-logging | scala-logging-slf4j_2.11scala-logging-slf4j_2.11 | 2.1.22.1.2 |
| com.univocitycom.univocity | univocity-parsersunivocity-parsers | 2.7.32.7.3 |
| com.vlkancom.vlkan | flatbuffersflatbuffers | 1.2.0-3f79e0551.2.0-3f79e055 |
| com.zaxxercom.zaxxer | HikariCPHikariCP | 3.1.03.1.0 |
| commons-beanutilscommons-beanutils | commons-beanutilscommons-beanutils | 1.9.31.9.3 |
| commons-clicommons-cli | commons-clicommons-cli | 1.21.2 |
| commons-codeccommons-codec | commons-codeccommons-codec | 1.101.10 |
| commons-collectionscommons-collections | commons-collectionscommons-collections | 3.2.23.2.2 |
| commons-configurationcommons-configuration | commons-configurationcommons-configuration | 1.61.6 |
| commons-dbcpcommons-dbcp | commons-dbcpcommons-dbcp | 1.41.4 |
| commons-digestercommons-digester | commons-digestercommons-digester | 1.81.8 |
| commons-httpclientcommons-httpclient | commons-httpclientcommons-httpclient | 3.13.1 |
| commons-iocommons-io | commons-iocommons-io | 2.42.4 |
| commons-langcommons-lang | commons-langcommons-lang | 2.62.6 |
| commons-loggingcommons-logging | commons-loggingcommons-logging | 1.1.31.1.3 |
| commons-netcommons-net | commons-netcommons-net | 3.13.1 |
| commons-poolcommons-pool | commons-poolcommons-pool | 1.5.41.5.4 |
| info.ganglia.gmetric4jinfo.ganglia.gmetric4j | gmetric4jgmetric4j | 1.0.71.0.7 |
| io.airliftio.airlift | aircompressoraircompressor | 0.100.10 |
| io.dropwizard.metricsio.dropwizard.metrics | metrics-coremetrics-core | 3.1.53.1.5 |
| io.dropwizard.metricsio.dropwizard.metrics | metrics-gangliametrics-ganglia | 3.1.53.1.5 |
| io.dropwizard.metricsio.dropwizard.metrics | metrics-graphitemetrics-graphite | 3.1.53.1.5 |
| io.dropwizard.metricsio.dropwizard.metrics | metrics-healthchecksmetrics-healthchecks | 3.1.53.1.5 |
| io.dropwizard.metricsio.dropwizard.metrics | metrics-jetty9metrics-jetty9 | 3.1.53.1.5 |
| io.dropwizard.metricsio.dropwizard.metrics | metrics-jsonmetrics-json | 3.1.53.1.5 |
| io.dropwizard.metricsio.dropwizard.metrics | metrics-jvmmetrics-jvm | 3.1.53.1.5 |
| io.dropwizard.metricsio.dropwizard.metrics | metrics-log4jmetrics-log4j | 3.1.53.1.5 |
| io.dropwizard.metricsio.dropwizard.metrics | metrics-servletsmetrics-servlets | 3.1.53.1.5 |
| io.nettyio.netty | nettynetty | 3.9.9.Final3.9.9.Final |
| io.nettyio.netty | netty-allnetty-all | 4.1.17.Final4.1.17.Final |
| javax.activationjavax.activation | activationactivation | 1.1.11.1.1 |
| javax.annotationjavax.annotation | javax.annotation-apijavax.annotation-api | 1.21.2 |
| javax.eljavax.el | javax.el-apijavax.el-api | 2.2.42.2.4 |
| javax.jdojavax.jdo | jdo-apijdo-api | 3.0.13.0.1 |
| javax.servletjavax.servlet | javax.servlet-apijavax.servlet-api | 3.1.03.1.0 |
| javax.servlet.jspjavax.servlet.jsp | jsp-apijsp-api | 2.12.1 |
| javax.transactionjavax.transaction | jtajta | 1.11.1 |
| javax.validationjavax.validation | validation-apivalidation-api | 1.1.0.Final1.1.0.Final |
| javax.ws.rsjavax.ws.rs | javax.ws.rs-apijavax.ws.rs-api | 2.0.12.0.1 |
| javax.xml.bindjavax.xml.bind | jaxb-apijaxb-api | 2.2.22.2.2 |
| javax.xml.streamjavax.xml.stream | stax-apistax-api | 1.0-21.0-2 |
| javolutionjavolution | javolutionjavolution | 5.5.15.5.1 |
| jlinejline | jlinejline | 2.14.62.14.6 |
| joda-timejoda-time | joda-timejoda-time | 2.9.32.9.3 |
| log4jlog4j | apache-log4j-extrasapache-log4j-extras | 1.2.171.2.17 |
| log4jlog4j | log4jlog4j | 1.2.171.2.17 |
| maven-treesmaven-trees | hive-exec-with-gluehive-exec-with-glue | hive-12679-patch_deployhive-12679-patch_deploy |
| maven-treesmaven-trees | hive-exec-with-gluehive-exec-with-glue | hive-exec_shadedhive-exec_shaded |
| net.hydromaticnet.hydromatic | eigenbase-propertieseigenbase-properties | 1.1.51.1.5 |
| net.razorvinenet.razorvine | pyrolitepyrolite | 4.134.13 |
| net.sf.jpamnet.sf.jpam | jpamjpam | 1.11.1 |
| net.sf.opencsvnet.sf.opencsv | opencsvopencsv | 2.32.3 |
| net.sf.supercsvnet.sf.supercsv | super-csvsuper-csv | 2.2.02.2.0 |
| net.snowflakenet.snowflake | snowflake-ingest-sdksnowflake-ingest-sdk | 0.9.50.9.5 |
| net.snowflakenet.snowflake | snowflake-jdbcsnowflake-jdbc | 3.6.153.6.15 |
| net.snowflakenet.snowflake | spark-snowflake_2.11spark-snowflake_2.11 | 2.4.10-spark_2.42.4.10-spark_2.4 |
| net.sourceforge.f2jnet.sourceforge.f2j | arpack_combined_allarpack_combined_all | 0.10.1 |
| org.acpltorg.acplt | oncrpconcrpc | 1.0.71.0.7 |
| org.antlrorg.antlr | ST4ST4 | 4.0.44.0.4 |
| org.antlrorg.antlr | antlr-runtimeantlr-runtime | 3.43.4 |
| org.antlrorg.antlr | antlr4-runtimeantlr4-runtime | 4.74.7 |
| org.antlrorg.antlr | stringtemplatestringtemplate | 3.2.13.2.1 |
| org.apache.antorg.apache.ant | antant | 1.9.21.9.2 |
| org.apache.antorg.apache.ant | ant-jschant-jsch | 1.9.21.9.2 |
| org.apache.antorg.apache.ant | ant-launcherant-launcher | 1.9.21.9.2 |
| org.apache.arroworg.apache.arrow | arrow-formatarrow-format | 0.10.00.10.0 |
| org.apache.arroworg.apache.arrow | arrow-memoryarrow-memory | 0.10.00.10.0 |
| org.apache.arroworg.apache.arrow | arrow-vectorarrow-vector | 0.10.00.10.0 |
| org.apache.avroorg.apache.avro | avroavro | 1.8.21.8.2 |
| org.apache.avroorg.apache.avro | avro-ipcavro-ipc | 1.8.21.8.2 |
| org.apache.avroorg.apache.avro | avro-mapred-hadoop2avro-mapred-hadoop2 | 1.8.21.8.2 |
| org.apache.calciteorg.apache.calcite | calcite-avaticacalcite-avatica | 1.2.0-incubating1.2.0-incubating |
| org.apache.calciteorg.apache.calcite | calcite-corecalcite-core | 1.2.0-incubating1.2.0-incubating |
| org.apache.calciteorg.apache.calcite | calcite-linq4jcalcite-linq4j | 1.2.0-incubating1.2.0-incubating |
| org.apache.commonsorg.apache.commons | commons-compresscommons-compress | 1.8.11.8.1 |
| org.apache.commonsorg.apache.commons | commons-cryptocommons-crypto | 1.0.01.0.0 |
| org.apache.commonsorg.apache.commons | commons-lang3commons-lang3 | 3.53.5 |
| org.apache.commonsorg.apache.commons | commons-math3commons-math3 | 3.4.13.4.1 |
| org.apache.curatororg.apache.curator | curator-clientcurator-client | 2.7.12.7.1 |
| org.apache.curatororg.apache.curator | curator-frameworkcurator-framework | 2.7.12.7.1 |
| org.apache.curatororg.apache.curator | curator-recipescurator-recipes | 2.7.12.7.1 |
| org.apache.derbyorg.apache.derby | derbyderby | 10.12.1.110.12.1.1 |
| org.apache.directory.apiorg.apache.directory.api | api-asn1-apiapi-asn1-api | 1.0.0-M201.0.0-M20 |
| org.apache.directory.apiorg.apache.directory.api | api-utilapi-util | 1.0.0-M201.0.0-M20 |
| org.apache.directory.serverorg.apache.directory.server | apacheds-i18napacheds-i18n | 2.0.0-M152.0.0-M15 |
| org.apache.directory.serverorg.apache.directory.server | apacheds-kerberos-codecapacheds-kerberos-codec | 2.0.0-M152.0.0-M15 |
| org.apache.hadooporg.apache.hadoop | hadoop-annotationshadoop-annotations | 2.7.32.7.3 |
| org.apache.hadooporg.apache.hadoop | hadoop-authhadoop-auth | 2.7.32.7.3 |
| org.apache.hadooporg.apache.hadoop | hadoop-clienthadoop-client | 2.7.32.7.3 |
| org.apache.hadooporg.apache.hadoop | hadoop-commonhadoop-common | 2.7.32.7.3 |
| org.apache.hadooporg.apache.hadoop | hadoop-hdfshadoop-hdfs | 2.7.32.7.3 |
| org.apache.hadooporg.apache.hadoop | hadoop-mapreduce-client-apphadoop-mapreduce-client-app | 2.7.32.7.3 |
| org.apache.hadooporg.apache.hadoop | hadoop-mapreduce-client-commonhadoop-mapreduce-client-common | 2.7.32.7.3 |
| org.apache.hadooporg.apache.hadoop | hadoop-mapreduce-client-corehadoop-mapreduce-client-core | 2.7.32.7.3 |
| org.apache.hadooporg.apache.hadoop | hadoop-mapreduce-client-jobclienthadoop-mapreduce-client-jobclient | 2.7.32.7.3 |
| org.apache.hadooporg.apache.hadoop | hadoop-mapreduce-client-shufflehadoop-mapreduce-client-shuffle | 2.7.32.7.3 |
| org.apache.hadooporg.apache.hadoop | hadoop-yarn-apihadoop-yarn-api | 2.7.32.7.3 |
| org.apache.hadooporg.apache.hadoop | hadoop-yarn-clienthadoop-yarn-client | 2.7.32.7.3 |
| org.apache.hadooporg.apache.hadoop | hadoop-yarn-commonhadoop-yarn-common | 2.7.32.7.3 |
| org.apache.hadooporg.apache.hadoop | hadoop-yarn-server-commonhadoop-yarn-server-common | 2.7.32.7.3 |
| org.apache.htraceorg.apache.htrace | htrace-corehtrace-core | 3.1.0-incubating3.1.0-incubating |
| org.apache.httpcomponentsorg.apache.httpcomponents | httpclienthttpclient | 4.5.44.5.4 |
| org.apache.httpcomponentsorg.apache.httpcomponents | httpcorehttpcore | 4.4.84.4.8 |
| org.apache.ivyorg.apache.ivy | ivyivy | 2.4.02.4.0 |
| org.apache.orcorg.apache.orc | orc-core-nohiveorc-core-nohive | 1.5.21.5.2 |
| org.apache.orcorg.apache.orc | orc-mapreduce-nohiveorc-mapreduce-nohive | 1.5.21.5.2 |
| org.apache.orcorg.apache.orc | orc-shimsorc-shims | 1.5.21.5.2 |
| org.apache.parquetorg.apache.parquet | parquet-columnparquet-column | 1.10.1.1-databricks31.10.1.1-databricks3 |
| org.apache.parquetorg.apache.parquet | parquet-commonparquet-common | 1.10.1.1-databricks31.10.1.1-databricks3 |
| org.apache.parquetorg.apache.parquet | parquet-encodingparquet-encoding | 1.10.1.1-databricks31.10.1.1-databricks3 |
| org.apache.parquetorg.apache.parquet | parquet-formatparquet-format | 2.4.02.4.0 |
| org.apache.parquetorg.apache.parquet | parquet-hadoopparquet-hadoop | 1.10.1.1-databricks31.10.1.1-databricks3 |
| org.apache.parquetorg.apache.parquet | parquet-jacksonparquet-jackson | 1.10.1.1-databricks31.10.1.1-databricks3 |
| org.apache.thriftorg.apache.thrift | libfb303libfb303 | 0.9.30.9.3 |
| org.apache.thriftorg.apache.thrift | libthriftlibthrift | 0.9.30.9.3 |
| org.apache.xbeanorg.apache.xbean | xbean-asm6-shadedxbean-asm6-shaded | 4.84.8 |
| org.apache.zookeeperorg.apache.zookeeper | zookeeperzookeeper | 3.4.63.4.6 |
| org.codehaus.jacksonorg.codehaus.jackson | jackson-core-asljackson-core-asl | 1.9.131.9.13 |
| org.codehaus.jacksonorg.codehaus.jackson | jackson-jaxrsjackson-jaxrs | 1.9.131.9.13 |
| org.codehaus.jacksonorg.codehaus.jackson | jackson-mapper-asljackson-mapper-asl | 1.9.131.9.13 |
| org.codehaus.jacksonorg.codehaus.jackson | jackson-xcjackson-xc | 1.9.131.9.13 |
| org.codehaus.janinoorg.codehaus.janino | commons-compilercommons-compiler | 3.0.103.0.10 |
| org.codehaus.janinoorg.codehaus.janino | janinojanino | 3.0.103.0.10 |
| org.datanucleusorg.datanucleus | datanucleus-api-jdodatanucleus-api-jdo | 3.2.63.2.6 |
| org.datanucleusorg.datanucleus | datanucleus-coredatanucleus-core | 3.2.103.2.10 |
| org.datanucleusorg.datanucleus | datanucleus-rdbmsdatanucleus-rdbms | 3.2.93.2.9 |
| org.eclipse.jettyorg.eclipse.jetty | jetty-clientjetty-client | 9.3.20.v201705319.3.20.v20170531 |
| org.eclipse.jettyorg.eclipse.jetty | jetty-continuationjetty-continuation | 9.3.20.v201705319.3.20.v20170531 |
| org.eclipse.jettyorg.eclipse.jetty | jetty-httpjetty-http | 9.3.20.v201705319.3.20.v20170531 |
| org.eclipse.jettyorg.eclipse.jetty | jetty-iojetty-io | 9.3.20.v201705319.3.20.v20170531 |
| org.eclipse.jettyorg.eclipse.jetty | jetty-jndijetty-jndi | 9.3.20.v201705319.3.20.v20170531 |
| org.eclipse.jettyorg.eclipse.jetty | jetty-plusjetty-plus | 9.3.20.v201705319.3.20.v20170531 |
| org.eclipse.jettyorg.eclipse.jetty | jetty-proxyjetty-proxy | 9.3.20.v201705319.3.20.v20170531 |
| org.eclipse.jettyorg.eclipse.jetty | jetty-securityjetty-security | 9.3.20.v201705319.3.20.v20170531 |
| org.eclipse.jettyorg.eclipse.jetty | jetty-serverjetty-server | 9.3.20.v201705319.3.20.v20170531 |
| org.eclipse.jettyorg.eclipse.jetty | jetty-servletjetty-servlet | 9.3.20.v201705319.3.20.v20170531 |
| org.eclipse.jettyorg.eclipse.jetty | jetty-servletsjetty-servlets | 9.3.20.v201705319.3.20.v20170531 |
| org.eclipse.jettyorg.eclipse.jetty | jetty-utiljetty-util | 9.3.20.v201705319.3.20.v20170531 |
| org.eclipse.jettyorg.eclipse.jetty | jetty-webappjetty-webapp | 9.3.20.v201705319.3.20.v20170531 |
| org.eclipse.jettyorg.eclipse.jetty | jetty-xmljetty-xml | 9.3.20.v201705319.3.20.v20170531 |
| org.fusesource.leveldbjniorg.fusesource.leveldbjni | leveldbjni-allleveldbjni-all | 1.81.8 |
| org.glassfish.hk2org.glassfish.hk2 | hk2-apihk2-api | 2.4.0-b342.4.0-b34 |
| org.glassfish.hk2org.glassfish.hk2 | hk2-locatorhk2-locator | 2.4.0-b342.4.0-b34 |
| org.glassfish.hk2org.glassfish.hk2 | hk2-utilshk2-utils | 2.4.0-b342.4.0-b34 |
| org.glassfish.hk2org.glassfish.hk2 | osgi-resource-locatorosgi-resource-locator | 1.0.11.0.1 |
| org.glassfish.hk2.externalorg.glassfish.hk2.external | aopalliance-repackagedaopalliance-repackaged | 2.4.0-b342.4.0-b34 |
| org.glassfish.hk2.externalorg.glassfish.hk2.external | javax.injectjavax.inject | 2.4.0-b342.4.0-b34 |
| org.glassfish.jersey.bundles.repackagedorg.glassfish.jersey.bundles.repackaged | jersey-guavajersey-guava | 2.22.22.22.2 |
| org.glassfish.jersey.containersorg.glassfish.jersey.containers | jersey-container-servletjersey-container-servlet | 2.22.22.22.2 |
| org.glassfish.jersey.containersorg.glassfish.jersey.containers | jersey-container-servlet-corejersey-container-servlet-core | 2.22.22.22.2 |
| org.glassfish.jersey.coreorg.glassfish.jersey.core | jersey-clientjersey-client | 2.22.22.22.2 |
| org.glassfish.jersey.coreorg.glassfish.jersey.core | jersey-commonjersey-common | 2.22.22.22.2 |
| org.glassfish.jersey.coreorg.glassfish.jersey.core | jersey-serverjersey-server | 2.22.22.22.2 |
| org.glassfish.jersey.mediaorg.glassfish.jersey.media | jersey-media-jaxbjersey-media-jaxb | 2.22.22.22.2 |
| org.hibernateorg.hibernate | hibernate-validatorhibernate-validator | 5.1.1.Final5.1.1.Final |
| org.iq80.snappyorg.iq80.snappy | snappysnappy | 0.20.2 |
| org.javassistorg.javassist | javassistjavassist | 3.18.1-GA3.18.1-GA |
| org.jboss.loggingorg.jboss.logging | jboss-loggingjboss-logging | 3.1.3.GA3.1.3.GA |
| org.jdbiorg.jdbi | jdbijdbi | 2.63.12.63.1 |
| org.jodaorg.joda | joda-convertjoda-convert | 1.71.7 |
| org.joddorg.jodd | jodd-corejodd-core | 3.5.23.5.2 |
| org.json4sorg.json4s | json4s-ast_2.11json4s-ast_2.11 | 3.5.33.5.3 |
| org.json4sorg.json4s | json4s-core_2.11json4s-core_2.11 | 3.5.33.5.3 |
| org.json4sorg.json4s | json4s-jackson_2.11json4s-jackson_2.11 | 3.5.33.5.3 |
| org.json4sorg.json4s | json4s-scalap_2.11json4s-scalap_2.11 | 3.5.33.5.3 |
| org.lz4org.lz4 | lz4-javalz4-java | 1.4.01.4.0 |
| org.mariadb.jdbcorg.mariadb.jdbc | mariadb-java-clientmariadb-java-client | 2.1.22.1.2 |
| org.mockitoorg.mockito | mockito-allmockito-all | 1.9.51.9.5 |
| org.objenesisorg.objenesis | objenesisobjenesis | 2.5.12.5.1 |
| org.postgresqlorg.postgresql | postgresqlpostgresql | 42.1.442.1.4 |
| org.roaringbitmaporg.roaringbitmap | RoaringBitmapRoaringBitmap | 0.7.450.7.45 |
| org.roaringbitmaporg.roaringbitmap | shimsshims | 0.7.450.7.45 |
| org.rocksdborg.rocksdb | rocksdbjnirocksdbjni | 5.2.15.2.1 |
| org.rosuda.REngineorg.rosuda.REngine | REngineREngine | 2.1.02.1.0 |
| org.scala-langorg.scala-lang | scala-compiler_2.11scala-compiler_2.11 | 2.11.122.11.12 |
| org.scala-langorg.scala-lang | scala-library_2.11scala-library_2.11 | 2.11.122.11.12 |
| org.scala-langorg.scala-lang | scala-reflect_2.11scala-reflect_2.11 | 2.11.122.11.12 |
| org.scala-lang.modulesorg.scala-lang.modules | scala-parser-combinators_2.11scala-parser-combinators_2.11 | 1.1.01.1.0 |
| org.scala-lang.modulesorg.scala-lang.modules | scala-xml_2.11scala-xml_2.11 | 1.0.51.0.5 |
| org.scala-sbtorg.scala-sbt | test-interfacetest-interface | 1.01.0 |
| org.scalacheckorg.scalacheck | scalacheck_2.11scalacheck_2.11 | 1.12.51.12.5 |
| org.scalacticorg.scalactic | scalactic_2.11scalactic_2.11 | 3.0.33.0.3 |
| org.scalanlporg.scalanlp | breeze-macros_2.11breeze-macros_2.11 | 0.13.20.13.2 |
| org.scalanlporg.scalanlp | breeze_2.11breeze_2.11 | 0.13.20.13.2 |
| org.scalatestorg.scalatest | scalatest_2.11scalatest_2.11 | 3.0.33.0.3 |
| org.slf4jorg.slf4j | jcl-over-slf4jjcl-over-slf4j | 1.7.161.7.16 |
| org.slf4jorg.slf4j | jul-to-slf4jjul-to-slf4j | 1.7.161.7.16 |
| org.slf4jorg.slf4j | slf4j-apislf4j-api | 1.7.161.7.16 |
| org.slf4jorg.slf4j | slf4j-log4j12slf4j-log4j12 | 1.7.161.7.16 |
| org.spark-project.hiveorg.spark-project.hive | hive-beelinehive-beeline | 1.2.1.spark21.2.1.spark2 |
| org.spark-project.hiveorg.spark-project.hive | hive-clihive-cli | 1.2.1.spark21.2.1.spark2 |
| org.spark-project.hiveorg.spark-project.hive | hive-jdbchive-jdbc | 1.2.1.spark21.2.1.spark2 |
| org.spark-project.hiveorg.spark-project.hive | hive-metastorehive-metastore | 1.2.1.spark21.2.1.spark2 |
| org.spark-project.sparkorg.spark-project.spark | unusedunused | 1.0.01.0.0 |
| org.spire-mathorg.spire-math | spire-macros_2.11spire-macros_2.11 | 0.13.00.13.0 |
| org.spire-mathorg.spire-math | spire_2.11spire_2.11 | 0.13.00.13.0 |
| org.springframeworkorg.springframework | spring-corespring-core | 4.1.4.RELEASE4.1.4.RELEASE |
| org.springframeworkorg.springframework | spring-testspring-test | 4.1.4.RELEASE4.1.4.RELEASE |
| org.tukaaniorg.tukaani | xzxz | 1.51.5 |
| org.typelevelorg.typelevel | machinist_2.11machinist_2.11 | 0.6.10.6.1 |
| org.typelevelorg.typelevel | macro-compat_2.11macro-compat_2.11 | 1.1.11.1.1 |
| org.xerialorg.xerial | sqlite-jdbcsqlite-jdbc | 3.8.11.23.8.11.2 |
| org.xerial.snappyorg.xerial.snappy | snappy-javasnappy-java | 1.1.7.31.1.7.3 |
| org.yamlorg.yaml | snakeyamlsnakeyaml | 1.161.16 |
| orooro | orooro | 2.0.82.0.8 |
| software.amazon.ionsoftware.amazon.ion | ion-javaion-java | 1.0.21.0.2 |
| staxstax | stax-apistax-api | 1.0.11.0.1 |
| xmlencxmlenc | xmlencxmlenc | 0.520.52 |