Databricks Runtime 5.5 LTSDatabricks Runtime 5.5 LTS

Databricks 于 2019 年 7 月发布了此映像。Databricks released this image in July 2019. 2019 年 8 月为其声明了长期支持 (LTS)。It was declared Long Term Support (LTS) in August 2019.

以下发行说明提供了由 Apache Spark 支持的 Databricks Runtime 5.5 的相关信息。The following release notes provide information about Databricks Runtime 5.5, powered by Apache Spark.

新增功能New features

Azure Databricks 上的 Delta Lake 自动优化Delta Lake on Azure Databricks Auto Optimize

现在,将数据写入云存储时,你需要压缩文件以获得最佳 I/O 性能。Today, when you write data into cloud storage, you need to compact files for optimal I/O performance. 你必须考虑正确的文件大小、压缩文件的频率、要使用的群集的大小,等等。You have to worry about the right file size, how often to compact the files, how big a cluster to use, and so on. 为了解决此类问题,我们非常高兴地宣布,通过 Azure Databricks 上的 Delta Lake 进行自动优化的功能正式发布。To address this class of problems, we are excited to announce the general availability of Auto Optimize with Delta Lake on Azure Databricks. 每次写入到 Delta 表期间,我们都会自动确定正确的文件大小并压缩文件,因此你不必为优化存储布局担忧。During every write to Delta tables, we automatically figure out the right file sizes and compact files so that you don’t have to worry about optimizing the storage layout. 在写入期间,如果 auto-optimize 选项为 true,则 Azure Databricks 会自动确定是否需要优化以及是否优化小文件。During writes, if the auto-optimize option is true, Azure Databricks automatically determines if an optimize is required and optimizes the small files. 有关详细信息,请参阅自动优化For details, see Auto Optimize.

Azure Databricks 上的 Delta Lake 改善了最小值、最大值和计数聚合查询性能Delta Lake on Azure Databricks improved min, max, and count aggregation query performance

通过减少读取的数据量,针对 Azure Databricks 上的 Delta Lake 的最小值、最大值和计数聚合查询的性能得到显着改善。The performance of min, max, and count aggregation queries for Delta Lake on Azure Databricks has been significantly improved by reducing the amount of data that’s read. 这些查询现在使用元数据中的统计信息和分区值来运行,而不是通过扫描数据来这样做。These queries are now run using statistics and partition values in the metadata, rather than scanning the data.

更快的模型推理管道,以及改进的二进制文件数据源和标量迭代器 pandas UDF(公共预览版)Faster model inference pipelines with improved binary file data source and scalar iterator pandas UDF (Public Preview)

机器学习任务,尤其是在图像和视频域中,通常需要对大量文件进行操作。Machine learning tasks, especially in the image and video domain, often have to operate on a large number of files. 我们在 Databricks Runtime 5.4 中提供了二进制文件数据源,用于将任意文件(例如图像)ETL 到 Spark 表中。In Databricks Runtime 5.4, we already made available the binary file data source to help ETL arbitrary files such as images, into Spark tables. 在 Databricks Runtime 5.5 中,我们添加了选项 recursiveFileLookup,用于以递归方式从嵌套的输入目录加载文件。In Databricks Runtime 5.5, we have added an option, recursiveFileLookup, to load files recursively from nested input directories. 请参阅二进制文件See Binary file.

有了二进制文件数据源,就可以使用标量 pandas UDF 从 Spark 表并行运行模型推理任务。The binary file data source enables you to run model inference tasks in parallel from Spark tables using a scalar pandas UDF. 但是,你可能必须为每个记录批初始化模型,这会带来开销。However, you might have to initialize the model for every record batch, which introduces overhead. 在 Databricks Runtime 5.5 中,我们从 Apache Spark 主节点向后移植了一个新的称为“标量迭代器”的 pandas UDF 类型。In Databricks Runtime 5.5, we backported a new pandas UDF type called “scalar iterator” from Apache Spark master. 使用此方法,只需对模型进行一次初始化,并将模型应用于多个输入批,这可能会使模型(例如 ResNet50)加速 2-3 倍。With it you can initialize a model only once and apply the model to many input batches, which can result in a 2-3x speedup for models like ResNet50. 请参阅序列到标量 UDFSee Series to scalar UDF.

R 笔记本中的机密 APISecrets API in R notebooks

使用机密 API,你可以将机密注入到笔记本中,无需对其进行硬编码。The Secrets API lets you inject secrets into notebooks without hardcoding them. 除了现有的针对 Python 和 Scala 笔记本的支持,此 API 现在还可在 R 笔记本中使用。This API is now available in R notebooks in addition to existing support for Python and Scala notebooks. 可以使用 dbutils.secrets.get 函数获取机密。You can use the dbutils.secrets.get function to obtain secrets. 在将机密输出到笔记本单元格之前,会对其进行修正。Secrets are redacted before printing to a notebook cell.

改进Improvements

  • 支持在 Python foreachBatch 中运行 Delta Lake SQL 操作:我们已修复了不能从 Python 中定义的结构化流式处理查询的 foreachBatch 内部写入到 Delta 表的已知限制。Support for running Delta Lake SQL operations in Python foreachBatch: We have fixed the known limitation of not being able to write to Delta tables from inside foreachBatch of a Structured Streaming query defined in Python. 这在常见的 Python 流式处理工作负荷中很有用,例如,使用 MERGE 和 foreachBatch 在更新模式下编写流式处理聚合This is useful in a common Python streaming workloads; for example, Writing streaming aggregates in update mode using MERGE and foreachBatch.
  • Azure Data Lake Gen2 中存储的 Delta 表的性能:针对 ADLS Gen2 上的 Delta 表的最新版本的检查现在仅检查事务日志的末尾,而不是列出所有可用版本。Performance of Delta tables stored in Azure Data Lake Gen2: The check for the latest version of a Delta table on ADLS Gen2 now only checks the end of the transaction log, rather than listing all available versions. 此优化使 UPDATE 成为时间恒定的操作,并显著改进了延迟情况。This optimization makes UPDATE a constant time operation, significantly improving the latency.
  • 优化 ZORDER BY 的可伸缩性:对于非常大的 Delta 表,Z 排序现在使用较小的工作单元,这些单元由高级许可控制管理。Scalability of Optimize ZORDER BY: Z-Ordering on very large Delta tables now uses smaller units of work that are governed by advanced admission control. 此功能可以提高此操作的稳定性,且不会牺牲群集利用率。This feature improves the stability of this operation without sacrificing cluster utilization.
  • 提高了对包含大量列的表执行的 DML 命令的性能:现在,在 UPDATEDELETEMERGE 命令中扫描匹配数据时,我们将执行更好的列修剪。Improved performance of DML commands on tables with large number of columns: We now perform better column pruning when scanning for matching data in UPDATE, DELETE, and MERGE commands.
  • 支持在 Spark - Synapse Analytics 连接器中安装 VNet + 服务终结点:我们将 ADL Gen2 路径作为临时数据位置 (.option("tempDir", "abfss://...")) 列入了允许列表,并添加了一个名为 useAzureMSI 的新选项。如果你的 Synapse Analytics 配置为通过 V2 存储帐户的托管标识进行身份验证,则将使用该选项而非 forward_spark_azure_storage_credentialsSupport for VNet + Service Endpoints setup in Spark - Synapse Analytics connector: We added ADL Gen2 paths to an allow list as temp data locations (.option("tempDir", "abfss://...")) and added a new option called useAzureMSI, to be used instead of forward_spark_azure_storage_credentials in case your Synapse Analytics is configured to authenticate via Managed Identities to your V2 storage account.
  • Delta 缓存的自动失效:Delta 缓存现在会自动检测缓存后修改或覆盖的文件。Automatic invalidation for Delta cache: The Delta cache now automatically detects files that have been modified or overwritten after being cached. 所有过时项都将自动失效,并从缓存中逐出。Any stale entries are automatically invalidated and evicted from the cache. 请参阅通过缓存优化性能See Optimize performance with caching.
  • 已将 Python 库轮从 0.33.3 升级到 0.33.4。Upgraded Python library wheel from 0.33.3 to 0.33.4.
  • 已将 R 库 nlme 从 3.1-139 升级到 3.1-140。Upgraded R library nlme from 3.1-139 to 3.1-140.

Bug 修复Bug fixes

  • 修复了对不运行 Spark 作业的 R 命令的取消操作。Fixed cancellation for R commands that do not run Spark jobs. 以前,可以取消不运行 Spark 作业的 R 命令,但笔记本的状态会丢失;现在,可以取消命令且不会丢失笔记本状态。Previously, R commands that do not run Spark jobs could be cancelled, but the notebooks’ state would be lost; commands can now be cancelled without losing notebook state.
  • 删除或移动托管表现在会使缓存的 Delta Lake 日志失效。Dropping or moving a managed table now invalidates the cached Delta Lake log.
  • 修复了写入 Delta Lake 检查点可能因 FileAlreadyExistsException 而失败的 bug。Fixed a bug that writing Delta Lake checkpoint may fail due to FileAlreadyExistsException.
  • Scala REPL 现在会设置正确的 -target:jvm-1.8 标志,以支持调用那些使用 Java 8 功能的 Java 方法。Scala REPL now sets the proper -target:jvm-1.8 flag to support calling Java methods that use Java 8 features.

Apache SparkApache Spark

Databricks Runtime 5.5 包括 Apache Spark 2.4.3。Databricks Runtime 5.5 includes Apache Spark 2.4.3. 此版本包括 Databricks Runtime 5.4(不受支持)中包含的所有 Spark 修复和改进功能,以及对 Spark 进行的下述其他 bug 修复和改进功能:This release includes all Spark fixes and improvements included in Databricks Runtime 5.4 (Unsupported), as well as the following additional bug fixes and improvements made to Spark:

  • [SPARK-24695] 允许 UDF 返回 CalendarInterval[SPARK-24695] Allow UDFs to return CalendarInterval
  • [SPARK-28056] 为 SCALAR_ITER pandas UDF 添加 docstring/doctest[SPARK-28056] add docstring/doctest for SCALAR_ITER pandas UDF
  • [SPARK-28185] 当 Python UDF 提前停止时关闭生成器[SPARK-28185] Closes the generator when Python UDFs stop early
  • [SPARK-24703] 对区间乘法的支持[SPARK-24703] Support for interval multiplication
  • [SPARK-27018][CORE] 修复 PeriodicCheckpointer 中检查点文件的不正确删除[SPARK-27018][CORE] Fix incorrect removal of checkpointed file in PeriodicCheckpointer
  • [SPARK-28127][SQL] TreeNode 的 mapChildren 方法上的宏优化[SPARK-28127][SQL] Micro optimization on TreeNode’s mapChildren method
  • [SPARK-26038] 对 long 类型中容纳不下的十进制数字使用 Decimal toScalaBigInt/toJavaBigInteger[SPARK-26038] Decimal toScalaBigInt/toJavaBigInteger for decimals not fitting in long
  • [SPARK-26555][SQL] 使 ScalaReflection 子类型检查线程安全[SPARK-26555][SQL] make ScalaReflection subtype checking thread safe
  • [SPARK-28081][ML] 处理 word2vec 中的大型 vocab 计数[SPARK-28081][ML] Handle large vocab counts in word2vec
  • [SPARK-21882][CORE] OutputMetrics 不能在 saveAsHadoopDataset 函数中正确统计写入的字节数[SPARK-21882][CORE] OutputMetrics doesn’t count written bytes correctly in the saveAsHadoopDataset function
  • [SPARK-28030] 将 filePath 转换为二进制文件数据源中的 URI[SPARK-28030] convert filePath to URI in binary file data source
  • [SPARK-27803][SQL] [PYTHON] 修复 Python UDF 的列修剪[SPARK-27803][SQL][PYTHON] Fix column pruning for Python UDF
  • [SPARK-27917][SQL] CaseWhen 对象的规范形式不正确[SPARK-27917][SQL] canonical form of CaseWhen object is incorrect
  • [SPARK-27798][SQL] from_avro 在转换为本地关系时不应产生相同的值[SPARK-27798][SQL] from_avro shouldn’t produces same value when converted to local relation
  • [SPARK-27873][SQL] 禁用 enforceSchema 时,不应使用 CSV 标题中的列名称核对 columnNameOfCorruptRecord[SPARK-27873][SQL] columnNameOfCorruptRecord should not be checked with column names in CSV header when disabling enforceSchema
  • [SPARK-27907][SQL] 在 0 行的情况下,HiveUDAF 应返回 NULL[SPARK-27907][SQL] HiveUDAF should return NULL in case of 0 rows
  • [SPARK-27699][SQL] 部分下推 Parquet/ORC 中的析取谓词[SPARK-27699][SQL] Partially push down disjunctive predicated in Parquet/ORC
  • [SPARK-27868][CORE] 套接字服务器积压的更好的默认值和文档。[SPARK-27868][CORE] Better default value and documentation for socket server backlog.
  • [SPARK-27869][CORE] 从 UI 中编辑系统属性中的敏感信息[SPARK-27869][CORE] Redact sensitive information in System Properties from UI
  • [SPARK-27863][SQL] [BACKPORT-2.4] 元数据文件和临时文件不应计为数据文件[SPARK-27863][SQL][BACKPORT-2.4] Metadata files and temporary files should not be counted as data files
  • [SPARK-27657][ML] 修复 ml.util.Instrumentation.logFai… 的日志格式。[SPARK-27657][ML] Fix the log format of ml.util.Instrumentation.logFai…
  • [SPARK-27858][SQL] 修复针对联合类型(具有多个非 null 类型)的 Avro 反序列化[SPARK-27858][SQL] Fix for Avro deserialization on union types with multiple non-null types
  • [SPARK-27711][CORE] 在任务结束时取消设置 InputFileBlockHolder[SPARK-27711][CORE] Unset InputFileBlockHolder at the end of tasks
  • [SPARK-27351][SQL] 对仅包含 null 值的列执行 AggregateEstimation 后出现错误的 outputRows 估计值[SPARK-27351][SQL] Wrong outputRows estimation after AggregateEstimation with only null value column
  • [SPARK-27539][SQL] 修复了对包含 null 值的列进行的不准确的聚合 outputRows 估计[SPARK-27539][SQL] Fix inaccurate aggregate outputRows estimation with column containing null values”
  • [SPARK-27800][SQL] 修复 BitwiseXor 测试用例的错误答案[SPARK-27800][SQL] Fix wrong answer on BitwiseXor test cases
  • [SPARK-27639][SQL] InMemoryTableScan 在 UI 上显示表名称(如果可能)[SPARK-27639][SQL] InMemoryTableScan shows the table name on UI if possible
  • [SPARK-27726][CORE] 修复在高负载下使用 InMemoryStore 时 ElementTrackingStore 删除操作的性能[SPARK-27726][CORE] Fix performance of ElementTrackingStore deletes when using InMemoryStore under high loads
  • [SPARK-27771][SQL] 为分组函数(cube、rollup、grouping 和 grouping_id)添加 SQL 说明[SPARK-27771][SQL] Add SQL description for grouping functions (cube, rollup, grouping and grouping_id)
  • [SPARK-27735][SS] 分析间隔字符串的操作在 SS 中应当不区分大小写[SPARK-27735][SS] Parsing interval string should be case-insensitive in SS
  • [SPARK-26856][PYSPARK] Python 对 from_avro 和 to_avro API 的支持[SPARK-26856][PYSPARK] Python support for from_avro and to_avro APIs
  • [SPARK-26870][SQL] 由于 Java 兼容性,因此可以将 to_avro/from_avro 移到函数对象中[SPARK-26870][SQL] Move to_avro/from_avro into functions object due to Java compatibility
  • [SPARK-26812][SQL] 为联合中的复杂数据类型报告正确的为 Null 性[SPARK-26812][SQL] Report correct nullability for complex datatypes in Union
  • [SPARK-27671][SQL] 修复从结构中的嵌套 null 进行强制转换时的错误[SPARK-27671][SQL] Fix error when casting from a nested null in a struct
  • [SPARK-27673][SQL] 将 since 信息添加到随机表达式、正则表达式和 null 表达式[SPARK-27673][SQL] Add since info to random, regex, null expressions
  • [SPARK-27672][SQL] 将 since 信息添加到字符串表达式[SPARK-27672][SQL] Add since info to string expressions
  • [SPARK-25139][SPARK-18406][CORE] 避免 NonFatals 在 PythonRunner 中终止执行程序[SPARK-25139][SPARK-18406][CORE] Avoid NonFatals to kill the Executor in PythonRunner
  • [SPARK-27624][CORE] 修复 CalenderInterval 以正确显示空间隔[SPARK-27624][CORE] Fix CalenderInterval to show an empty interval correctly
  • [SPARK-27577][MLLIB] 更正 BinaryClassificationMetrics 中的 downsampled 阈值[SPARK-27577][MLLIB] Correct thresholds downsampled in BinaryClassificationMetrics
  • [SPARK-27621][ML] 线性回归 - 验证与训练相关的参数(例如,仅拟合阶段中的损失)[SPARK-27621][ML] Linear Regression - validate training related params such as loss only during fitting phase
  • [SPARK-26048][SPARK-24530] 将所有缺失的提交 Cherrypick 到 2.4 发布脚本[SPARK-26048][SPARK-24530] Cherrypick all the missing commits to 2.4 release script
  • [SPARK-24935][SQL] 支持在 Hive UDAF 适配器中执行“初始化”->“更新”->“合并”->“完成”[SPARK-24935][SQL] support INIT -> UPDATE -> MERGE -> FINISH in Hive UDAF adapter

维护更新Maintenance updates

请参阅 Databricks Runtime 5.5 维护更新See Databricks Runtime 5.5 maintenance updates.

系统环境System environment

  • 操作系统:Ubuntu 16.04.6 LTSOperating System: Ubuntu 16.04.6 LTS
  • Java:1.8.0_252Java: 1.8.0_252
  • Scala:2.11.12Scala: 2.11.12
  • Python:2.7.12 适用于 Python 2 群集,3.5.2 适用于 Python 3 群集。Python: 2.7.12 for Python 2 clusters and 3.5.2 for Python 3 clusters. 有关详细信息,请参阅 Python 版本For details, see Python version.
  • R:R 版本 3.6.0 (2019-04-26)R: R version 3.6.0 (2019-04-26)
  • GPU 群集:安装了以下 NVIDIA GPU 库:GPU clusters: The following NVIDIA GPU libraries are installed:
    • Tesla 驱动程序 375.66Tesla driver 375.66
    • CUDA 9.0CUDA 9.0
    • cuDNN 7.0cuDNN 7.0

备注

尽管 Apache Spark 2.4 支持 Scala 2.12,但 Databricks Runtime 5.5 不支持它。Although Scala 2.12 is supported in Apache Spark 2.4, it is not supported in Databricks Runtime 5.5.

本节内容:In this section:

已安装的 Python 库Installed Python libraries

Library 版本Version Library 版本Version Library 版本Version
ansi2htmlansi2html 1.1.11.1.1 argparseargparse 1.2.11.2.1 backports-abcbackports-abc 0.50.5
botoboto 2.42.02.42.0 boto3boto3 1.4.11.4.1 botocorebotocore 1.4.701.4.70
brewer2mplbrewer2mpl 1.4.11.4.1 certificertifi 2016.2.282016.2.28 cfficffi 1.7.01.7.0
chardetchardet 2.3.02.3.0 coloramacolorama 0.3.70.3.7 configobjconfigobj 5.0.65.0.6
密码系统cryptography 1.51.5 cyclercycler 0.10.00.10.0 CythonCython 0.24.10.24.1
decoratordecorator 4.0.104.0.10 docutilsdocutils 0.140.14 enum34enum34 1.1.61.1.6
et-xmlfileet-xmlfile 1.0.11.0.1 freetype-pyfreetype-py 1.0.21.0.2 funcsigsfuncsigs 1.0.21.0.2
fusepyfusepy 2.0.42.0.4 Futurefutures 3.2.03.2.0 ggplotggplot 0.6.80.6.8
html5libhtml5lib 0.9990.999 idnaidna 2.12.1 ipaddressipaddress 1.0.161.0.16
ipythonipython 2.2.02.2.0 ipython-genutilsipython-genutils 0.1.00.1.0 jdcaljdcal 1.21.2
Jinja2Jinja2 2.82.8 jmespathjmespath 0.9.00.9.0 llvmlitellvmlite 0.13.00.13.0
lxmllxml 3.6.43.6.4 MarkupSafeMarkupSafe 0.230.23 matplotlibmatplotlib 1.5.31.5.3
mpld3mpld3 0.20.2 msgpack-pythonmsgpack-python 0.4.70.4.7 ndg-httpsclientndg-httpsclient 0.3.30.3.3
numbanumba 0.28.10.28.1 numpynumpy 1.11.11.11.1 openpyxlopenpyxl 2.3.22.3.2
pandaspandas 0.19.20.19.2 pathlib2pathlib2 2.1.02.1.0 patsypatsy 0.4.10.4.1
pexpectpexpect 4.0.14.0.1 picklesharepickleshare 0.7.40.7.4 PillowPillow 3.3.13.3.1
pippip 19.1.119.1.1 plyply 3.93.9 prompt-toolkitprompt-toolkit 1.0.71.0.7
psycopg2psycopg2 2.6.22.6.2 ptyprocessptyprocess 0.5.10.5.1 py4jpy4j 0.10.30.10.3
pyarrowpyarrow 0.8.00.8.0 pyasn1pyasn1 0.1.90.1.9 pycparserpycparser 2.142.14
PygmentsPygments 2.1.32.1.3 PyGObjectPyGObject 3.20.03.20.0 pyOpenSSLpyOpenSSL 16.0.016.0.0
pyparsingpyparsing 2.2.02.2.0 pypngpypng 0.0.180.0.18 PythonPython 2.7.122.7.12
python-dateutilpython-dateutil 2.5.32.5.3 python-geohashpython-geohash 0.8.50.8.5 pytzpytz 2016.6.12016.6.1
请求requests 2.11.12.11.1 s3transfers3transfer 0.1.90.1.9 scikit-learnscikit-learn 0.18.10.18.1
scipyscipy 0.18.10.18.1 scourscour 0.320.32 seabornseaborn 0.7.10.7.1
setuptoolssetuptools 41.0.141.0.1 simplejsonsimplejson 3.8.23.8.2 simples3simples3 1.01.0
singledispatchsingledispatch 3.4.0.33.4.0.3 6six 1.10.01.10.0 statsmodelsstatsmodels 0.6.10.6.1
tornadotornado 5.1.15.1.1 traitletstraitlets 4.3.04.3.0 urllib3urllib3 1.19.11.19.1
virtualenvvirtualenv 16.1.016.1.0 wcwidthwcwidth 0.1.70.1.7 wheelwheel 0.33.40.33.4
wsgirefwsgiref 0.1.20.1.2

已安装的 R 库 Installed R libraries

Library 版本Version Library 版本Version Library 版本Version
abindabind 1.4-51.4-5 askpassaskpass 1.11.1 assertthatassertthat 0.2.10.2.1
backportsbackports 1.1.31.1.3 basebase 3.6.03.6.0 base64encbase64enc 0.1-30.1-3
BHBH 1.69.0-11.69.0-1 bitbit 1.1-141.1-14 bit64bit64 0.9-70.9-7
bitopsbitops 1.0-61.0-6 blobblob 1.1.11.1.1 bootboot 1.3-201.3-20
brewbrew 1.0-61.0-6 callrcallr 3.2.03.2.0 carcar 3.0-23.0-2
carDatacarData 3.0-23.0-2 caretcaret 6.0-826.0-82 cellrangercellranger 1.1.01.1.0
chronchron 2.3-532.3-53 classclass 7.3-157.3-15 clicli 1.1.01.1.0
cliprclipr 0.5.00.5.0 clisymbolsclisymbols 1.2.01.2.0 clustercluster 2.0.82.0.8
codetoolscodetools 0.2-160.2-16 colorspacecolorspace 1.4-11.4-1 commonmarkcommonmark 1.71.7
compilercompiler 3.6.03.6.0 configconfig 0.30.3 crayoncrayon 1.3.41.3.4
curlcurl 3.33.3 data.tabledata.table 1.12.01.12.0 datasetsdatasets 3.6.03.6.0
DBIDBI 1.0.01.0.0 dbplyrdbplyr 1.3.01.3.0 descdesc 1.2.01.2.0
devtoolsdevtools 2.0.12.0.1 digestdigest 0.6.180.6.18 doMCdoMC 1.3.51.3.5
dplyrdplyr 0.8.0.10.8.0.1 ellipsisellipsis 0.1.00.1.0 fansifansi 0.4.00.4.0
forcatsforcats 0.4.00.4.0 foreachforeach 1.4.41.4.4 foreignforeign 0.8-710.8-71
forgeforge 0.2.00.2.0 fsfs 1.2.71.2.7 gbmgbm 2.1.52.1.5
genericsgenerics 0.0.20.0.2 ggplot2ggplot2 3.1.03.1.0 ghgh 1.0.11.0.1
git2rgit2r 0.25.20.25.2 glmnetglmnet 2.0-162.0-16 glueglue 1.3.11.3.1
gowergower 0.2.00.2.0 graphicsgraphics 3.6.03.6.0 grDevicesgrDevices 3.6.03.6.0
gridgrid 3.6.03.6.0 gridExtragridExtra 2.32.3 gsubfngsubfn 0.70.7
gtablegtable 0.3.00.3.0 h2oh2o 3.22.1.13.22.1.1 havenhaven 2.1.02.1.0
hmshms 0.4.20.4.2 htmltoolshtmltools 0.3.60.3.6 htmlwidgetshtmlwidgets 1.31.3
httrhttr 1.4.01.4.0 hwriterhwriter 1.3.21.3.2 hwriterPlushwriterPlus 1.0-31.0-3
iniini 0.3.10.3.1 ipredipred 0.9-80.9-8 iteratorsiterators 1.0.101.0.10
jsonlitejsonlite 1.61.6 KernSmoothKernSmooth 2.23-152.23-15 labelinglabeling 0.30.3
latticelattice 0.20-380.20-38 lavalava 1.6.51.6.5 lazyevallazyeval 0.2.20.2.2
littlerlittler 0.3.70.3.7 lme4lme4 1.1-211.1-21 lubridatelubridate 1.7.41.7.4
magrittrmagrittr 1.51.5 mapprojmapproj 1.2.61.2.6 mapsmaps 3.3.03.3.0
maptoolsmaptools 0.9-50.9-5 MASSMASS 7.3-51.17.3-51.1 矩阵Matrix 1.2-171.2-17
MatrixModelsMatrixModels 0.4-10.4-1 memoisememoise 1.1.01.1.0 方法methods 3.6.03.6.0
mgcvmgcv 1.8-281.8-28 mimemime 0.60.6 minqaminqa 1.2.41.2.4
ModelMetricsModelMetrics 1.2.21.2.2 munsellmunsell 0.5.00.5.0 mvtnormmvtnorm 1.0-101.0-10
nlmenlme 3.1-1403.1-140 nloptrnloptr 1.2.11.2.1 nnetnnet 7.3-127.3-12
numDerivnumDeriv 2016.8-12016.8-1 opensslopenssl 1.31.3 openxlsxopenxlsx 4.1.04.1.0
parallelparallel 3.6.03.6.0 pbkrtestpbkrtest 0.4-70.4-7 pillarpillar 1.3.11.3.1
pkgbuildpkgbuild 1.0.31.0.3 pkgconfigpkgconfig 2.0.22.0.2 pkgKittenpkgKitten 0.1.40.1.4
pkgloadpkgload 1.0.21.0.2 plogrplogr 0.2.00.2.0 plyrplyr 1.8.41.8.4
praisepraise 1.0.01.0.0 prettyunitsprettyunits 1.0.21.0.2 pROCpROC 1.14.01.14.0
processxprocessx 3.3.03.3.0 prodlimprodlim 2018.04.182018.04.18 进度progress 1.2.01.2.0
protoproto 1.0.01.0.0 psps 1.3.01.3.0 purrrpurrr 0.3.20.3.2
quantregquantreg 5.385.38 R.methodsS3R.methodsS3 1.7.11.7.1 R.ooR.oo 1.22.01.22.0
R.utilsR.utils 2.8.02.8.0 r2d3r2d3 0.2.30.2.3 R6R6 2.4.02.4.0
randomForestrandomForest 4.6-144.6-14 rappdirsrappdirs 0.3.10.3.1 rcmdcheckrcmdcheck 1.3.21.3.2
RColorBrewerRColorBrewer 1.1-21.1-2 RcppRcpp 1.0.11.0.1 RcppEigenRcppEigen 0.3.3.5.00.3.3.5.0
RcppRollRcppRoll 0.3.00.3.0 RCurlRCurl 1.95-4.121.95-4.12 readrreadr 1.3.11.3.1
readxlreadxl 1.3.11.3.1 recipesrecipes 0.1.50.1.5 rematchrematch 1.0.11.0.1
remotesremotes 2.0.22.0.2 reshape2reshape2 1.4.31.4.3 riorio 0.5.160.5.16
rlangrlang 0.3.30.3.3 RODBCRODBC 1.3-151.3-15 roxygen2roxygen2 6.1.16.1.1
rpartrpart 4.1-154.1-15 rprojrootrprojroot 1.3-21.3-2 RserveRserve 1.8-61.8-6
RSQLiteRSQLite 2.1.12.1.1 rstudioapirstudioapi 0.100.10 scalesscales 1.0.01.0.0
sessioninfosessioninfo 1.1.11.1.1 spsp 1.3-11.3-1 sparklyrsparklyr 1.0.01.0.0
SparkRSparkR 2.4.42.4.4 SparseMSparseM 1.771.77 spatialspatial 7.3-117.3-11
splinessplines 3.6.03.6.0 sqldfsqldf 0.4-110.4-11 SQUAREMSQUAREM 2017.10-12017.10-1
statmodstatmod 1.4.301.4.30 statsstats 3.6.03.6.0 stats4stats4 3.6.03.6.0
stringistringi 1.4.31.4.3 stringrstringr 1.4.01.4.0 survivalsurvival 2.43-32.43-3
syssys 3.13.1 tcltktcltk 3.6.03.6.0 TeachingDemosTeachingDemos 2.102.10
testthattestthat 2.0.12.0.1 tibbletibble 2.1.12.1.1 tidyrtidyr 0.8.30.8.3
tidyselecttidyselect 0.2.50.2.5 timeDatetimeDate 3043.1023043.102 工具tools 3.6.03.6.0
usethisusethis 1.4.01.4.0 utf8utf8 1.1.41.1.4 utilsutils 3.6.03.6.0
viridisLiteviridisLite 0.3.00.3.0 whiskerwhisker 0.3-20.3-2 withrwithr 2.1.22.1.2
xml2xml2 1.2.01.2.0 xopenxopen 1.0.01.0.0 yamlyaml 2.2.02.2.0
zipzip 2.0.12.0.1

已安装的 Java 库和 Scala 库(Scala 2.11 群集版本)Installed Java and Scala libraries (Scala 2.11 cluster version)

组 IDGroup ID 项目 IDArtifact ID 版本Version
antlrantlr antlrantlr 2.7.72.7.7
com.amazonawscom.amazonaws amazon-kinesis-clientamazon-kinesis-client 1.8.101.8.10
com.amazonawscom.amazonaws aws-java-sdk-autoscalingaws-java-sdk-autoscaling 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-cloudformationaws-java-sdk-cloudformation 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-cloudfrontaws-java-sdk-cloudfront 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-cloudhsmaws-java-sdk-cloudhsm 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-cloudsearchaws-java-sdk-cloudsearch 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-cloudtrailaws-java-sdk-cloudtrail 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-cloudwatchaws-java-sdk-cloudwatch 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-cloudwatchmetricsaws-java-sdk-cloudwatchmetrics 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-codedeployaws-java-sdk-codedeploy 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-cognitoidentityaws-java-sdk-cognitoidentity 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-cognitosyncaws-java-sdk-cognitosync 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-configaws-java-sdk-config 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-coreaws-java-sdk-core 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-datapipelineaws-java-sdk-datapipeline 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-directconnectaws-java-sdk-directconnect 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-directoryaws-java-sdk-directory 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-dynamodbaws-java-sdk-dynamodb 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-ec2aws-java-sdk-ec2 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-ecsaws-java-sdk-ecs 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-efsaws-java-sdk-efs 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-elasticacheaws-java-sdk-elasticache 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-elasticbeanstalkaws-java-sdk-elasticbeanstalk 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-elasticloadbalancingaws-java-sdk-elasticloadbalancing 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-elastictranscoderaws-java-sdk-elastictranscoder 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-emraws-java-sdk-emr 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-glacieraws-java-sdk-glacier 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-glueaws-java-sdk-glue 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-iamaws-java-sdk-iam 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-importexportaws-java-sdk-importexport 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-kinesisaws-java-sdk-kinesis 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-kmsaws-java-sdk-kms 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-lambdaaws-java-sdk-lambda 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-logsaws-java-sdk-logs 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-machinelearningaws-java-sdk-machinelearning 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-opsworksaws-java-sdk-opsworks 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-rdsaws-java-sdk-rds 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-redshiftaws-java-sdk-redshift 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-route53aws-java-sdk-route53 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-s3aws-java-sdk-s3 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-sesaws-java-sdk-ses 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-simpledbaws-java-sdk-simpledb 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-simpleworkflowaws-java-sdk-simpleworkflow 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-snsaws-java-sdk-sns 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-sqsaws-java-sdk-sqs 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-ssmaws-java-sdk-ssm 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-storagegatewayaws-java-sdk-storagegateway 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-stsaws-java-sdk-sts 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-supportaws-java-sdk-support 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-swf-librariesaws-java-sdk-swf-libraries 1.11.221.11.22
com.amazonawscom.amazonaws aws-java-sdk-workspacesaws-java-sdk-workspaces 1.11.3131.11.313
com.amazonawscom.amazonaws jmespath-javajmespath-java 1.11.3131.11.313
com.carrotsearchcom.carrotsearch hppchppc 0.7.20.7.2
com.chuusaicom.chuusai shapeless_2.11shapeless_2.11 2.3.22.3.2
com.clearspring.analyticscom.clearspring.analytics 流 (stream)stream 2.7.02.7.0
com.databrickscom.databricks RserveRserve 1.8-31.8-3
com.databrickscom.databricks dbml-local_2.11dbml-local_2.11 0.5.0-db8-spark2.40.5.0-db8-spark2.4
com.databrickscom.databricks dbml-local_2.11-testsdbml-local_2.11-tests 0.5.0-db8-spark2.40.5.0-db8-spark2.4
com.databrickscom.databricks jets3tjets3t 0.7.1-00.7.1-0
com.databricks.scalapbcom.databricks.scalapb compilerplugin_2.11compilerplugin_2.11 0.4.15-90.4.15-9
com.databricks.scalapbcom.databricks.scalapb scalapb-runtime_2.11scalapb-runtime_2.11 0.4.15-90.4.15-9
com.esotericsoftwarecom.esotericsoftware kryo-shadedkryo-shaded 4.0.24.0.2
com.esotericsoftwarecom.esotericsoftware minlogminlog 1.3.01.3.0
com.fasterxmlcom.fasterxml classmateclassmate 1.0.01.0.0
com.fasterxml.jackson.corecom.fasterxml.jackson.core jackson-annotationsjackson-annotations 2.6.72.6.7
com.fasterxml.jackson.corecom.fasterxml.jackson.core jackson-corejackson-core 2.6.72.6.7
com.fasterxml.jackson.corecom.fasterxml.jackson.core jackson-databindjackson-databind 2.6.7.12.6.7.1
com.fasterxml.jackson.dataformatcom.fasterxml.jackson.dataformat jackson-dataformat-cborjackson-dataformat-cbor 2.6.72.6.7
com.fasterxml.jackson.datatypecom.fasterxml.jackson.datatype jackson-datatype-jodajackson-datatype-joda 2.6.72.6.7
com.fasterxml.jackson.modulecom.fasterxml.jackson.module jackson-module-paranamerjackson-module-paranamer 2.6.72.6.7
com.fasterxml.jackson.modulecom.fasterxml.jackson.module jackson-module-scala_2.11jackson-module-scala_2.11 2.6.7.12.6.7.1
com.github.fommilcom.github.fommil jniloaderjniloader 1.11.1
com.github.fommil.netlibcom.github.fommil.netlib corecore 1.1.21.1.2
com.github.fommil.netlibcom.github.fommil.netlib native_ref-javanative_ref-java 1.11.1
com.github.fommil.netlibcom.github.fommil.netlib native_ref-java-nativesnative_ref-java-natives 1.11.1
com.github.fommil.netlibcom.github.fommil.netlib native_system-javanative_system-java 1.11.1
com.github.fommil.netlibcom.github.fommil.netlib native_system-java-nativesnative_system-java-natives 1.11.1
com.github.fommil.netlibcom.github.fommil.netlib netlib-native_ref-linux-x86_64-nativesnetlib-native_ref-linux-x86_64-natives 1.11.1
com.github.fommil.netlibcom.github.fommil.netlib netlib-native_system-linux-x86_64-nativesnetlib-native_system-linux-x86_64-natives 1.11.1
com.github.lubencom.github.luben zstd-jnizstd-jni 1.3.2-21.3.2-2
com.github.rwlcom.github.rwl jtransformsjtransforms 2.4.02.4.0
com.google.code.findbugscom.google.code.findbugs jsr305jsr305 2.0.12.0.1
com.google.code.gsoncom.google.code.gson gsongson 2.2.42.2.4
com.google.guavacom.google.guava guavaguava 15.015.0
com.google.protobufcom.google.protobuf protobuf-javaprotobuf-java 2.6.12.6.1
com.googlecode.javaewahcom.googlecode.javaewah JavaEWAHJavaEWAH 0.3.20.3.2
com.h2databasecom.h2database h2h2 1.3.1741.3.174
com.jcraftcom.jcraft jschjsch 0.1.500.1.50
com.jolboxcom.jolbox bonecpbonecp 0.8.0.RELEASE0.8.0.RELEASE
com.microsoft.azurecom.microsoft.azure azure-data-lake-store-sdkazure-data-lake-store-sdk 2.2.82.2.8
com.microsoft.azurecom.microsoft.azure azure-storageazure-storage 5.2.05.2.0
com.microsoft.sqlservercom.microsoft.sqlserver mssql-jdbcmssql-jdbc 6.2.2.jre86.2.2.jre8
com.ningcom.ning compress-lzfcompress-lzf 1.0.31.0.3
com.sun.mailcom.sun.mail javax.mailjavax.mail 1.5.21.5.2
com.thoughtworks.paranamercom.thoughtworks.paranamer paranamerparanamer 2.82.8
com.trueaccord.lensescom.trueaccord.lenses lenses_2.11lenses_2.11 0.30.3
com.twittercom.twitter chill-javachill-java 0.9.30.9.3
com.twittercom.twitter chill_2.11chill_2.11 0.9.30.9.3
com.twittercom.twitter parquet-hadoop-bundleparquet-hadoop-bundle 1.6.01.6.0
com.twittercom.twitter util-app_2.11util-app_2.11 6.23.06.23.0
com.twittercom.twitter util-core_2.11util-core_2.11 6.23.06.23.0
com.twittercom.twitter util-jvm_2.11util-jvm_2.11 6.23.06.23.0
com.typesafecom.typesafe configconfig 1.2.11.2.1
com.typesafe.scala-loggingcom.typesafe.scala-logging scala-logging-api_2.11scala-logging-api_2.11 2.1.22.1.2
com.typesafe.scala-loggingcom.typesafe.scala-logging scala-logging-slf4j_2.11scala-logging-slf4j_2.11 2.1.22.1.2
com.univocitycom.univocity univocity-parsersunivocity-parsers 2.7.32.7.3
com.vlkancom.vlkan flatbuffersflatbuffers 1.2.0-3f79e0551.2.0-3f79e055
com.zaxxercom.zaxxer HikariCPHikariCP 3.1.03.1.0
commons-beanutilscommons-beanutils commons-beanutilscommons-beanutils 1.9.31.9.3
commons-clicommons-cli commons-clicommons-cli 1.21.2
commons-codeccommons-codec commons-codeccommons-codec 1.101.10
commons-collectionscommons-collections commons-collectionscommons-collections 3.2.23.2.2
commons-configurationcommons-configuration commons-configurationcommons-configuration 1.61.6
commons-dbcpcommons-dbcp commons-dbcpcommons-dbcp 1.41.4
commons-digestercommons-digester commons-digestercommons-digester 1.81.8
commons-httpclientcommons-httpclient commons-httpclientcommons-httpclient 3.13.1
commons-iocommons-io commons-iocommons-io 2.42.4
commons-langcommons-lang commons-langcommons-lang 2.62.6
commons-loggingcommons-logging commons-loggingcommons-logging 1.1.31.1.3
commons-netcommons-net commons-netcommons-net 3.13.1
commons-poolcommons-pool commons-poolcommons-pool 1.5.41.5.4
info.ganglia.gmetric4jinfo.ganglia.gmetric4j gmetric4jgmetric4j 1.0.71.0.7
io.airliftio.airlift aircompressoraircompressor 0.100.10
io.dropwizard.metricsio.dropwizard.metrics metrics-coremetrics-core 3.1.53.1.5
io.dropwizard.metricsio.dropwizard.metrics metrics-gangliametrics-ganglia 3.1.53.1.5
io.dropwizard.metricsio.dropwizard.metrics metrics-graphitemetrics-graphite 3.1.53.1.5
io.dropwizard.metricsio.dropwizard.metrics metrics-healthchecksmetrics-healthchecks 3.1.53.1.5
io.dropwizard.metricsio.dropwizard.metrics metrics-jetty9metrics-jetty9 3.1.53.1.5
io.dropwizard.metricsio.dropwizard.metrics metrics-jsonmetrics-json 3.1.53.1.5
io.dropwizard.metricsio.dropwizard.metrics metrics-jvmmetrics-jvm 3.1.53.1.5
io.dropwizard.metricsio.dropwizard.metrics metrics-log4jmetrics-log4j 3.1.53.1.5
io.dropwizard.metricsio.dropwizard.metrics metrics-servletsmetrics-servlets 3.1.53.1.5
io.nettyio.netty nettynetty 3.9.9.Final3.9.9.Final
io.nettyio.netty netty-allnetty-all 4.1.17.Final4.1.17.Final
javax.activationjavax.activation activationactivation 1.1.11.1.1
javax.annotationjavax.annotation javax.annotation-apijavax.annotation-api 1.21.2
javax.eljavax.el javax.el-apijavax.el-api 2.2.42.2.4
javax.jdojavax.jdo jdo-apijdo-api 3.0.13.0.1
javax.servletjavax.servlet javax.servlet-apijavax.servlet-api 3.1.03.1.0
javax.servlet.jspjavax.servlet.jsp jsp-apijsp-api 2.12.1
javax.transactionjavax.transaction jtajta 1.11.1
javax.validationjavax.validation validation-apivalidation-api 1.1.0.Final1.1.0.Final
javax.ws.rsjavax.ws.rs javax.ws.rs-apijavax.ws.rs-api 2.0.12.0.1
javax.xml.bindjavax.xml.bind jaxb-apijaxb-api 2.2.22.2.2
javax.xml.streamjavax.xml.stream stax-apistax-api 1.0-21.0-2
javolutionjavolution javolutionjavolution 5.5.15.5.1
jlinejline jlinejline 2.14.62.14.6
joda-timejoda-time joda-timejoda-time 2.9.32.9.3
log4jlog4j apache-log4j-extrasapache-log4j-extras 1.2.171.2.17
log4jlog4j log4jlog4j 1.2.171.2.17
maven-treesmaven-trees hive-exec-with-gluehive-exec-with-glue hive-12679-patch_deployhive-12679-patch_deploy
maven-treesmaven-trees hive-exec-with-gluehive-exec-with-glue hive-exec_shadedhive-exec_shaded
net.hydromaticnet.hydromatic eigenbase-propertieseigenbase-properties 1.1.51.1.5
net.razorvinenet.razorvine pyrolitepyrolite 4.134.13
net.sf.jpamnet.sf.jpam jpamjpam 1.11.1
net.sf.opencsvnet.sf.opencsv opencsvopencsv 2.32.3
net.sf.supercsvnet.sf.supercsv super-csvsuper-csv 2.2.02.2.0
net.snowflakenet.snowflake snowflake-ingest-sdksnowflake-ingest-sdk 0.9.50.9.5
net.snowflakenet.snowflake snowflake-jdbcsnowflake-jdbc 3.6.153.6.15
net.snowflakenet.snowflake spark-snowflake_2.11spark-snowflake_2.11 2.4.10-spark_2.42.4.10-spark_2.4
net.sourceforge.f2jnet.sourceforge.f2j arpack_combined_allarpack_combined_all 0.10.1
org.acpltorg.acplt oncrpconcrpc 1.0.71.0.7
org.antlrorg.antlr ST4ST4 4.0.44.0.4
org.antlrorg.antlr antlr-runtimeantlr-runtime 3.43.4
org.antlrorg.antlr antlr4-runtimeantlr4-runtime 4.74.7
org.antlrorg.antlr stringtemplatestringtemplate 3.2.13.2.1
org.apache.antorg.apache.ant antant 1.9.21.9.2
org.apache.antorg.apache.ant ant-jschant-jsch 1.9.21.9.2
org.apache.antorg.apache.ant ant-launcherant-launcher 1.9.21.9.2
org.apache.arroworg.apache.arrow arrow-formatarrow-format 0.10.00.10.0
org.apache.arroworg.apache.arrow arrow-memoryarrow-memory 0.10.00.10.0
org.apache.arroworg.apache.arrow arrow-vectorarrow-vector 0.10.00.10.0
org.apache.avroorg.apache.avro avroavro 1.8.21.8.2
org.apache.avroorg.apache.avro avro-ipcavro-ipc 1.8.21.8.2
org.apache.avroorg.apache.avro avro-mapred-hadoop2avro-mapred-hadoop2 1.8.21.8.2
org.apache.calciteorg.apache.calcite calcite-avaticacalcite-avatica 1.2.0-incubating1.2.0-incubating
org.apache.calciteorg.apache.calcite calcite-corecalcite-core 1.2.0-incubating1.2.0-incubating
org.apache.calciteorg.apache.calcite calcite-linq4jcalcite-linq4j 1.2.0-incubating1.2.0-incubating
org.apache.commonsorg.apache.commons commons-compresscommons-compress 1.8.11.8.1
org.apache.commonsorg.apache.commons commons-cryptocommons-crypto 1.0.01.0.0
org.apache.commonsorg.apache.commons commons-lang3commons-lang3 3.53.5
org.apache.commonsorg.apache.commons commons-math3commons-math3 3.4.13.4.1
org.apache.curatororg.apache.curator curator-clientcurator-client 2.7.12.7.1
org.apache.curatororg.apache.curator curator-frameworkcurator-framework 2.7.12.7.1
org.apache.curatororg.apache.curator curator-recipescurator-recipes 2.7.12.7.1
org.apache.derbyorg.apache.derby derbyderby 10.12.1.110.12.1.1
org.apache.directory.apiorg.apache.directory.api api-asn1-apiapi-asn1-api 1.0.0-M201.0.0-M20
org.apache.directory.apiorg.apache.directory.api api-utilapi-util 1.0.0-M201.0.0-M20
org.apache.directory.serverorg.apache.directory.server apacheds-i18napacheds-i18n 2.0.0-M152.0.0-M15
org.apache.directory.serverorg.apache.directory.server apacheds-kerberos-codecapacheds-kerberos-codec 2.0.0-M152.0.0-M15
org.apache.hadooporg.apache.hadoop hadoop-annotationshadoop-annotations 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-authhadoop-auth 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-clienthadoop-client 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-commonhadoop-common 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-hdfshadoop-hdfs 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-mapreduce-client-apphadoop-mapreduce-client-app 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-mapreduce-client-commonhadoop-mapreduce-client-common 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-mapreduce-client-corehadoop-mapreduce-client-core 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-mapreduce-client-jobclienthadoop-mapreduce-client-jobclient 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-mapreduce-client-shufflehadoop-mapreduce-client-shuffle 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-yarn-apihadoop-yarn-api 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-yarn-clienthadoop-yarn-client 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-yarn-commonhadoop-yarn-common 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-yarn-server-commonhadoop-yarn-server-common 2.7.32.7.3
org.apache.htraceorg.apache.htrace htrace-corehtrace-core 3.1.0-incubating3.1.0-incubating
org.apache.httpcomponentsorg.apache.httpcomponents httpclienthttpclient 4.5.44.5.4
org.apache.httpcomponentsorg.apache.httpcomponents httpcorehttpcore 4.4.84.4.8
org.apache.ivyorg.apache.ivy ivyivy 2.4.02.4.0
org.apache.orcorg.apache.orc orc-core-nohiveorc-core-nohive 1.5.21.5.2
org.apache.orcorg.apache.orc orc-mapreduce-nohiveorc-mapreduce-nohive 1.5.21.5.2
org.apache.orcorg.apache.orc orc-shimsorc-shims 1.5.21.5.2
org.apache.parquetorg.apache.parquet parquet-columnparquet-column 1.10.1.1-databricks31.10.1.1-databricks3
org.apache.parquetorg.apache.parquet parquet-commonparquet-common 1.10.1.1-databricks31.10.1.1-databricks3
org.apache.parquetorg.apache.parquet parquet-encodingparquet-encoding 1.10.1.1-databricks31.10.1.1-databricks3
org.apache.parquetorg.apache.parquet parquet-formatparquet-format 2.4.02.4.0
org.apache.parquetorg.apache.parquet parquet-hadoopparquet-hadoop 1.10.1.1-databricks31.10.1.1-databricks3
org.apache.parquetorg.apache.parquet parquet-jacksonparquet-jackson 1.10.1.1-databricks31.10.1.1-databricks3
org.apache.thriftorg.apache.thrift libfb303libfb303 0.9.30.9.3
org.apache.thriftorg.apache.thrift libthriftlibthrift 0.9.30.9.3
org.apache.xbeanorg.apache.xbean xbean-asm6-shadedxbean-asm6-shaded 4.84.8
org.apache.zookeeperorg.apache.zookeeper zookeeperzookeeper 3.4.63.4.6
org.codehaus.jacksonorg.codehaus.jackson jackson-core-asljackson-core-asl 1.9.131.9.13
org.codehaus.jacksonorg.codehaus.jackson jackson-jaxrsjackson-jaxrs 1.9.131.9.13
org.codehaus.jacksonorg.codehaus.jackson jackson-mapper-asljackson-mapper-asl 1.9.131.9.13
org.codehaus.jacksonorg.codehaus.jackson jackson-xcjackson-xc 1.9.131.9.13
org.codehaus.janinoorg.codehaus.janino commons-compilercommons-compiler 3.0.103.0.10
org.codehaus.janinoorg.codehaus.janino janinojanino 3.0.103.0.10
org.datanucleusorg.datanucleus datanucleus-api-jdodatanucleus-api-jdo 3.2.63.2.6
org.datanucleusorg.datanucleus datanucleus-coredatanucleus-core 3.2.103.2.10
org.datanucleusorg.datanucleus datanucleus-rdbmsdatanucleus-rdbms 3.2.93.2.9
org.eclipse.jettyorg.eclipse.jetty jetty-clientjetty-client 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-continuationjetty-continuation 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-httpjetty-http 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-iojetty-io 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-jndijetty-jndi 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-plusjetty-plus 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-proxyjetty-proxy 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-securityjetty-security 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-serverjetty-server 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-servletjetty-servlet 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-servletsjetty-servlets 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-utiljetty-util 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-webappjetty-webapp 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-xmljetty-xml 9.3.20.v201705319.3.20.v20170531
org.fusesource.leveldbjniorg.fusesource.leveldbjni leveldbjni-allleveldbjni-all 1.81.8
org.glassfish.hk2org.glassfish.hk2 hk2-apihk2-api 2.4.0-b342.4.0-b34
org.glassfish.hk2org.glassfish.hk2 hk2-locatorhk2-locator 2.4.0-b342.4.0-b34
org.glassfish.hk2org.glassfish.hk2 hk2-utilshk2-utils 2.4.0-b342.4.0-b34
org.glassfish.hk2org.glassfish.hk2 osgi-resource-locatorosgi-resource-locator 1.0.11.0.1
org.glassfish.hk2.externalorg.glassfish.hk2.external aopalliance-repackagedaopalliance-repackaged 2.4.0-b342.4.0-b34
org.glassfish.hk2.externalorg.glassfish.hk2.external javax.injectjavax.inject 2.4.0-b342.4.0-b34
org.glassfish.jersey.bundles.repackagedorg.glassfish.jersey.bundles.repackaged jersey-guavajersey-guava 2.22.22.22.2
org.glassfish.jersey.containersorg.glassfish.jersey.containers jersey-container-servletjersey-container-servlet 2.22.22.22.2
org.glassfish.jersey.containersorg.glassfish.jersey.containers jersey-container-servlet-corejersey-container-servlet-core 2.22.22.22.2
org.glassfish.jersey.coreorg.glassfish.jersey.core jersey-clientjersey-client 2.22.22.22.2
org.glassfish.jersey.coreorg.glassfish.jersey.core jersey-commonjersey-common 2.22.22.22.2
org.glassfish.jersey.coreorg.glassfish.jersey.core jersey-serverjersey-server 2.22.22.22.2
org.glassfish.jersey.mediaorg.glassfish.jersey.media jersey-media-jaxbjersey-media-jaxb 2.22.22.22.2
org.hibernateorg.hibernate hibernate-validatorhibernate-validator 5.1.1.Final5.1.1.Final
org.iq80.snappyorg.iq80.snappy snappysnappy 0.20.2
org.javassistorg.javassist javassistjavassist 3.18.1-GA3.18.1-GA
org.jboss.loggingorg.jboss.logging jboss-loggingjboss-logging 3.1.3.GA3.1.3.GA
org.jdbiorg.jdbi jdbijdbi 2.63.12.63.1
org.jodaorg.joda joda-convertjoda-convert 1.71.7
org.joddorg.jodd jodd-corejodd-core 3.5.23.5.2
org.json4sorg.json4s json4s-ast_2.11json4s-ast_2.11 3.5.33.5.3
org.json4sorg.json4s json4s-core_2.11json4s-core_2.11 3.5.33.5.3
org.json4sorg.json4s json4s-jackson_2.11json4s-jackson_2.11 3.5.33.5.3
org.json4sorg.json4s json4s-scalap_2.11json4s-scalap_2.11 3.5.33.5.3
org.lz4org.lz4 lz4-javalz4-java 1.4.01.4.0
org.mariadb.jdbcorg.mariadb.jdbc mariadb-java-clientmariadb-java-client 2.1.22.1.2
org.mockitoorg.mockito mockito-allmockito-all 1.9.51.9.5
org.objenesisorg.objenesis objenesisobjenesis 2.5.12.5.1
org.postgresqlorg.postgresql postgresqlpostgresql 42.1.442.1.4
org.roaringbitmaporg.roaringbitmap RoaringBitmapRoaringBitmap 0.7.450.7.45
org.roaringbitmaporg.roaringbitmap shimsshims 0.7.450.7.45
org.rocksdborg.rocksdb rocksdbjnirocksdbjni 5.2.15.2.1
org.rosuda.REngineorg.rosuda.REngine REngineREngine 2.1.02.1.0
org.scala-langorg.scala-lang scala-compiler_2.11scala-compiler_2.11 2.11.122.11.12
org.scala-langorg.scala-lang scala-library_2.11scala-library_2.11 2.11.122.11.12
org.scala-langorg.scala-lang scala-reflect_2.11scala-reflect_2.11 2.11.122.11.12
org.scala-lang.modulesorg.scala-lang.modules scala-parser-combinators_2.11scala-parser-combinators_2.11 1.1.01.1.0
org.scala-lang.modulesorg.scala-lang.modules scala-xml_2.11scala-xml_2.11 1.0.51.0.5
org.scala-sbtorg.scala-sbt test-interfacetest-interface 1.01.0
org.scalacheckorg.scalacheck scalacheck_2.11scalacheck_2.11 1.12.51.12.5
org.scalacticorg.scalactic scalactic_2.11scalactic_2.11 3.0.33.0.3
org.scalanlporg.scalanlp breeze-macros_2.11breeze-macros_2.11 0.13.20.13.2
org.scalanlporg.scalanlp breeze_2.11breeze_2.11 0.13.20.13.2
org.scalatestorg.scalatest scalatest_2.11scalatest_2.11 3.0.33.0.3
org.slf4jorg.slf4j jcl-over-slf4jjcl-over-slf4j 1.7.161.7.16
org.slf4jorg.slf4j jul-to-slf4jjul-to-slf4j 1.7.161.7.16
org.slf4jorg.slf4j slf4j-apislf4j-api 1.7.161.7.16
org.slf4jorg.slf4j slf4j-log4j12slf4j-log4j12 1.7.161.7.16
org.spark-project.hiveorg.spark-project.hive hive-beelinehive-beeline 1.2.1.spark21.2.1.spark2
org.spark-project.hiveorg.spark-project.hive hive-clihive-cli 1.2.1.spark21.2.1.spark2
org.spark-project.hiveorg.spark-project.hive hive-jdbchive-jdbc 1.2.1.spark21.2.1.spark2
org.spark-project.hiveorg.spark-project.hive hive-metastorehive-metastore 1.2.1.spark21.2.1.spark2
org.spark-project.sparkorg.spark-project.spark unusedunused 1.0.01.0.0
org.spire-mathorg.spire-math spire-macros_2.11spire-macros_2.11 0.13.00.13.0
org.spire-mathorg.spire-math spire_2.11spire_2.11 0.13.00.13.0
org.springframeworkorg.springframework spring-corespring-core 4.1.4.RELEASE4.1.4.RELEASE
org.springframeworkorg.springframework spring-testspring-test 4.1.4.RELEASE4.1.4.RELEASE
org.tukaaniorg.tukaani xzxz 1.51.5
org.typelevelorg.typelevel machinist_2.11machinist_2.11 0.6.10.6.1
org.typelevelorg.typelevel macro-compat_2.11macro-compat_2.11 1.1.11.1.1
org.xerialorg.xerial sqlite-jdbcsqlite-jdbc 3.8.11.23.8.11.2
org.xerial.snappyorg.xerial.snappy snappy-javasnappy-java 1.1.7.31.1.7.3
org.yamlorg.yaml snakeyamlsnakeyaml 1.161.16
orooro orooro 2.0.82.0.8
software.amazon.ionsoftware.amazon.ion ion-javaion-java 1.0.21.0.2
staxstax stax-apistax-api 1.0.11.0.1
xmlencxmlenc xmlencxmlenc 0.520.52