Databricks Runtime 4.2Databricks Runtime 4.2

Databricks 于 2018 年 7 月发布了此映像。Databricks released this image in July 2018.

重要

此版本已于 2019 年 3 月 5 日弃用。This release was deprecated on March 5, 2019. 有关 Databricks Runtime 弃用策略和计划的详细信息,请参阅 Databricks Runtime 支持生命周期For more information about the Databricks Runtime deprecation policy and schedule, see Databricks runtime support lifecycle.

以下发行说明提供了由 Apache Spark 支持的 Databricks Runtime 4.2 的相关信息。The following release notes provide information about Databricks Runtime 4.2, powered by Apache Spark.

Delta LakeDelta Lake

Databricks Runtime 4.2 为 Delta Lake 增加了重大的质量改进和功能。Databricks Runtime 4.2 adds major quality improvements and functionality to Delta Lake. Databricks 强烈建议将所有 Delta Lake 客户升级到新的运行时。Databricks highly recommends that all Delta Lake customers upgrade to the new runtime. 此版本仍以个人预览版提供,但它代表了即将推出的正式发布版 (GA) 的候选发行版。This release remains in Private Preview, but it represents a candidate release in anticipation of the upcoming general availability (GA) release.

新增功能New features

  • 现在,可以使用 df.writeStream.table(...) 将流直接写入到在 Hive 元存储中注册的 Delta 表。Streams can now be directly written to a Delta table registered in the Hive metastore using df.writeStream.table(...).

改进Improvements

  • 所有 Delta Lake 命令和查询现在都支持使用表的路径作为标识符来引用表:All Delta Lake commands and queries now support referring to a table using its path as an identifier:

    delta.`<path-to-table>`
    

    以前,OPTIMIZEVACUUM 要求以非标准方式使用字符串文字(即 '<path-to-table>')。Previously OPTIMIZE and VACUUM required non-standard use of string literals (that is, '<path-to-table>').

  • DESCRIBE HISTORY 现在包含提交 ID,默认按从最新到最旧的顺序进行排序。DESCRIBE HISTORY now includes the commit ID and is ordered newest to oldest by default.

Bug 修复Bug fixes

  • 即使谓词的大小写不同于表的大小写,现在也能正常进行基于分区谓词的筛选。Filtering based on partition predicates now operates correctly even when the case of the predicates differs from that of the table.
  • 修复了对 Delta 表中的布尔列执行相等检查(即 booleanValue = true)时缺少的列 AnalysisExceptionFixed missing column AnalysisException when performing equality checks on boolean columns in Delta tables (that is, booleanValue = true).
  • 创建指向现有表的指针时,CREATE TABLE 不再修改事务日志。CREATE TABLE no longer modifies the transaction log when creating a pointer to an existing table. 这可以防止不必要的并发流冲突,并允许创建用户对其中的数据仅具有读取访问权限的表的元存储指针。This prevents unnecessary conflicts with concurrent streams and allows the creation of metastore pointer to tables where the user only has read access to the data.
  • 对包含大量数据的流调用 display() 不再会导致驱动程序中出现 OOM。Calling display() on a stream with large amounts of data no longer causes OOM in the driver.
  • 如果删除了某个基础 Delta Lake 路径,则现在会引发 AnalysisException,而不是返回空结果。AnalysisException is now thrown when an underlying Delta Lake path is deleted, rather than returning empty results.
  • 需要特定协议版本(例如 appendOnly)的 Delta Lake 配置只能应用于相应版本的表。Delta Lake configs that require a specific protocol version (for example, appendOnly) can only be applied to tables at an appropriate version.
  • 更新 Delta 表的状态时,现在会自动截断长数据世系以避免 StackOverFlowErrorWhen updating the state of a Delta table, long lineages are now automatically truncated to avoid a StackOverFlowError.

结构化流式处理Structured Streaming

新增功能New features

  • Delta Lake 和 Kafka 现在完全支持 Trigger.OnceDelta Lake and Kafka now fully support Trigger.Once. 以前指定为源选项或默认值的速率限制(例如 maxOffsetsPerTriggermaxFilesPerTrigger)可能会导致仅部分执行可用的数据。Previously rate limits (for example maxOffsetsPerTrigger or maxFilesPerTrigger) specified as source options or defaults could result in only a partial execution of available data. 现在,当使用 Trigger.Once 时,这些选项会被忽略,这样就可以处理所有当前可用的数据。These options are now ignored when Trigger.Once is used, allowing all currently available data to be processed.

  • 在 Scala 中添加了新的流式处理 foreachBatch(),你可以在其中定义一个函数,以使用数据帧操作来处理每个微批的输出。Added new streaming foreachBatch() in Scala, where the you can define a function to process the output of every microbatch using DataFrame operations. 这样可以实现以下方案:This enables the following:

    • 使用现有批处理数据源将微批输出写入到尚未包含流式处理数据源的系统(例如,对每个微批输出使用 Cassandra 批处理编写器)。Using existing batch data sources to write microbatch outputs to systems that do not have a streaming data source yet (for example, use Cassandra batch writer on every micro-batch output).
    • 将微批输出写入到多个位置。Writing microbatch output to multiple locations.
    • 将数据帧和表操作应用于流式处理数据帧中尚不支持的微批输出(例如,将微批输出更新插入到 Delta 表)。Applying DataFrame and table operations on microbatch outputs that are not supported in streaming DataFrames yet (for example, upsert microbatch output into a Delta table).
  • 添加了 from_avro/to_avro 函数,用于在数据帧中(而不是只在文件中)读取和写入 Avro 数据,类似于 from_json/to_jsonAdded from_avro/to_avro functions to read and write Avro data within a DataFrame instead of just files, similar to from_json/to_json. 有关更多详细信息,请参阅在任何位置读取和写入 Avro 数据See Read and Write Avro Data Anywhere for more details.

  • 在 Python 中添加了对流式处理 foreach() 的支持(已在 Scala 中提供)。Added support for streaming foreach() in Python (already available in Scala). 有关更多详细信息,请参阅 foreach 和 foreachBatch 文档See foreach and foreachBatch documentation for more details.

改进Improvements

  • 当输入流中没有数据时,使用有状态操作(mapGroupsWithState、流流联接、流式处理聚合、流式处理 dropDuplicates)可以更快地生成输出结果和/或进行状态清除。Faster generation of output results and/or state cleanup with stateful operations (mapGroupsWithState, stream-stream join, streaming aggregation, streaming dropDuplicates) when there is no data in the input stream.

Bug 修复Bug fixes

  • 修复了流间联接中的正确性 bug SPARK-24588,该 bug 的表现为:当联接之前存在显式重新分区(例如 df1.repartition("a", "b").join(df, "a"))时,联接报告的结果较少。Fixed correctness bug SPARK-24588 in stream-stream join where join reported fewer results when there is an explicit repartition before it (for example, df1.repartition("a", "b").join(df, "a")).

其他更改和改进Other Changes and Improvements

  • 为启用了表访问控制的群集增加了对 SQL Deny 命令的支持。Added support for SQL Deny command for table access control enabled clusters. 用户现在可以像以前被授予特定权限一样拒绝特定的权限。Users can now deny specific permissions in the same way they could be granted before. 拒绝某个权限时,已授予的权限会被取代。A denied permission will supersede a granted one. 仍然始终允许特定对象的管理员和所有者执行操作。Admins and Owners of a particular object are still always allowed to perform actions.
  • 使用 ABFS 驱动程序的新的 Azure Data Lake Storage Gen2 数据源。New Azure Data Lake Storage Gen2 data source that uses the ABFS driver. 请参阅 Azure Data Lake Storage Gen2See Azure Data Lake Storage Gen2
  • 升级了一些已安装的 Python 库:Upgraded some installed Python libraries:
    • pip:从 10.0.0b2 升级到了 10.0.1pip: from 10.0.0b2 to 10.0.1
    • setuptools:从 39.0.1 升级到了 39.2.0setuptools: from 39.0.1 to 39.2.0
    • tornado:从 5.0.1 升级到了 5.0.2tornado: 5.0.1 to 5.0.2
    • wheel:从 0.31.0 升级到了 0.31.1wheel: 0.31.0 to 0.31.1
  • 升级了多个已安装的 R 库。Upgraded several installed R libraries. 请参阅已安装的 R 库See Installed R Libraries.
  • 改进了 Parquet 支持Improved Parquet support
  • 已将 Apache ORC 从 1.4.1 升级到了 1.4.3Upgraded Apache ORC from 1.4.1 to 1.4.3

Apache SparkApache Spark

Databricks Runtime 4.2 包括 Apache Spark 2.3.1。Databricks Runtime 4.2 includes Apache Spark 2.3.1. 此版本包括 Databricks Runtime 4.1 中包含的所有修复和改进,以及对 Spark 进行的下述其他的 bug 修复和改进:This release includes all fixes and improvements included in Databricks Runtime 4.1, as well as the following additional bug fixes and improvements made to Spark:

  • [SPARK-24588][SS] 流式处理联接应当需要来自子代的 HashClusteredPartitioning[SPARK-24588][SS] streaming join should require HashClusteredPartitioning from children
  • [SPARK-23931][SQL] 在function.scala @scala.annotation.varargs 中创建 arrays_zip[SPARK-23931][SQL] Make arrays_zip in function.scala @scala.annotation.varargs.
  • [SPARK-24633][SQL] 修复了当 arrays_zip 需要拆分时的 codegen[SPARK-24633][SQL] Fix codegen when split is required for arrays_zip
  • [SPARK-24578][CORE] 限制子区域的已返回的 nio 缓冲区的大小上限[SPARK-24578][CORE] Cap sub-region’s size of returned nio buffer
  • [SPARK-24613][SQL] 具有 UDF 的缓存无法与后续的依赖缓存匹配[SPARK-24613][SQL] Cache with UDF could not be matched with subsequent dependent caches
  • [SPARK-24583][SQL] InsertIntoDataSourceCommand 中的架构类型错误[SPARK-24583][SQL] Wrong schema type in InsertIntoDataSourceCommand
  • [SPARK-24565][SS] 在结构化流式处理中添加了用于将每个微批的输出行公开为数据帧的 API[SPARK-24565][SS] Add API for in Structured Streaming for exposing output rows of each microbatch as a DataFrame
  • [SPARK-24396][SS][PYSPARK] 为 Python 添加结构化流式处理 ForeachWriter[SPARK-24396][SS][PYSPARK] Add Structured Streaming ForeachWriter for Python
  • [SPARK-24216][SQL] Spark TypedAggregateExpression 使用在 Scala 中不安全的 getSimpleName[SPARK-24216][SQL] Spark TypedAggregateExpression uses getSimpleName that is not safe in Scala
  • [SPARK-24452][SQL][CORE] 在整数加法或乘法中避免可能的溢出[SPARK-24452][SQL][CORE] Avoid possible overflow in int add or multiple
  • [SPARK-24187][R][SQL] 向 SparkR 添加 array_join 函数[SPARK-24187][R][SQL] Add array_join function to SparkR
  • [SPARK-24525][SS] 提供一个选项,用于限制 MemorySink 中的行数[SPARK-24525][SS] Provide an option to limit number of rows in a MemorySink
  • [SPARK-24331][SPARKR][SQL] 向 SparkR 添加 arrays_overlap、array_repeat、map_entries[SPARK-24331][SPARKR][SQL] Adding arrays_overlap, array_repeat, map_entries to SparkR
  • [SPARK-23931][SQL] 向 Spark SQL 添加 arrays_zip 函数[SPARK-23931][SQL] Adds arrays_zip function to Spark SQL
  • [SPARK-24186][R][SQL] 更改对 R 中的集合函数的反向和连接操作[SPARK-24186][R][SQL] change reverse and concat to collection functions in R
  • [SPARK-24198][SPARKR][SQL] 向 SparkR 添加 slice 函数[SPARK-24198][SPARKR][SQL] Adding slice function to SparkR
  • [SPARK-23920][SQL] 添加了 array_remove,用于删除数组中与 element 等效的所有元素[SPARK-23920][SQL] add array_remove to remove all elements that equal element from array
  • [SPARK-24197][SPARKR][SQL] 向 SparkR 添加 array_sort 函数[SPARK-24197][SPARKR][SQL] Adding array_sort function to SparkR
  • [SPARK-24340][CORE] 在独立群集上的执行程序退出后,清理非无序磁盘块管理器文件[SPARK-24340][CORE] Clean up non-shuffle disk block manager files following executor exits on a standalone cluster
  • [SPARK-23935][SQL] 添加 map_entries 函数[SPARK-23935][SQL] Adding map_entries function
  • [SPARK-24500][SQL] 确保在树转换期间将流具体化。[SPARK-24500][SQL] Make sure streams are materialized during Tree transforms.
  • [SPARK-24495][SQL] EnsureRequirement 在将相等的键重新排序时返回错误的计划[SPARK-24495][SQL] EnsureRequirement returns wrong plan when reordering equal keys
  • [SPARK-24506][UI] 将 UI 筛选器添加到绑定后添加的选项卡[SPARK-24506][UI] Add UI filters to tabs added after binding
  • [SPARK-24468][SQL] 在调整十进制运算的精度时处理负刻度[SPARK-24468][SQL] Handle negative scale when adjusting precision for decimal operations
  • [SPARK-24313][SQL] 修复集合操作针对复杂类型进行的解释计算[SPARK-24313][SQL] Fix collection operations’ interpreted evaluation for complex types
  • [SPARK-23922][SQL] 添加了 arrays_overlap 函数[SPARK-23922][SQL] Add arrays_overlap function
  • [SPARK-24369][SQL] 更正了对具有相同参数集的多个不同聚合的处理[SPARK-24369][SQL] Correct handling for multiple distinct aggregations having the same argument set
  • [SPARK-24455][CORE] 修复了 TaskSchedulerImpl 注释中的拼写错误[SPARK-24455][CORE] fix typo in TaskSchedulerImpl comment
  • [SPARK-24397][PYSPARK] 在 Python 中添加了 TaskContext.getLocalProperty(key)[SPARK-24397][PYSPARK] Added TaskContext.getLocalProperty(key) in Python
  • [SPARK-24117][SQL] 统一了 getSizePerRow[SPARK-24117][SQL] Unified the getSizePerRow
  • [SPARK-24156][SS] 修复了在无数据批中从故障进行恢复时发生的错误[SPARK-24156][SS] Fix error recovering from the failure in a no-data batch
  • [SPARK-24414][UI] 为某个阶段计算正确的任务数。[SPARK-24414][UI] Calculate the correct number of tasks for a stage.
  • [SPARK-23754][PYTHON] 在客户端代码中重新引发 StopIteration[SPARK-23754][PYTHON] Re-raising StopIteration in client code
  • [SPARK-23991][DSTREAMS] 当 allocateBlocksToBatch 中的 WAL 写入失败时修复数据丢失错误[SPARK-23991][DSTREAMS] Fix data loss when WAL write fails in allocateBlocksToBatch
  • [SPARK-24373][SQL] 向 RelationalGroupedDataset 的子代和 KeyValueGroupedDataset 的子代添加 AnalysisBarrier[SPARK-24373][SQL] Add AnalysisBarrier to RelationalGroupedDataset’s and KeyValueGroupedDataset’s child
  • [SPARK-24392][PYTHON] 将 pandas_udf as 标记为试验性的[SPARK-24392][PYTHON] Label pandas_udf as Experimental
  • [SPARK-24334] 修复了 ArrowPythonRunner 中出现争用情况时导致 Arrow 内存分配器不正常关闭的问题[SPARK-24334] Fix race condition in ArrowPythonRunner causes unclean shutdown of Arrow memory allocator
  • [SPARK-19112][CORE] 将缺少的 shortCompressionCodecNames 添加到配置。[SPARK-19112][CORE] Add missing shortCompressionCodecNames to configuration.
  • [SPARK-24244][SPARK-24368][SQL] 仅传递 CSV 分析程序所需的列[SPARK-24244][SPARK-24368][SQL] Passing only required columns to the CSV parser
  • [SPARK-24366][SQL] 改进用于类型转换的错误消息[SPARK-24366][SQL] Improving of error messages for type converting
  • [SPARK-24371][SQL] 在用于 Scala 的数据帧 API 中添加了 isInCollection[SPARK-24371][SQL] Added isInCollection in DataFrame API for Scala an…
  • [SPARK-23925][SQL] 添加了 array_repeat 集合函数[SPARK-23925][SQL] Add array_repeat collection function
  • [MINOR] 在 toString 和 scaladoc 中添加了端口 SSL 配置[MINOR] Add port SSL config in toString and scaladoc
  • [SPARK-24378][SQL] 修复了 date_trunc 函数的不正确示例[SPARK-24378][SQL] Fix date_trunc function incorrect examples
  • [SPARK-24364][SS] 防止 InMemoryFileIndex 在文件路径不存在时失败[SPARK-24364][SS] Prevent InMemoryFileIndex from failing if file path doesn’t exist
  • [SPARK-24257][SQL] LongToUnsafeRowMap 计算的新大小可能是错误的[SPARK-24257][SQL] LongToUnsafeRowMap calculate the new size may be wrong
  • [SPARK-24348][SQL] 修复了 element_at 错误[SPARK-24348][SQL] element_at” error fix
  • [SPARK-23930][SQL] 添加 slice 函数[SPARK-23930][SQL] Add slice function
  • [SPARK-23416][SS] 为 ContinuousExecution 添加了特定的 stop 方法。[SPARK-23416][SS] Add a specific stop method for ContinuousExecution.
  • [SPARK-23852][SQL] 升级到 Parquet 1.8.3[SPARK-23852][SQL] Upgrade to Parquet 1.8.3
  • [SPARK-24350][SQL] 修复了“array_position”函数中的 ClassCastException[SPARK-24350][SQL] Fixes ClassCastException in the “array_position” function
  • [SPARK-24321][SQL] 从 Divide/Remainder 中将公用代码提取到基础特征[SPARK-24321][SQL] Extract common code from Divide/Remainder to a base trait
  • [SPARK-24309][CORE] 发生中断时,AsyncEventQueue 应停止。[SPARK-24309][CORE] AsyncEventQueue should stop on interrupt.
  • [SPARK-23850][SQL] 针对 SQL 选项修正添加单独的配置。[SPARK-23850][SQL] Add separate config for SQL options redaction.
  • [SPARK-22371][CORE] 对累加器执行垃圾回收时,返回 None 而不是引发异常。[SPARK-22371][CORE] Return None instead of throwing an exception when an accumulator is garbage collected.
  • [SPARK-24002][SQL] 任务由于 org.apache.parquet.io.api.Binary$ByteBufferBackedBinary.getBytes 而无法序列化[SPARK-24002][SQL] Task not serializable caused by org.apache.parquet.io.api.Binary$ByteBufferBackedBinary.getBytes
  • [SPARK-23921][SQL] 添加 array_sort 函数[SPARK-23921][SQL] Add array_sort function
  • [SPARK-23923][SQL] 添加 cardinality 函数[SPARK-23923][SQL] Add cardinality function
  • [SPARK-24159][SS] 为流式处理 mapGroupswithState 启用无数据微批处理[SPARK-24159][SS] Enable no-data micro batches for streaming mapGroupswithState
  • [SPARK-24158][SS] 为流式处理联接启用无数据批处理[SPARK-24158][SS] Enable no-data batches for streaming joins
  • [SPARK-24157][SS] 在 MicroBatchExecution 中启用了用于流式处理聚合和重复数据删除的无数据批处理[SPARK-24157][SS] Enabled no-data batches in MicroBatchExecution for streaming aggregation and deduplication
  • [SPARK-23799][SQL] FilterEstimation.evaluateInSet 为 STRING 生成了错误的统计信息[SPARK-23799][SQL] FilterEstimation.evaluateInSet produces wrong stats for STRING
  • [SPARK-17916][SQL] 修复了当设置 nullValue 时将空字符串分析为 null 的错误。[SPARK-17916][SQL] Fix empty string being parsed as null when nullValue is set.
  • [SPARK-23916][SQL] 添加 array_join 函数[SPARK-23916][SQL] Add array_join function
  • [SPARK-23408][SS] 同步流式处理 JoinSuite 过程中的连续 AddData 操作[SPARK-23408][SS] Synchronize successive AddData actions in Streaming*JoinSuite
  • [SPARK-23780][R] 无法将 googleVis 库与新的 SparkR 一起使用[SPARK-23780][R] Failed to use googleVis library with new SparkR
  • [SPARK-23821][SQL] 集合函数:flatten[SPARK-23821][SQL] Collection function: flatten
  • [SPARK-23627][SQL] 在数据集中提供 isEmpty[SPARK-23627][SQL] Provide isEmpty in Dataset
  • [SPARK-24027][SQL] from_json 支持在使用 MapType 时将键的 StringType 作为根类型[SPARK-24027][SQL] Support MapType with StringType for keys as the root type by from_json
  • [SPARK-24035][SQL] 用于透视的 SQL 语法 - 修复 antlr 警告[SPARK-24035][SQL] SQL syntax for Pivot - fix antlr warning
  • [SPARK-23736][SQL] 扩展了 concat 函数以支持数组列[SPARK-23736][SQL] Extending the concat function to support array columns
  • [SPARK-24246][SQL] 当原因已知时通过设置原因改进 AnalysisException[SPARK-24246][SQL] Improve AnalysisException by setting the cause when it’s available
  • [SPARK-24263][R] SparkR java 检查在使用 openjdk 时中断[SPARK-24263][R] SparkR java check breaks with openjdk
  • [SPARK-24262][PYTHON] 修复 UDF 类型匹配错误消息中的拼写错误[SPARK-24262][PYTHON] Fix typo in UDF type match error message
  • [SPARK-24067][STREAMING][KAFKA] 允许非连续偏移[SPARK-24067][STREAMING][KAFKA] Allow non-consecutive offsets
  • [SPARK-10878][CORE] 修复了当多个客户端同时解析项目时出现争用情况的问题[SPARK-10878][CORE] Fix race condition when multiple clients resolves artifacts at the same time
  • [SPARK-19181][CORE] 修复不可靠的“SparkListenerSuite.local metrics”[SPARK-19181][CORE] Fixing flaky “SparkListenerSuite.local metrics”
  • [SPARK-24068]将 DataFrameReader 的选项传播到有关架构推理的文本数据源[SPARK-24068]Propagating DataFrameReader’s options to Text datasource on schema inferring
  • [SPARK-24214][SS] 修复 StreamingRelationV2/StreamingExecutionRelation/ContinuousExecutionRelation 的 toJSON[SPARK-24214][SS] Fix toJSON for StreamingRelationV2/StreamingExecutionRelation/ContinuousExecutionRelation
  • [SPARK-23919][SPARK-23924][SPARK-24054][SQL] 添加 array_position/element_at 函数[SPARK-23919][SPARK-23924][SPARK-24054][SQL] Add array_position/element_at function
  • [SPARK-23926][SQL] 扩展 reverse 函数以支持 ArrayType 参数[SPARK-23926][SQL] Extending reverse function to support ArrayType arguments
  • [SPARK-23809][SQL] 应当通过 getOrCreate 设置活动 SparkSession[SPARK-23809][SQL] Active SparkSession should be set by getOrCreate
  • [SPARK-23094][SPARK-23723][SPARK-23724][SQL] 支持针对 json 文件进行的自定义编码[SPARK-23094][SPARK-23723][SPARK-23724][SQL] Support custom encoding for json files
  • [SPARK-24035][SQL] 用于透视的 SQL 语法[SPARK-24035][SQL] SQL syntax for Pivot
  • [SPARK-24069][R] 添加 array_min / array_max 函数[SPARK-24069][R] Add array_min / array_max functions
  • [SPARK-23976][CORE] 检测 UTF8String.concat()/ByteArray.concat() 中的长度溢出[SPARK-23976][CORE] Detect length overflow in UTF8String.concat()/ByteArray.concat()
  • [SPARK-24188][CORE] 还原“/version”API 终结点。[SPARK-24188][CORE] Restore “/version” API endpoint.
  • [SPARK-24128][SQL] 在隐式 CROSS JOIN 错误中提到配置选项[SPARK-24128][SQL] Mention configuration option in implicit CROSS JOIN error
  • [SPARK-23291][SQL][R] 当调用 Scala API 时,R 的 substr 不应将起始位置减 1[SPARK-23291][SQL][R] R’s substr should not reduce starting position by 1 when calling Scala API
  • [SPARK-23697][CORE] LegacyAccumulatorWrapper 应当正确定义 isZero[SPARK-23697][CORE] LegacyAccumulatorWrapper should define isZero correctly
  • [SPARK-24168][SQL] WindowExec 不应在执行程序端访问 SQLConf[SPARK-24168][SQL] WindowExec should not access SQLConf at executor side
  • [SPARK-24143]将 mapstatus 转换为 (blockId, size) 对时筛选空块[SPARK-24143]filter empty blocks when convert mapstatus to (blockId, size) pair
  • [SPARK-23917][SPARK-23918][SQL] 添加 array_max/array_min 函数[SPARK-23917][SPARK-23918][SQL] Add array_max/array_min function
  • [SPARK-23905][SQL] 添加 UDF 工作日[SPARK-23905][SQL] Add UDF weekday
  • [SPARK-16406][SQL] 改进 LogicalPlan.resolve 的性能[SPARK-16406][SQL] Improve performance of LogicalPlan.resolve
  • [SPARK-24013][SQL] 删除 ApproximatePercentile 中的不必要压缩[SPARK-24013][SQL] Remove unneeded compress in ApproximatePercentile
  • [SPARK-23433][CORE] 延迟完成僵尸任务后会更新所有任务集[SPARK-23433][CORE] Late zombie task completions update all tasksets
  • [SPARK-24169][SQL] JsonToStructs 不应在执行程序端访问 SQLConf[SPARK-24169][SQL] JsonToStructs should not access SQLConf at executor side
  • [SPARK-24133][SQL] 向后移植 [SPARK-24133]检查重设 WritableColumnVectors 大小时是否发生整数溢出[SPARK-24133][SQL] Backport [SPARK-24133]Check for integer overflows when resizing WritableColumnVectors
  • [SPARK-24166][SQL] InMemoryTableScanExec 不应在执行程序端访问 SQLConf[SPARK-24166][SQL] InMemoryTableScanExec should not access SQLConf at executor side
  • [SPARK-24133][SQL] 检查重设 WritableColumnVectors 大小时是否发生整数溢出[SPARK-24133][SQL] Check for integer overflows when resizing WritableColumnVectors
  • [SPARK-24085][SQL] 如果在分区表达式中存在标量子查询,则查询会返回 UnsupportedOperationException[SPARK-24085][SQL] Query returns UnsupportedOperationException when scalar subquery is present in partitioning expression
  • [SPARK-24062][THRIFT SERVER] 修复了 SASL 加密无法在 Thrift 服务器中启用的问题[SPARK-24062][THRIFT SERVER] Fix SASL encryption cannot enabled issue in thrift server
  • [SPARK-23004][SS] 确保在流式处理聚合任务中仅调用 StateStore.commit 一次[SPARK-23004][SS] Ensure StateStore.commit is called only once in a streaming aggregation task
  • [SPARK-23188][SQL] 使向量化列式读取器批处理大小可配置[SPARK-23188][SQL] Make vectorized columar reader batch size configurable
  • [SPARK-23375][SPARK-23973][SQL] 消除优化器中的不必要排序[SPARK-23375][SPARK-23973][SQL] Eliminate unneeded Sort in Optimizer
  • [SPARK-23877][SQL] 使用筛选器谓词来修剪仅限元数据的查询中的分区[SPARK-23877][SQL] Use filter predicates to prune partitions in metadata-only queries
  • [SPARK-24033][SQL] 修复了不匹配的窗口框架 specifiedwindowframe(RowFrame, -1, -1)[SPARK-24033][SQL] Fix Mismatched of Window Frame specifiedwindowframe(RowFrame, -1, -1)
  • [SPARK-23340][SQL] 将 Apache ORC 升级到 1.4.3[SPARK-23340][SQL] Upgrade Apache ORC to 1.4.3
  • 修复了 null 检查缺失问题,该问题很可能由简化的表达式代码生成触发,并由 SPARK-23986 公开,因为它使生成的源代码稍长一些,并触发了有问题的代码路径(通过 Expression.reduceCodeSize() 进行代码拆分)。Fix a missing null check issue that is more likely triggered by streamlined experssion code generation, and exposed by SPARK-23986 because it made the generated source code a bit longer, and it triggered the problematic code path (code splitting by Expression.reduceCodeSize()).
  • [SPARK-23989][SQL] exchange 应当在非序列化混排之前复制数据[SPARK-23989][SQL] exchange should copy data before non-serialized shuffle
  • [SPARK-24021][CORE] 修复 BlacklistTracker 的 updateBlacklistForFetchFailure 中的 bug[SPARK-24021][CORE] fix bug in BlacklistTracker’s updateBlacklistForFetchFailure
  • [SPARK-24014][PYSPARK] 将 onStreamingStarted 方法添加到 StreamingListener[SPARK-24014][PYSPARK] Add onStreamingStarted method to StreamingListener
  • [SPARK-23963][SQL] 在针对基于文本的 Hive 表进行的查询中正确处理大量列[SPARK-23963][SQL] Properly handle large number of columns in query on text-based Hive table
  • [SPARK-23948] 在 submitMissingTasks 中触发 mapstage 的作业侦听器[SPARK-23948] Trigger mapstage’s job listener in submitMissingTasks
  • [SPARK-23986][SQL] freshName 可以生成非唯一名称[SPARK-23986][SQL] freshName can generate non-unique names
  • [SPARK-23835][SQL] 向元组的参数反序列化添加非 null 检查[SPARK-23835][SQL] Add not-null check to Tuples’ arguments deserialization

维护更新Maintenance updates

请参阅 Databricks Runtime 4.2 维护更新See Databricks Runtime 4.2 maintenance updates.

系统环境System environment

  • 操作系统:Ubuntu 16.04.4 LTSOperating System: Ubuntu 16.04.4 LTS
  • Java:1.8.0_162Java: 1.8.0_162
  • Scala:2.11.8Scala: 2.11.8
  • Python:适用于 Python 2 群集的 2.7.12 和适用于 Python 3 群集的 3.5.2。Python: 2.7.12 for Python 2 clusters and 3.5.2 for Python 3 clusters. 有关详细信息,请参阅 Python 版本For details, see Python version.
  • R:R 版本 3.4.4 (2018-03-15)R: R version 3.4.4 (2018-03-15)
  • GPU 群集:安装了以下 NVIDIA GPU 库:GPU clusters: The following NVIDIA GPU libraries are installed:
    • Tesla 驱动程序 375.66Tesla driver 375.66
    • CUDA 9.0CUDA 9.0
    • cuDNN 7.0cuDNN 7.0

已安装的 Python 库Installed Python libraries

Library 版本Version Library 版本Version Library 版本Version
ansi2htmlansi2html 1.1.11.1.1 argparseargparse 1.2.11.2.1 backports-abcbackports-abc 0.50.5
botoboto 2.42.02.42.0 boto3boto3 1.4.11.4.1 botocorebotocore 1.4.701.4.70
brewer2mplbrewer2mpl 1.4.11.4.1 certificertifi 2016.2.282016.2.28 cfficffi 1.7.01.7.0
chardetchardet 2.3.02.3.0 coloramacolorama 0.3.70.3.7 configobjconfigobj 5.0.65.0.6
密码系统cryptography 1.51.5 cyclercycler 0.10.00.10.0 CythonCython 0.24.10.24.1
decoratordecorator 4.0.104.0.10 docutilsdocutils 0.140.14 enum34enum34 1.1.61.1.6
et-xmlfileet-xmlfile 1.0.11.0.1 freetype-pyfreetype-py 1.0.21.0.2 funcsigsfuncsigs 1.0.21.0.2
fusepyfusepy 2.0.42.0.4 Futurefutures 3.2.03.2.0 ggplotggplot 0.6.80.6.8
html5libhtml5lib 0.9990.999 idnaidna 2.12.1 ipaddressipaddress 1.0.161.0.16
ipythonipython 2.2.02.2.0 ipython-genutilsipython-genutils 0.1.00.1.0 jdcaljdcal 1.21.2
Jinja2Jinja2 2.82.8 jmespathjmespath 0.9.00.9.0 llvmlitellvmlite 0.13.00.13.0
lxmllxml 3.6.43.6.4 MarkupSafeMarkupSafe 0.230.23 matplotlibmatplotlib 1.5.31.5.3
mpld3mpld3 0.20.2 msgpack-pythonmsgpack-python 0.4.70.4.7 ndg-httpsclientndg-httpsclient 0.3.30.3.3
numbanumba 0.28.10.28.1 numpynumpy 1.11.11.11.1 openpyxlopenpyxl 2.3.22.3.2
pandaspandas 0.19.20.19.2 pathlib2pathlib2 2.1.02.1.0 patsypatsy 0.4.10.4.1
pexpectpexpect 4.0.14.0.1 picklesharepickleshare 0.7.40.7.4 PillowPillow 3.3.13.3.1
pippip 10.0.110.0.1 plyply 3.93.9 prompt-toolkitprompt-toolkit 1.0.71.0.7
psycopg2psycopg2 2.6.22.6.2 ptyprocessptyprocess 0.5.10.5.1 py4jpy4j 0.10.30.10.3
pyarrowpyarrow 0.8.00.8.0 pyasn1pyasn1 0.1.90.1.9 pycparserpycparser 2.142.14
PygmentsPygments 2.1.32.1.3 PyGObjectPyGObject 3.20.03.20.0 pyOpenSSLpyOpenSSL 16.0.016.0.0
pyparsingpyparsing 2.2.02.2.0 pypngpypng 0.0.180.0.18 PythonPython 2.7.122.7.12
python-dateutilpython-dateutil 2.5.32.5.3 python-geohashpython-geohash 0.8.50.8.5 pytzpytz 2016.6.12016.6.1
请求requests 2.11.12.11.1 s3transfers3transfer 0.1.90.1.9 scikit-learnscikit-learn 0.18.10.18.1
scipyscipy 0.18.10.18.1 scourscour 0.320.32 seabornseaborn 0.7.10.7.1
setuptoolssetuptools 39.2.039.2.0 simplejsonsimplejson 3.8.23.8.2 simples3simples3 1.01.0
singledispatchsingledispatch 3.4.0.33.4.0.3 6six 1.10.01.10.0 statsmodelsstatsmodels 0.6.10.6.1
tornadotornado 5.0.25.0.2 traitletstraitlets 4.3.04.3.0 urllib3urllib3 1.19.11.19.1
virtualenvvirtualenv 15.0.115.0.1 wcwidthwcwidth 0.1.70.1.7 wheelwheel 0.31.10.31.1
wsgirefwsgiref 0.1.20.1.2

已安装的 R 库Installed R libraries

Library 版本Version Library 版本Version Library 版本Version
abindabind 1.4-51.4-5 assertthatassertthat 0.2.00.2.0 backportsbackports 1.1.21.1.2
basebase 3.4.43.4.4 BHBH 1.66.0-11.66.0-1 bindrbindr 0.1.10.1.1
bindrcppbindrcpp 0.2.20.2.2 bitbit 1.1-121.1-12 bit64bit64 0.9-70.9-7
bitopsbitops 1.0-61.0-6 blobblob 1.1.11.1.1 bootboot 1.3-201.3-20
brewbrew 1.0-61.0-6 broombroom 0.4.40.4.4 carcar 3.0-03.0-0
carDatacarData 3.0-13.0-1 caretcaret 6.0-796.0-79 cellrangercellranger 1.1.01.1.0
chronchron 2.3-522.3-52 classclass 7.3-147.3-14 clicli 1.0.01.0.0
clustercluster 2.0.7-12.0.7-1 codetoolscodetools 0.2-150.2-15 colorspacecolorspace 1.3-21.3-2
commonmarkcommonmark 1.41.4 compilercompiler 3.4.43.4.4 crayoncrayon 1.3.41.3.4
curlcurl 3.23.2 CVSTCVST 0.2-10.2-1 data.tabledata.table 1.10.4-31.10.4-3
datasetsdatasets 3.4.43.4.4 DBIDBI 0.80.8 ddalphaddalpha 1.3.1.11.3.1.1
DEoptimRDEoptimR 1.0-81.0-8 descdesc 1.1.11.1.1 devtoolsdevtools 1.13.51.13.5
dichromatdichromat 2.0-02.0-0 digestdigest 0.6.150.6.15 dimReddimRed 0.1.00.1.0
doMCdoMC 1.3.51.3.5 dplyrdplyr 0.7.40.7.4 DRRDRR 0.0.30.0.3
forcatsforcats 0.3.00.3.0 foreachforeach 1.4.41.4.4 foreignforeign 0.8-700.8-70
gbmgbm 2.1.32.1.3 ggplot2ggplot2 2.2.12.2.1 git2rgit2r 0.21.00.21.0
glmnetglmnet 2.0-162.0-16 glueglue 1.2.01.2.0 gowergower 0.1.20.1.2
graphicsgraphics 3.4.43.4.4 grDevicesgrDevices 3.4.43.4.4 gridgrid 3.4.43.4.4
gsubfngsubfn 0.70.7 gtablegtable 0.2.00.2.0 h2oh2o 3.16.0.23.16.0.2
havenhaven 1.1.11.1.1 hmshms 0.4.20.4.2 httrhttr 1.3.11.3.1
hwriterhwriter 1.3.21.3.2 hwriterPlushwriterPlus 1.0-31.0-3 ipredipred 0.9-60.9-6
iteratorsiterators 1.0.91.0.9 jsonlitejsonlite 1.51.5 kernlabkernlab 0.9-250.9-25
KernSmoothKernSmooth 2.23-152.23-15 labelinglabeling 0.30.3 latticelattice 0.20-350.20-35
lavalava 1.6.11.6.1 lazyevallazyeval 0.2.10.2.1 littlerlittler 0.3.30.3.3
lme4lme4 1.1-171.1-17 lubridatelubridate 1.7.31.7.3 magrittrmagrittr 1.51.5
mapprojmapproj 1.2.61.2.6 mapsmaps 3.3.03.3.0 maptoolsmaptools 0.9-20.9-2
MASSMASS 7.3-507.3-50 矩阵Matrix 1.2-141.2-14 MatrixModelsMatrixModels 0.4-10.4-1
memoisememoise 1.1.01.1.0 methodsmethods 3.4.43.4.4 mgcvmgcv 1.8-241.8-24
mimemime 0.50.5 minqaminqa 1.2.41.2.4 mnormtmnormt 1.5-51.5-5
ModelMetricsModelMetrics 1.1.01.1.0 munsellmunsell 0.4.30.4.3 mvtnormmvtnorm 1.0-71.0-7
nlmenlme 3.1-1373.1-137 nloptrnloptr 1.0.41.0.4 nnetnnet 7.3-127.3-12
numDerivnumDeriv 2016.8-12016.8-1 opensslopenssl 1.0.11.0.1 openxlsxopenxlsx 4.0.174.0.17
parallelparallel 3.4.43.4.4 pbkrtestpbkrtest 0.4-70.4-7 pillarpillar 1.2.11.2.1
pkgconfigpkgconfig 2.0.12.0.1 pkgKittenpkgKitten 0.1.40.1.4 plogrplogr 0.2.00.2.0
plyrplyr 1.8.41.8.4 praisepraise 1.0.01.0.0 prettyunitsprettyunits 1.0.21.0.2
pROCpROC 1.11.01.11.0 prodlimprodlim 1.6.11.6.1 protoproto 1.0.01.0.0
psychpsych 1.8.3.31.8.3.3 purrrpurrr 0.2.40.2.4 quantregquantreg 5.355.35
R.methodsS3R.methodsS3 1.7.11.7.1 R.ooR.oo 1.21.01.21.0 R.utilsR.utils 2.6.02.6.0
R6R6 2.2.22.2.2 randomForestrandomForest 4.6-144.6-14 RColorBrewerRColorBrewer 1.1-21.1-2
RcppRcpp 0.12.160.12.16 RcppEigenRcppEigen 0.3.3.4.00.3.3.4.0 RcppRollRcppRoll 0.2.20.2.2
RCurlRCurl 1.95-4.101.95-4.10 readrreadr 1.1.11.1.1 readxlreadxl 1.0.01.0.0
recipesrecipes 0.1.20.1.2 rematchrematch 1.0.11.0.1 reshape2reshape2 1.4.31.4.3
riorio 0.5.100.5.10 rlangrlang 0.2.00.2.0 robustbaserobustbase 0.92-80.92-8
RODBCRODBC 1.3-151.3-15 roxygen2roxygen2 6.0.16.0.1 rpartrpart 4.1-134.1-13
rprojrootrprojroot 1.3-21.3-2 RserveRserve 1.7-31.7-3 RSQLiteRSQLite 2.1.02.1.0
rstudioapirstudioapi 0.70.7 scalesscales 0.5.00.5.0 sfsmiscsfsmisc 1.1-21.1-2
spsp 1.2-71.2-7 SparkRSparkR 2.3.12.3.1 SparseMSparseM 1.771.77
spatialspatial 7.3-117.3-11 splinessplines 3.4.43.4.4 sqldfsqldf 0.4-110.4-11
SQUAREMSQUAREM 2017.10-12017.10-1 statmodstatmod 1.4.301.4.30 statsstats 3.4.43.4.4
stats4stats4 3.4.43.4.4 stringistringi 1.1.71.1.7 stringrstringr 1.3.01.3.0
survivalsurvival 2.42-32.42-3 tcltktcltk 3.4.43.4.4 TeachingDemosTeachingDemos 2.102.10
testthattestthat 2.0.02.0.0 tibbletibble 1.4.21.4.2 tidyrtidyr 0.8.00.8.0
tidyselecttidyselect 0.2.40.2.4 timeDatetimeDate 3043.1023043.102 toolstools 3.4.43.4.4
utf8utf8 1.1.31.1.3 utilsutils 3.4.43.4.4 viridisLiteviridisLite 0.3.00.3.0
whiskerwhisker 0.3-20.3-2 withrwithr 2.1.22.1.2 xml2xml2 1.2.01.2.0

已安装的 Java 库和 Scala 库(Scala 2.11 群集版本)Installed Java and Scala libraries (Scala 2.11 cluster version)

组 IDGroup ID 项目 IDArtifact ID 版本Version
antlrantlr antlrantlr 2.7.72.7.7
com.amazonawscom.amazonaws amazon-kinesis-clientamazon-kinesis-client 1.7.31.7.3
com.amazonawscom.amazonaws aws-java-sdk-autoscalingaws-java-sdk-autoscaling 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-cloudformationaws-java-sdk-cloudformation 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-cloudfrontaws-java-sdk-cloudfront 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-cloudhsmaws-java-sdk-cloudhsm 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-cloudsearchaws-java-sdk-cloudsearch 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-cloudtrailaws-java-sdk-cloudtrail 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-cloudwatchaws-java-sdk-cloudwatch 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-cloudwatchmetricsaws-java-sdk-cloudwatchmetrics 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-codedeployaws-java-sdk-codedeploy 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-cognitoidentityaws-java-sdk-cognitoidentity 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-cognitosyncaws-java-sdk-cognitosync 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-configaws-java-sdk-config 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-coreaws-java-sdk-core 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-datapipelineaws-java-sdk-datapipeline 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-directconnectaws-java-sdk-directconnect 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-directoryaws-java-sdk-directory 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-dynamodbaws-java-sdk-dynamodb 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-ec2aws-java-sdk-ec2 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-ecsaws-java-sdk-ecs 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-efsaws-java-sdk-efs 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-elasticacheaws-java-sdk-elasticache 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-elasticbeanstalkaws-java-sdk-elasticbeanstalk 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-elasticloadbalancingaws-java-sdk-elasticloadbalancing 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-elastictranscoderaws-java-sdk-elastictranscoder 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-emraws-java-sdk-emr 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-glacieraws-java-sdk-glacier 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-iamaws-java-sdk-iam 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-importexportaws-java-sdk-importexport 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-kinesisaws-java-sdk-kinesis 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-kmsaws-java-sdk-kms 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-lambdaaws-java-sdk-lambda 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-logsaws-java-sdk-logs 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-machinelearningaws-java-sdk-machinelearning 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-opsworksaws-java-sdk-opsworks 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-rdsaws-java-sdk-rds 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-redshiftaws-java-sdk-redshift 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-route53aws-java-sdk-route53 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-s3aws-java-sdk-s3 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-sesaws-java-sdk-ses 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-simpledbaws-java-sdk-simpledb 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-simpleworkflowaws-java-sdk-simpleworkflow 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-snsaws-java-sdk-sns 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-sqsaws-java-sdk-sqs 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-ssmaws-java-sdk-ssm 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-storagegatewayaws-java-sdk-storagegateway 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-stsaws-java-sdk-sts 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-supportaws-java-sdk-support 1.11.3131.11.313
com.amazonawscom.amazonaws aws-java-sdk-swf-librariesaws-java-sdk-swf-libraries 1.11.221.11.22
com.amazonawscom.amazonaws aws-java-sdk-workspacesaws-java-sdk-workspaces 1.11.3131.11.313
com.amazonawscom.amazonaws jmespath-javajmespath-java 1.11.3131.11.313
com.carrotsearchcom.carrotsearch hppchppc 0.7.20.7.2
com.chuusaicom.chuusai shapeless_2.11shapeless_2.11 2.3.22.3.2
com.clearspring.analyticscom.clearspring.analytics 流 (stream)stream 2.7.02.7.0
com.databrickscom.databricks RserveRserve 1.8-31.8-3
com.databrickscom.databricks dbml-local_2.11dbml-local_2.11 0.4.1-db1-spark2.30.4.1-db1-spark2.3
com.databrickscom.databricks dbml-local_2.11-testsdbml-local_2.11-tests 0.4.1-db1-spark2.30.4.1-db1-spark2.3
com.databrickscom.databricks jets3tjets3t 0.7.1-00.7.1-0
com.databricks.scalapbcom.databricks.scalapb compilerplugin_2.11compilerplugin_2.11 0.4.15-90.4.15-9
com.databricks.scalapbcom.databricks.scalapb scalapb-runtime_2.11scalapb-runtime_2.11 0.4.15-90.4.15-9
com.esotericsoftwarecom.esotericsoftware kryo-shadedkryo-shaded 3.0.33.0.3
com.esotericsoftwarecom.esotericsoftware minlogminlog 1.3.01.3.0
com.fasterxmlcom.fasterxml classmateclassmate 1.0.01.0.0
com.fasterxml.jackson.corecom.fasterxml.jackson.core jackson-annotationsjackson-annotations 2.6.72.6.7
com.fasterxml.jackson.corecom.fasterxml.jackson.core jackson-corejackson-core 2.6.72.6.7
com.fasterxml.jackson.corecom.fasterxml.jackson.core jackson-databindjackson-databind 2.6.7.12.6.7.1
com.fasterxml.jackson.dataformatcom.fasterxml.jackson.dataformat jackson-dataformat-cborjackson-dataformat-cbor 2.6.72.6.7
com.fasterxml.jackson.datatypecom.fasterxml.jackson.datatype jackson-datatype-jodajackson-datatype-joda 2.6.72.6.7
com.fasterxml.jackson.modulecom.fasterxml.jackson.module jackson-module-paranamerjackson-module-paranamer 2.6.72.6.7
com.fasterxml.jackson.modulecom.fasterxml.jackson.module jackson-module-scala_2.11jackson-module-scala_2.11 2.6.7.12.6.7.1
com.github.fommilcom.github.fommil jniloaderjniloader 1.11.1
com.github.fommil.netlibcom.github.fommil.netlib corecore 1.1.21.1.2
com.github.fommil.netlibcom.github.fommil.netlib native_ref-javanative_ref-java 1.11.1
com.github.fommil.netlibcom.github.fommil.netlib native_ref-java-nativesnative_ref-java-natives 1.11.1
com.github.fommil.netlibcom.github.fommil.netlib native_system-javanative_system-java 1.11.1
com.github.fommil.netlibcom.github.fommil.netlib native_system-java-nativesnative_system-java-natives 1.11.1
com.github.fommil.netlibcom.github.fommil.netlib netlib-native_ref-linux-x86_64-nativesnetlib-native_ref-linux-x86_64-natives 1.11.1
com.github.fommil.netlibcom.github.fommil.netlib netlib-native_system-linux-x86_64-nativesnetlib-native_system-linux-x86_64-natives 1.11.1
com.github.lubencom.github.luben zstd-jnizstd-jni 1.3.2-21.3.2-2
com.github.rwlcom.github.rwl jtransformsjtransforms 2.4.02.4.0
com.google.code.findbugscom.google.code.findbugs jsr305jsr305 2.0.12.0.1
com.google.code.gsoncom.google.code.gson gsongson 2.2.42.2.4
com.google.guavacom.google.guava guavaguava 15.015.0
com.google.protobufcom.google.protobuf protobuf-javaprotobuf-java 2.6.12.6.1
com.googlecode.javaewahcom.googlecode.javaewah JavaEWAHJavaEWAH 0.3.20.3.2
com.h2databasecom.h2database h2h2 1.3.1741.3.174
com.jamesmurty.utilscom.jamesmurty.utils java-xmlbuilderjava-xmlbuilder 1.11.1
com.jcraftcom.jcraft jschjsch 0.1.500.1.50
com.jolboxcom.jolbox bonecpbonecp 0.8.0.RELEASE0.8.0.RELEASE
com.mchangecom.mchange c3p0c3p0 0.9.5.10.9.5.1
com.mchangecom.mchange mchange-commons-javamchange-commons-java 0.2.100.2.10
com.microsoft.azurecom.microsoft.azure azure-data-lake-store-sdkazure-data-lake-store-sdk 2.2.82.2.8
com.microsoft.sqlservercom.microsoft.sqlserver mssql-jdbcmssql-jdbc 6.2.2.jre86.2.2.jre8
com.ningcom.ning compress-lzfcompress-lzf 1.0.31.0.3
com.sun.mailcom.sun.mail javax.mailjavax.mail 1.5.21.5.2
com.thoughtworks.paranamercom.thoughtworks.paranamer paranamerparanamer 2.82.8
com.trueaccord.lensescom.trueaccord.lenses lenses_2.11lenses_2.11 0.30.3
com.twittercom.twitter chill-javachill-java 0.8.40.8.4
com.twittercom.twitter chill_2.11chill_2.11 0.8.40.8.4
com.twittercom.twitter parquet-hadoop-bundleparquet-hadoop-bundle 1.6.01.6.0
com.twittercom.twitter util-app_2.11util-app_2.11 6.23.06.23.0
com.twittercom.twitter util-core_2.11util-core_2.11 6.23.06.23.0
com.twittercom.twitter util-jvm_2.11util-jvm_2.11 6.23.06.23.0
com.typesafecom.typesafe configconfig 1.2.11.2.1
com.typesafe.scala-loggingcom.typesafe.scala-logging scala-logging-api_2.11scala-logging-api_2.11 2.1.22.1.2
com.typesafe.scala-loggingcom.typesafe.scala-logging scala-logging-slf4j_2.11scala-logging-slf4j_2.11 2.1.22.1.2
com.univocitycom.univocity univocity-parsersunivocity-parsers 2.5.92.5.9
com.vlkancom.vlkan flatbuffersflatbuffers 1.2.0-3f79e0551.2.0-3f79e055
com.zaxxercom.zaxxer HikariCPHikariCP 3.1.03.1.0
commons-beanutilscommons-beanutils commons-beanutilscommons-beanutils 1.7.01.7.0
commons-beanutilscommons-beanutils commons-beanutils-corecommons-beanutils-core 1.8.01.8.0
commons-clicommons-cli commons-clicommons-cli 1.21.2
commons-codeccommons-codec commons-codeccommons-codec 1.101.10
commons-collectionscommons-collections commons-collectionscommons-collections 3.2.23.2.2
commons-configurationcommons-configuration commons-configurationcommons-configuration 1.61.6
commons-dbcpcommons-dbcp commons-dbcpcommons-dbcp 1.41.4
commons-digestercommons-digester commons-digestercommons-digester 1.81.8
commons-httpclientcommons-httpclient commons-httpclientcommons-httpclient 3.13.1
commons-iocommons-io commons-iocommons-io 2.42.4
commons-langcommons-lang commons-langcommons-lang 2.62.6
commons-loggingcommons-logging commons-loggingcommons-logging 1.1.31.1.3
commons-netcommons-net commons-netcommons-net 2.22.2
commons-poolcommons-pool commons-poolcommons-pool 1.5.41.5.4
info.ganglia.gmetric4jinfo.ganglia.gmetric4j gmetric4jgmetric4j 1.0.71.0.7
io.airliftio.airlift aircompressoraircompressor 0.80.8
io.dropwizard.metricsio.dropwizard.metrics metrics-coremetrics-core 3.1.53.1.5
io.dropwizard.metricsio.dropwizard.metrics metrics-gangliametrics-ganglia 3.1.53.1.5
io.dropwizard.metricsio.dropwizard.metrics metrics-graphitemetrics-graphite 3.1.53.1.5
io.dropwizard.metricsio.dropwizard.metrics metrics-healthchecksmetrics-healthchecks 3.1.53.1.5
io.dropwizard.metricsio.dropwizard.metrics metrics-jetty9metrics-jetty9 3.1.53.1.5
io.dropwizard.metricsio.dropwizard.metrics metrics-jsonmetrics-json 3.1.53.1.5
io.dropwizard.metricsio.dropwizard.metrics metrics-jvmmetrics-jvm 3.1.53.1.5
io.dropwizard.metricsio.dropwizard.metrics metrics-log4jmetrics-log4j 3.1.53.1.5
io.dropwizard.metricsio.dropwizard.metrics metrics-servletsmetrics-servlets 3.1.53.1.5
io.nettyio.netty nettynetty 3.9.9.Final3.9.9.Final
io.nettyio.netty netty-allnetty-all 4.1.17.Final4.1.17.Final
io.prometheusio.prometheus simpleclientsimpleclient 0.0.160.0.16
io.prometheusio.prometheus simpleclient_commonsimpleclient_common 0.0.160.0.16
io.prometheusio.prometheus simpleclient_dropwizardsimpleclient_dropwizard 0.0.160.0.16
io.prometheusio.prometheus simpleclient_servletsimpleclient_servlet 0.0.160.0.16
io.prometheus.jmxio.prometheus.jmx 收集器collector 0.70.7
javax.activationjavax.activation activationactivation 1.1.11.1.1
javax.annotationjavax.annotation javax.annotation-apijavax.annotation-api 1.21.2
javax.eljavax.el javax.el-apijavax.el-api 2.2.42.2.4
javax.jdojavax.jdo jdo-apijdo-api 3.0.13.0.1
javax.servletjavax.servlet javax.servlet-apijavax.servlet-api 3.1.03.1.0
javax.servlet.jspjavax.servlet.jsp jsp-apijsp-api 2.12.1
javax.transactionjavax.transaction jtajta 1.11.1
javax.validationjavax.validation validation-apivalidation-api 1.1.0.Final1.1.0.Final
javax.ws.rsjavax.ws.rs javax.ws.rs-apijavax.ws.rs-api 2.0.12.0.1
javax.xml.bindjavax.xml.bind jaxb-apijaxb-api 2.2.22.2.2
javax.xml.streamjavax.xml.stream stax-apistax-api 1.0-21.0-2
javolutionjavolution javolutionjavolution 5.5.15.5.1
jlinejline jlinejline 2.112.11
joda-timejoda-time joda-timejoda-time 2.9.32.9.3
log4jlog4j apache-log4j-extrasapache-log4j-extras 1.2.171.2.17
log4jlog4j log4jlog4j 1.2.171.2.17
net.hydromaticnet.hydromatic eigenbase-propertieseigenbase-properties 1.1.51.1.5
net.ihardernet.iharder base64base64 2.3.82.3.8
net.java.dev.jets3tnet.java.dev.jets3t jets3tjets3t 0.9.40.9.4
net.razorvinenet.razorvine pyrolitepyrolite 4.134.13
net.sf.jpamnet.sf.jpam jpamjpam 1.11.1
net.sf.opencsvnet.sf.opencsv opencsvopencsv 2.32.3
net.sf.supercsvnet.sf.supercsv super-csvsuper-csv 2.2.02.2.0
net.snowflakenet.snowflake snowflake-jdbcsnowflake-jdbc 3.6.33.6.3
net.snowflakenet.snowflake spark-snowflake_2.11spark-snowflake_2.11 2.3.22.3.2
net.sourceforge.f2jnet.sourceforge.f2j arpack_combined_allarpack_combined_all 0.10.1
org.acpltorg.acplt oncrpconcrpc 1.0.71.0.7
org.antlrorg.antlr ST4ST4 4.0.44.0.4
org.antlrorg.antlr antlr-runtimeantlr-runtime 3.43.4
org.antlrorg.antlr antlr4-runtimeantlr4-runtime 4.74.7
org.antlrorg.antlr stringtemplatestringtemplate 3.2.13.2.1
org.apache.antorg.apache.ant antant 1.9.21.9.2
org.apache.antorg.apache.ant ant-jschant-jsch 1.9.21.9.2
org.apache.antorg.apache.ant ant-launcherant-launcher 1.9.21.9.2
org.apache.arroworg.apache.arrow arrow-formatarrow-format 0.8.00.8.0
org.apache.arroworg.apache.arrow arrow-memoryarrow-memory 0.8.00.8.0
org.apache.arroworg.apache.arrow arrow-vectorarrow-vector 0.8.00.8.0
org.apache.avroorg.apache.avro avroavro 1.7.71.7.7
org.apache.avroorg.apache.avro avro-ipcavro-ipc 1.7.71.7.7
org.apache.avroorg.apache.avro avro-ipc-testsavro-ipc-tests 1.7.71.7.7
org.apache.avroorg.apache.avro avro-mapred-hadoop2avro-mapred-hadoop2 1.7.71.7.7
org.apache.calciteorg.apache.calcite calcite-avaticacalcite-avatica 1.2.0-incubating1.2.0-incubating
org.apache.calciteorg.apache.calcite calcite-corecalcite-core 1.2.0-incubating1.2.0-incubating
org.apache.calciteorg.apache.calcite calcite-linq4jcalcite-linq4j 1.2.0-incubating1.2.0-incubating
org.apache.commonsorg.apache.commons commons-compresscommons-compress 1.4.11.4.1
org.apache.commonsorg.apache.commons commons-cryptocommons-crypto 1.0.01.0.0
org.apache.commonsorg.apache.commons commons-lang3commons-lang3 3.53.5
org.apache.commonsorg.apache.commons commons-math3commons-math3 3.4.13.4.1
org.apache.curatororg.apache.curator curator-clientcurator-client 2.7.12.7.1
org.apache.curatororg.apache.curator curator-frameworkcurator-framework 2.7.12.7.1
org.apache.curatororg.apache.curator curator-recipescurator-recipes 2.7.12.7.1
org.apache.derbyorg.apache.derby derbyderby 10.12.1.110.12.1.1
org.apache.directory.apiorg.apache.directory.api api-asn1-apiapi-asn1-api 1.0.0-M201.0.0-M20
org.apache.directory.apiorg.apache.directory.api api-utilapi-util 1.0.0-M201.0.0-M20
org.apache.directory.serverorg.apache.directory.server apacheds-i18napacheds-i18n 2.0.0-M152.0.0-M15
org.apache.directory.serverorg.apache.directory.server apacheds-kerberos-codecapacheds-kerberos-codec 2.0.0-M152.0.0-M15
org.apache.hadooporg.apache.hadoop hadoop-annotationshadoop-annotations 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-authhadoop-auth 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-clienthadoop-client 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-commonhadoop-common 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-hdfshadoop-hdfs 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-mapreduce-client-apphadoop-mapreduce-client-app 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-mapreduce-client-commonhadoop-mapreduce-client-common 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-mapreduce-client-corehadoop-mapreduce-client-core 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-mapreduce-client-jobclienthadoop-mapreduce-client-jobclient 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-mapreduce-client-shufflehadoop-mapreduce-client-shuffle 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-yarn-apihadoop-yarn-api 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-yarn-clienthadoop-yarn-client 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-yarn-commonhadoop-yarn-common 2.7.32.7.3
org.apache.hadooporg.apache.hadoop hadoop-yarn-server-commonhadoop-yarn-server-common 2.7.32.7.3
org.apache.htraceorg.apache.htrace htrace-corehtrace-core 3.1.0-incubating3.1.0-incubating
org.apache.httpcomponentsorg.apache.httpcomponents httpclienthttpclient 4.5.44.5.4
org.apache.httpcomponentsorg.apache.httpcomponents httpcorehttpcore 4.4.84.4.8
org.apache.ivyorg.apache.ivy ivyivy 2.4.02.4.0
org.apache.orcorg.apache.orc orc-core-nohiveorc-core-nohive 1.4.31.4.3
org.apache.orcorg.apache.orc orc-mapreduce-nohiveorc-mapreduce-nohive 1.4.31.4.3
org.apache.parquetorg.apache.parquet parquet-columnparquet-column 1.8.3-databricks21.8.3-databricks2
org.apache.parquetorg.apache.parquet parquet-commonparquet-common 1.8.3-databricks21.8.3-databricks2
org.apache.parquetorg.apache.parquet parquet-encodingparquet-encoding 1.8.3-databricks21.8.3-databricks2
org.apache.parquetorg.apache.parquet parquet-formatparquet-format 2.3.12.3.1
org.apache.parquetorg.apache.parquet parquet-hadoopparquet-hadoop 1.8.3-databricks21.8.3-databricks2
org.apache.parquetorg.apache.parquet parquet-jacksonparquet-jackson 1.8.3-databricks21.8.3-databricks2
org.apache.thriftorg.apache.thrift libfb303libfb303 0.9.30.9.3
org.apache.thriftorg.apache.thrift libthriftlibthrift 0.9.30.9.3
org.apache.xbeanorg.apache.xbean xbean-asm5-shadedxbean-asm5-shaded 4.44.4
org.apache.zookeeperorg.apache.zookeeper zookeeperzookeeper 3.4.63.4.6
org.bouncycastleorg.bouncycastle bcprov-jdk15onbcprov-jdk15on 1.581.58
org.codehaus.jacksonorg.codehaus.jackson jackson-core-asljackson-core-asl 1.9.131.9.13
org.codehaus.jacksonorg.codehaus.jackson jackson-jaxrsjackson-jaxrs 1.9.131.9.13
org.codehaus.jacksonorg.codehaus.jackson jackson-mapper-asljackson-mapper-asl 1.9.131.9.13
org.codehaus.jacksonorg.codehaus.jackson jackson-xcjackson-xc 1.9.131.9.13
org.codehaus.janinoorg.codehaus.janino commons-compilercommons-compiler 3.0.83.0.8
org.codehaus.janinoorg.codehaus.janino janinojanino 3.0.83.0.8
org.datanucleusorg.datanucleus datanucleus-api-jdodatanucleus-api-jdo 3.2.63.2.6
org.datanucleusorg.datanucleus datanucleus-coredatanucleus-core 3.2.103.2.10
org.datanucleusorg.datanucleus datanucleus-rdbmsdatanucleus-rdbms 3.2.93.2.9
org.eclipse.jettyorg.eclipse.jetty jetty-clientjetty-client 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-continuationjetty-continuation 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-httpjetty-http 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-iojetty-io 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-jndijetty-jndi 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-plusjetty-plus 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-proxyjetty-proxy 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-securityjetty-security 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-serverjetty-server 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-servletjetty-servlet 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-servletsjetty-servlets 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-utiljetty-util 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-webappjetty-webapp 9.3.20.v201705319.3.20.v20170531
org.eclipse.jettyorg.eclipse.jetty jetty-xmljetty-xml 9.3.20.v201705319.3.20.v20170531
org.fusesource.leveldbjniorg.fusesource.leveldbjni leveldbjni-allleveldbjni-all 1.81.8
org.glassfish.hk2org.glassfish.hk2 hk2-apihk2-api 2.4.0-b342.4.0-b34
org.glassfish.hk2org.glassfish.hk2 hk2-locatorhk2-locator 2.4.0-b342.4.0-b34
org.glassfish.hk2org.glassfish.hk2 hk2-utilshk2-utils 2.4.0-b342.4.0-b34
org.glassfish.hk2org.glassfish.hk2 osgi-resource-locatorosgi-resource-locator 1.0.11.0.1
org.glassfish.hk2.externalorg.glassfish.hk2.external aopalliance-repackagedaopalliance-repackaged 2.4.0-b342.4.0-b34
org.glassfish.hk2.externalorg.glassfish.hk2.external javax.injectjavax.inject 2.4.0-b342.4.0-b34
org.glassfish.jersey.bundles.repackagedorg.glassfish.jersey.bundles.repackaged jersey-guavajersey-guava 2.22.22.22.2
org.glassfish.jersey.containersorg.glassfish.jersey.containers jersey-container-servletjersey-container-servlet 2.22.22.22.2
org.glassfish.jersey.containersorg.glassfish.jersey.containers jersey-container-servlet-corejersey-container-servlet-core 2.22.22.22.2
org.glassfish.jersey.coreorg.glassfish.jersey.core jersey-clientjersey-client 2.22.22.22.2
org.glassfish.jersey.coreorg.glassfish.jersey.core jersey-commonjersey-common 2.22.22.22.2
org.glassfish.jersey.coreorg.glassfish.jersey.core jersey-serverjersey-server 2.22.22.22.2
org.glassfish.jersey.mediaorg.glassfish.jersey.media jersey-media-jaxbjersey-media-jaxb 2.22.22.22.2
org.hibernateorg.hibernate hibernate-validatorhibernate-validator 5.1.1.Final5.1.1.Final
org.iq80.snappyorg.iq80.snappy snappysnappy 0.20.2
org.javassistorg.javassist javassistjavassist 3.18.1-GA3.18.1-GA
org.jboss.loggingorg.jboss.logging jboss-loggingjboss-logging 3.1.3.GA3.1.3.GA
org.jdbiorg.jdbi jdbijdbi 2.63.12.63.1
org.jodaorg.joda joda-convertjoda-convert 1.71.7
org.joddorg.jodd jodd-corejodd-core 3.5.23.5.2
org.json4sorg.json4s json4s-ast_2.11json4s-ast_2.11 3.2.113.2.11
org.json4sorg.json4s json4s-core_2.11json4s-core_2.11 3.2.113.2.11
org.json4sorg.json4s json4s-jackson_2.11json4s-jackson_2.11 3.2.113.2.11
org.lz4org.lz4 lz4-javalz4-java 1.4.01.4.0
org.mariadb.jdbcorg.mariadb.jdbc mariadb-java-clientmariadb-java-client 2.1.22.1.2
org.mockitoorg.mockito mockito-allmockito-all 1.9.51.9.5
org.objenesisorg.objenesis objenesisobjenesis 2.12.1
org.postgresqlorg.postgresql postgresqlpostgresql 42.1.442.1.4
org.roaringbitmaporg.roaringbitmap RoaringBitmapRoaringBitmap 0.5.110.5.11
org.rocksdborg.rocksdb rocksdbjnirocksdbjni 5.2.15.2.1
org.rosuda.REngineorg.rosuda.REngine REngineREngine 2.1.02.1.0
org.scala-langorg.scala-lang scala-compiler_2.11scala-compiler_2.11 2.11.82.11.8
org.scala-langorg.scala-lang scala-library_2.11scala-library_2.11 2.11.82.11.8
org.scala-langorg.scala-lang scala-reflect_2.11scala-reflect_2.11 2.11.82.11.8
org.scala-langorg.scala-lang scalap_2.11scalap_2.11 2.11.82.11.8
org.scala-lang.modulesorg.scala-lang.modules scala-parser-combinators_2.11scala-parser-combinators_2.11 1.0.21.0.2
org.scala-lang.modulesorg.scala-lang.modules scala-xml_2.11scala-xml_2.11 1.0.51.0.5
org.scala-sbtorg.scala-sbt test-interfacetest-interface 1.01.0
org.scalacheckorg.scalacheck scalacheck_2.11scalacheck_2.11 1.12.51.12.5
org.scalanlporg.scalanlp breeze-macros_2.11breeze-macros_2.11 0.13.20.13.2
org.scalanlporg.scalanlp breeze_2.11breeze_2.11 0.13.20.13.2
org.scalatestorg.scalatest scalatest_2.11scalatest_2.11 2.2.62.2.6
org.slf4jorg.slf4j jcl-over-slf4jjcl-over-slf4j 1.7.161.7.16
org.slf4jorg.slf4j jul-to-slf4jjul-to-slf4j 1.7.161.7.16
org.slf4jorg.slf4j slf4j-apislf4j-api 1.7.161.7.16
org.slf4jorg.slf4j slf4j-log4j12slf4j-log4j12 1.7.161.7.16
org.spark-project.hiveorg.spark-project.hive hive-beelinehive-beeline 1.2.1.spark21.2.1.spark2
org.spark-project.hiveorg.spark-project.hive hive-clihive-cli 1.2.1.spark21.2.1.spark2
org.spark-project.hiveorg.spark-project.hive hive-exechive-exec 1.2.1.spark21.2.1.spark2
org.spark-project.hiveorg.spark-project.hive hive-jdbchive-jdbc 1.2.1.spark21.2.1.spark2
org.spark-project.hiveorg.spark-project.hive hive-metastorehive-metastore 1.2.1.spark21.2.1.spark2
org.spark-project.sparkorg.spark-project.spark unusedunused 1.0.01.0.0
org.spire-mathorg.spire-math spire-macros_2.11spire-macros_2.11 0.13.00.13.0
org.spire-mathorg.spire-math spire_2.11spire_2.11 0.13.00.13.0
org.springframeworkorg.springframework spring-corespring-core 4.1.4.RELEASE4.1.4.RELEASE
org.springframeworkorg.springframework spring-testspring-test 4.1.4.RELEASE4.1.4.RELEASE
org.tukaaniorg.tukaani xzxz 1.01.0
org.typelevelorg.typelevel machinist_2.11machinist_2.11 0.6.10.6.1
org.typelevelorg.typelevel macro-compat_2.11macro-compat_2.11 1.1.11.1.1
org.xerialorg.xerial sqlite-jdbcsqlite-jdbc 3.8.11.23.8.11.2
org.xerial.snappyorg.xerial.snappy snappy-javasnappy-java 1.1.2.61.1.2.6
org.yamlorg.yaml snakeyamlsnakeyaml 1.161.16
orooro orooro 2.0.82.0.8
software.amazon.ionsoftware.amazon.ion ion-javaion-java 1.0.21.0.2
staxstax stax-apistax-api 1.0.11.0.1
xmlencxmlenc xmlencxmlenc 0.520.52