Databricks Runtime 15.3
The following release notes provide information about Databricks Runtime 15.3, powered by Apache Spark 3.5.0.
Databricks released these images in June 2024.
New features and improvements
PySpark DataSources now support stream reading and writing
PySpark DataSources, which enable reading from custom data sources and writing to custom data sinks, now support stream reading and writing. See PySpark custom data sources.
Disable column mapping with drop feature
You can now use DROP FEATURE
to disable column mapping on Delta tables and downgrade the table protocol. See Disable column mapping.
Variant type syntax and functions in Public Preview
Native Apache Spark support for working with semi-structured data as VARIANT
type is now available in Spark DataFrames and SQL. See Query variant data.
Variant type support for Delta Lake in Public Preview
You can now use VARIANT
to store semi-structured data in tables backed by Delta Lake. See Variant support in Delta Lake.
Support for different modes of schema evolution in views
CREATE VIEW and ALTER VIEW now allows you to set a schema binding mode, enhancing how views handle schema changes in underlying objects. This feature enables views to either tolerate or adapt to schema changes in the underlying objects. It addresses changes in the query schema resulting from modifications to object definitions.
Support for observe()
methods added to the Spark Connect Scala client
The Spark Connect Scala client now supports the Dataset.observe()
methods. Support for these methods allows you to define metrics to observe on a Dataset
object using the ds.observe("name", metrics...)
or ds.observe(observationObject, metrics...)
methods.
Improved stream restart latency for Auto Loader
This release includes a change that improves the stream restart latency for Auto Loader. This improvement is implemented by making the loading of state by the RocksDB state store asynchronous. With this change, you should see an improvement in start times for streams with large states, for example, streams with a large number of already ingested files.
Return a DataFrame as a pyarrow.Table
To support writing a DataFrame directly to an Apache Arrow pyarrow.Table
object, this release includes the DataFrame.toArrow()
function. To learn more about using Arrow in PySpark, see Apache Arrow in PySpark.
Performance improvement for some window functions
This release includes a change that improves the performance of some Spark window functions, specifically functions that do not include an ORDER BY
clause or a window_frame
parameter. In these cases, the system can rewrite the query to run it using an aggregate function. This change allows the query to run faster by using partial aggregation and avoiding the overhead of running window functions. The Spark configuration parameter spark.databricks.optimizer.replaceWindowsWithAggregates.enabled
controls this optimization and is set to true
by default. To turn this optimization off, set spark.databricks.optimizer.replaceWindowsWithAggregates.enabled
to false
.
Support for the try_mod
function added
This release adds support for the PySpark try_mod()
function. This function supports the ANSI SQL-compatible calculation of the integer remainder from dividing two numeric values. If the divisor argument is 0, the try_mod()
function returns null instead of throwing an exception. You can use the try_mod()
function instead of mod
or %
, which throw an exception if the divisor argument is 0 and ANSI SQL is enabled.
Support for an optional scope parameter in the list_secrets()
This release allows you to limit the results of the list_secrets() table function to a specific scope.
Bug fixes
WriteIntoDeltaCommand
metrics in the Spark UI now display correctly
This release includes a fix to the metrics displayed in the SQL tab of the Spark UI for the Execute WriteIntoDeltaCommand
node. Previously, the metrics shown for this node were all zero.
The groupby()
function in the Pandas API ignored the as_index=False
argument
This release includes a fix for an issue with the groupby()
function in the Pandas API on Spark. Before this fix, a groupby()
with relabeling of aggregate columns and the as_index=False
argument did not include group keys in the resulting DataFrame.
Parsing error with multiple window functions that reference output from the other functions
This release fixes an issue that might occur when a Spark query has multiple consecutive window functions, where the window functions reference output from the other window functions. In rare cases, the system might drop one of the references, leading to errors in evaluating the query. This fix projects these references to ensure query evaluation. This change is controlled by the Spark configuration parameter spark.databricks.optimizer.collapseWindows.projectReferences
, which is set to true
by default. To turn off this change, set spark.databricks.optimizer.collapseWindows.projectReferences
to false
.
Library upgrades
- Upgraded Python libraries:
- filelock from 3.13.1 to 3.13.4
- Upgraded R libraries:
- Upgraded Java libraries:
- org.rocksdb.rocksdbjni from 8.3.2 to 8.11.4
Apache Spark
Databricks Runtime 15.3 includes Apache Spark 3.5.0. This release includes all Spark fixes and improvements included in Databricks Runtime 15.2, as well as the following additional bug fixes and improvements made to Spark:
- [SPARK-48288] [SC-166141] Add source data type for connector cast expression
- [SPARK-48175] [SC-166341][SQL][PYTHON] Store collation information in metadata and not in type for SER/DE
- [SPARK-48172] [SC-166078][SQL] Fix escaping issues in JDBCDialects
- [SPARK-48186] [SC-165544][SQL] Add support for AbstractMapType
- [SPARK-48031] [SC-166523] Grandfather legacy views to SCHEMA BINDING
- [SPARK-48369] [SC-166566][SQL][PYTHON][CONNECT] Add function
timestamp_add
- [SPARK-48330] [SC-166458][SS][PYTHON] Fix the python streaming data source timeout issue for large trigger interval
- [SPARK-48369] Revert "[SC-166494][SQL][PYTHON][CONNECT] Add function
timestamp_add
" - [SPARK-48336] [SC-166495][PS][CONNECT] Implement
ps.sql
in Spark Connect - [SPARK-48369] [SC-166494][SQL][PYTHON][CONNECT] Add function
timestamp_add
- [SPARK-47354] [SC-165546][SQL] Add collation support for variant expressions
- [SPARK-48161] [SC-165325][SQL] Fix reverted PR - Add collation support for JSON expressions
- [SPARK-48031] [SC-166391] Decompose viewSchemaMode config, add SHOW CREATE TABLE support
- [SPARK-48268] [SC-166217][CORE] Add a configuration for SparkContext.setCheckpointDir
- [SPARK-48312] [ES-1076198][SQL] Improve Alias.removeNonInheritableMetadata performance
- [SPARK-48294] [SC-166205][SQL] Handle lowercase in nestedTypeMissingElementTypeError
- [SPARK-47254] [SC-158847][SQL] Assign names to the error classes _LEGACY_ERROR_TEMP_325[1-9]
- [SPARK-47255] [SC-158749][SQL] Assign names to the error classes _LEGACY_ERROR_TEMP_323[6-7] and _LEGACY_ERROR_TEMP_324[7-9]
- [SPARK-48310] [SC-166239][PYTHON][CONNECT] Cached properties must return copies
- [SPARK-48308] [SC-166152][Core] Unify getting data schema without partition columns in FileSourceStrategy
- [SPARK-48301] [SC-166143][SQL] Rename
CREATE_FUNC_WITH_IF_NOT_EXISTS_AND_REPLACE
toCREATE_ROUTINE_WITH_IF_NOT_EXISTS_AND_REPLACE
- [SPARK-48287] [SC-166139][PS][CONNECT] Apply the builtin
timestamp_diff
method - [SPARK-47607] [SC-166129] Add documentation for Structured logging framework
- [SPARK-48297] [SC-166136][SQL] Fix a regression TRANSFORM clause with char/varchar
- [SPARK-47045] [SC-156808][SQL] Replace
IllegalArgumentException
bySparkIllegalArgumentException
insql/api
- [SPARK-46991] [SC-156399][SQL] Replace
IllegalArgumentException
bySparkIllegalArgumentException
incatalyst
- [SPARK-48031] [SC-165805][SQL] Support view schema evolution
- [SPARK-48276] [SC-166116][PYTHON][CONNECT] Add the missing
__repr__
method forSQLExpression
- [SPARK-48278] [SC-166071][PYTHON][CONNECT] Refine the string representation of
Cast
- [SPARK-48272] [SC-166069][SQL][PYTHON][CONNECT] Add function
timestamp_diff
- [SPARK-47798] [SC-162492][SQL] Enrich the error message for the reading failures of decimal values
- [SPARK-47158] [SC-158078][SQL] Assign proper name and
sqlState
to_LEGACY_ERROR_TEMP_(2134|2231)
- [SPARK-48218] [SC-166082][CORE] TransportClientFactory.createClient may NPE cause FetchFailedException
- [SPARK-48277] [SC-166066] Improve error message for ErrorClassesJsonReader.getErrorMessage
- [SPARK-47545] [SC-165444][CONNECT] Dataset
observe
support for the Scala client - [SPARK-48954] [SC-171672][SQL] Add
try_mod
function - [SPARK-43258] [SC-158151][SQL] Assign names to error _LEGACY_ERROR_TEMP_202[3,5]
- [SPARK-48267] [SC-165903][SS] Regression e2e test with SPARK-47305
- [SPARK-48263] [SC-165925] Collate function support for non UTF8_BINARY strings
- [SPARK-48260] [SC-165883][SQL] Disable output committer coordination in one test of ParquetIOSuite
- [SPARK-47834] [SC-165645][SQL][CONNECT] Mark deprecated functions with
@deprecated
inSQLImplicits
- [SPARK-48011] [SC-164061][Core] Store LogKey name as a value to avoid generating new string instances
- [SPARK-48074] [SC-164647][Core] Improve the readability of JSON loggings
- [SPARK-44953] [SC-165866][CORE] Log a warning when shuffle tracking is enabled along side another DA supported mechanism
- [SPARK-48266] [SC-165897][CONNECT] Move package object
org.apache.spark.sql.connect.dsl
to test directory - [SPARK-47847] [SC-165651][CORE] Deprecate
spark.network.remoteReadNioBufferConversion
- [SPARK-48171] [SC-165178][CORE] Clean up the use of deprecated constructors of
o.rocksdb.Logger
- [SPARK-48235] [SC-165669][SQL] Directly pass join instead of all arguments to getBroadcastBuildSide and getShuffleHashJoinBuildSide
- [SPARK-48224] [SC-165648][SQL] Disallow map keys from being of variant type
- [SPARK-48248] [SC-165791][PYTHON] Fix nested array to respect legacy conf of inferArrayTypeFromFirstElement
- [SPARK-47409] [SC-165568][SQL] Add support for collation for StringTrim type of functions/expressions (for UTF8_BINARY & LCASE)
- [SPARK-48143] [ES-1095638][SQL] Use lightweight exceptions for control-flow between UnivocityParser and FailureSafeParser
- [SPARK-48146] [SC-165668][SQL] Fix aggregate function in With expression child assertion
- [SPARK-48161] Revert "[SC-165325][SQL] Add collation support for JSON expressions"
- [SPARK-47963] [CORE] Make the external Spark ecosystem can use structured logging mechanisms
- [SPARK-48180] [SC-165632][SQL] Improve error when UDTF call with TABLE arg forgets parentheses around multiple PARTITION/ORDER BY exprs
- [SPARK-48002] [SC-164132][PYTHON][SS] Add test for observed metrics in PySpark StreamingQueryListener
- [SPARK-47421] [SC-165548][SQL] Add collation support for URL expressions
- [SPARK-48161] [SC-165325][SQL] Add collation support for JSON expressions
- [SPARK-47359] [SC-164328][SQL] Support TRANSLATE function to work with collated strings
- [SPARK-47365] [SC-165643][PYTHON] Add toArrow() DataFrame method to PySpark
- [SPARK-48228] [SC-165649][PYTHON][CONNECT] Implement the missing function validation in ApplyInXXX
- [SPARK-47986] [SC-165549][CONNECT][PYTHON] Unable to create a new session when the default session is closed by the server
- [SPARK-47963] Revert "[CORE] Make the external Spark ecosystem can use structured logging mechanisms "
- [SPARK-47963] [CORE] Make the external Spark ecosystem can use structured logging mechanisms
- [SPARK-48208] [SC-165547][SS] Skip providing memory usage metrics from RocksDB if bounded memory usage is enabled
- [SPARK-47566] [SC-164314][SQL] Support SubstringIndex function to work with collated strings
- [SPARK-47589] [SC-162127][SQL]Hive-Thriftserver: Migrate logError with variables to structured logging framework
- [SPARK-48205] [SC-165501][PYTHON] Remove the private[sql] modifier for Python data sources
- [SPARK-48173] [SC-165181][SQL] CheckAnalysis should see the entire query plan
- [SPARK-48197] [SC-165520][SQL] Avoid assert error for invalid lambda function
- [SPARK-47318] [SC-162573][CORE] Adds HKDF round to AuthEngine key derivation to follow standard KEX practices
- [SPARK-48184] [SC-165335][PYTHON][CONNECT] Always set the seed of
Dataframe.sample
in Client side - [SPARK-48128] [SC-165004][SQL] For BitwiseCount / bit_count expression, fix codegen syntax error for boolean type inputs
- [SPARK-48147] [SC-165144][SS][CONNECT] Remove client side listeners when local Spark session is deleted
- [SPARK-48045] [SC-165299][PYTHON] Pandas API groupby with multi-agg-relabel ignores as_index=False
- [SPARK-48191] [SC-165323][SQL] Support UTF-32 for string encode and decode
- [SPARK-45352] [SC-137627][SQL] Eliminate foldable window partitions
- [SPARK-47297] [SC-165179][SQL] Add collation support for format expressions
- [SPARK-47267] [SC-165170][SQL] Add collation support for hash expressions
- [SPARK-47965] [SC-163822][CORE] Avoid orNull in TypedConfigBuilder and OptionalConfigEntry
- [SPARK-48166] [SQL] Avoid using BadRecordException as user-facing error in VariantExpressionEvalUtils
- [SPARK-48105] [SC-165132][SS] Fix the race condition between state store unloading and snapshotting
- [SPARK-47922] [SC-163997][SQL] Implement the try_parse_json expression
- [SPARK-47719] [SC-161909][SQL] Change spark.sql.legacy.timeParse…
- [SPARK-48035] [SC-165136][SQL] Fix try_add/try_multiply being semantic equal to add/multiply
- [SPARK-48107] [SC-164878][PYTHON] Exclude tests from Python distribution
- [SPARK-46894] [SC-164447][PYTHON] Move PySpark error conditions into standalone JSON file
- [SPARK-47583] [SC-163825][CORE] SQL core: Migrate logError with variables to structured logging framework
- [SPARK-48064] Revert "[SC-164697][SQL] Update error messages for routine related error classes"
- [SPARK-48048] [SC-164846][CONNECT][SS] Added client side listener support for Scala
- [SPARK-48064] [SC-164697][SQL] Update error messages for routine related error classes
- [SPARK-48056] [SC-164715][CONNECT][PYTHON] Re-execute plan if a SESSION_NOT_FOUND error is raised and no partial response was received
- [SPARK-48124] [SC-165009][CORE] Disable structured logging for Connect-Repl by default
- [SPARK-47922] Revert "[SC-163997][SQL] Implement the try_parse_json expression"
- [SPARK-48065] [SC-164817][SQL] SPJ: allowJoinKeysSubsetOfPartitionKeys is too strict
- [SPARK-48114] [SC-164956][CORE] Precompile template regex to avoid unnecessary work
- [SPARK-48067] [SC-164773][SQL] Fix variant default columns
- [SPARK-47922] [SC-163997][SQL] Implement the try_parse_json expression
- [SPARK-48075] [SC-164709] [SS] Add type checking for PySpark avro functions
- [SPARK-47793] [SC-164324][SS][PYTHON] Implement SimpleDataSourceStreamReader for python streaming data source
- [SPARK-48081] [SC-164719] Fix ClassCastException in NTile.checkInputDataTypes() when argument is non-foldable or of wrong type
- [SPARK-48102] [SC-164853][SS] Track duration for acquiring source/sink metrics while reporting streaming query progress
- [SPARK-47671] [SC-164854][Core] Enable structured logging in log4j2.properties.template and update docs
- [SPARK-47904] [SC-163409][SQL] Preserve case in Avro schema when using enableStableIdentifiersForUnionType
- [SPARK-48058] [SC-164695][SPARK-43727][PYTHON][CONNECT]
UserDefinedFunction.returnType
parse the DDL string - [SPARK-46922] [SC-156102][CORE][SQL] Do not wrap runtime user-facing errors
- [SPARK-48047] [SC-164576][SQL] Reduce memory pressure of empty TreeNode tags
- [SPARK-47934] [SC-164648] [CORE] Ensure trailing slashes in
HistoryServer
URL redirections - [SPARK-47921] [SC-163826][CONNECT] Fix ExecuteJobTag creation in ExecuteHolder
- [SPARK-48014] [SC-164150][SQL] Change the makeFromJava error in EvaluatePython to a user-facing error
- [SPARK-47903] [SC-163424][PYTHON] Add support for remaining scalar types in the PySpark Variant library
- [SPARK-48068] [SC-164579][PYTHON]
mypy
should have--python-executable
parameter - [SPARK-47846] [SC-163074][SQL] Add support for Variant type in from_json expression
- [SPARK-48050] [SC-164322][SS] Log logical plan at query start
- [SPARK-47810] [SC-163076][SQL] Replace equivalent expression to <=> in join condition
- [SPARK-47741] [SC-164290] Added stack overflow handling in parser
- [SPARK-48053] [SC-164309][PYTHON][CONNECT] SparkSession.createDataFrame should warn for unsupported options
- [SPARK-47939] [SC-164171][SQL] Implement a new Analyzer rule to move ParameterizedQuery inside ExplainCommand and DescribeQueryCommand
- [SPARK-48063] [SC-164432][CORE] Enable
spark.stage.ignoreDecommissionFetchFailure
by default - [SPARK-48016] [SC-164280][SQL] Fix a bug in try_divide function when with decimals
- [SPARK-48033] [SC-164291][SQL] Fix
RuntimeReplaceable
expressions being used in default columns - [SPARK-48010] [SC-164051][SQL][ES-1109148] Avoid repeated calls to conf.resolver in resolveExpression
- [SPARK-48003] [SC-164323][SQL] Add collation support for hll sketch aggregate
- [SPARK-47994] [SC-164175][SQL] Fix bug with CASE WHEN column filter push down in SQLServer
- [SPARK-47984] [SC-163837][ML][SQL] Change
MetricsAggregate/V2Aggregator#serialize/deserialize
to callSparkSerDeUtils#serialize/deserialize
- [SPARK-48042] [SC-164202][SQL] Use a timestamp formatter with timezone at class level instead of making copies at method level
- [SPARK-47596] [SPARK-47600][SPARK-47604][SPARK-47804] Structured log migrations
- [SPARK-47594] [SPARK-47590][SPARK-47588][SPARK-47584] Structured log migrations
- [SPARK-47567] [SC-164172][SQL] Support LOCATE function to work with collated strings
- [SPARK-47764] [SC-163820][CORE][SQL] Cleanup shuffle dependencies based on ShuffleCleanupMode
- [SPARK-48039] [SC-164174][PYTHON][CONNECT] Update the error class for
group.apply
- [SPARK-47414] [SC-163831][SQL] Lowercase collation support for regexp expressions
- [SPARK-47418] [SC-163818][SQL] Add hand-crafted implementations for lowercase unicode-aware contains, startsWith and endsWith and optimize UTF8_BINARY_LCASE
- [SPARK-47580] [SC-163834][SQL] SQL catalyst: eliminate unnamed variables in error logs
- [SPARK-47351] [SC-164008][SQL] Add collation support for StringToMap & Mask string expressions
- [SPARK-47292] [SC-164151][SS] safeMapToJValue should consider null typed values
- [SPARK-47476] [SC-164014][SQL] Support REPLACE function to work with collated strings
- [SPARK-47408] [SC-164104][SQL] Fix mathExpressions that use StringType
- [SPARK-47350] [SC-164006][SQL] Add collation support for SplitPart string expression
- [SPARK-47692] [SC-163819][SQL] Fix default StringType meaning in implicit casting
- [SPARK-47094] [SC-161957][SQL] SPJ : Dynamically rebalance number of buckets when they are not equal
- [SPARK-48001] [SC-164000][CORE] Remove unused
private implicit def arrayToArrayWritable
fromSparkContext
- [SPARK-47986] [SC-163999][CONNECT][PYTHON] Unable to create a new session when the default session is closed by the server
- [SPARK-48019] [SC-164121] Fix incorrect behavior in ColumnVector/ColumnarArray with dictionary and nulls
- [SPARK-47743] [SPARK-47592][SPARK-47589][SPARK-47581][SPARK-47586][SPARK-47593][SPARK-47595][SPARK-47587][SPARK-47603] Structured log migrations
- [SPARK-47999] [SC-163998][SS] Improve logging around snapshot creation and adding/removing entries from state cache map in HDFS backed state store provider
- [SPARK-47417] [SC-162872][SQL] Collation support: Ascii, Chr, Base64, UnBase64, Decode, StringDecode, Encode, ToBinary, FormatNumber, Sentences
- [SPARK-47712] [SC-161871][CONNECT] Allow connect plugins to create and process Datasets
- [SPARK-47411] [SC-163351][SQL] Support StringInstr & FindInSet functions to work with collated strings
- [SPARK-47360] [SC-163014][SQL] Collation support: Overlay, FormatString, Length, BitLength, OctetLength, SoundEx, Luhncheck
- [SPARK-47413] [SC-163323][SQL] - add support to substr/left/right for collations
- [SPARK-47983] [SC-163835][SQL] Demote spark.sql.pyspark.legacy.inferArrayTypeFromFirstElement.enabled to internal
- [SPARK-47964] [SC-163816][PYTHON][CONNECT] Hide SQLContext and HiveContext in pyspark-connect
- [SPARK-47985] [SC-163841][PYTHON] Simplify functions with
lit
- [SPARK-47633] [SC-163453][SQL] Include right-side plan output in
LateralJoin#allAttributes
for more consistent canonicalization - [SPARK-47909] Revert "[PYTHON][CONNECT] Parent DataFrame class f…
- [SPARK-47767] [SC-163096][SQL] Show offset value in TakeOrderedAndProjectExec
- [SPARK-47822] [SC-162968][SQL] Prohibit Hash Expressions from hashing the Variant Data Type
- [SPARK-47490] [SC-160494][SS] Fix RocksDB Logger constructor use to avoid deprecation warning
- [SPARK-47417] Revert "[SC-162872][SQL] Collation support: Ascii, Chr, Base64, UnBase64, Decode, StringDecode, Encode, ToBinary, FormatNumber, Sentences"
- [SPARK-47352] [SC-163460][SQL] Fix Upper, Lower, InitCap collation awareness
- [SPARK-47909] [PYTHON][CONNECT] Parent DataFrame class for Spark Connect and Spark Classic
- [SPARK-47417] [SC-162872][SQL] Collation support: Ascii, Chr, Base64, UnBase64, Decode, StringDecode, Encode, ToBinary, FormatNumber, Sentences
Databricks ODBC/JDBC driver support
Databricks supports ODBC/JDBC drivers released in the past 2 years. Please download the recently released drivers and upgrade (download ODBC, download JDBC).
System environment
- Operating System: Ubuntu 22.04.4 LTS
- Java: Zulu 8.78.0.19-CA-linux64
- Scala: 2.12.18
- Python: 3.11.0
- R: 4.3.2
- Delta Lake: 3.2.0
Installed Python libraries
Library | Version | Library | Version | Library | Version |
---|---|---|---|---|---|
asttokens | 2.0.5 | astunparse | 1.6.3 | azure-core | 1.30.1 |
azure-storage-blob | 12.19.1 | azure-storage-file-datalake | 12.14.0 | backcall | 0.2.0 |
black | 23.3.0 | blinker | 1.4 | boto3 | 1.34.39 |
botocore | 1.34.39 | cachetools | 5.3.3 | certifi | 2023.7.22 |
cffi | 1.15.1 | chardet | 4.0.0 | charset-normalizer | 2.0.4 |
click | 8.0.4 | cloudpickle | 2.2.1 | comm | 0.1.2 |
contourpy | 1.0.5 | cryptography | 41.0.3 | cycler | 0.11.0 |
Cython | 0.29.32 | databricks-sdk | 0.20.0 | dbus-python | 1.2.18 |
debugpy | 1.6.7 | decorator | 5.1.1 | distlib | 0.3.8 |
entrypoints | 0.4 | executing | 0.8.3 | facets-overview | 1.1.1 |
filelock | 3.13.4 | fonttools | 4.25.0 | gitdb | 4.0.11 |
GitPython | 3.1.43 | google-api-core | 2.18.0 | google-auth | 2.29.0 |
google-cloud-core | 2.4.1 | google-cloud-storage | 2.16.0 | google-crc32c | 1.5.0 |
google-resumable-media | 2.7.0 | googleapis-common-protos | 1.63.0 | grpcio | 1.60.0 |
grpcio-status | 1.60.0 | httplib2 | 0.20.2 | idna | 3.4 |
importlib-metadata | 6.0.0 | ipyflow-core | 0.0.198 | ipykernel | 6.25.1 |
ipython | 8.15.0 | ipython-genutils | 0.2.0 | ipywidgets | 7.7.2 |
isodate | 0.6.1 | jedi | 0.18.1 | jeepney | 0.7.1 |
jmespath | 0.10.0 | joblib | 1.2.0 | jupyter_client | 7.4.9 |
jupyter_core | 5.3.0 | keyring | 23.5.0 | kiwisolver | 1.4.4 |
launchpadlib | 1.10.16 | lazr.restfulclient | 0.14.4 | lazr.uri | 1.0.6 |
matplotlib | 3.7.2 | matplotlib-inline | 0.1.6 | mlflow-skinny | 2.11.3 |
more-itertools | 8.10.0 | mypy-extensions | 0.4.3 | nest-asyncio | 1.5.6 |
numpy | 1.23.5 | oauthlib | 3.2.0 | packaging | 23.2 |
pandas | 1.5.3 | parso | 0.8.3 | pathspec | 0.10.3 |
patsy | 0.5.3 | pexpect | 4.8.0 | pickleshare | 0.7.5 |
Pillow | 9.4.0 | pip | 23.2.1 | platformdirs | 3.10.0 |
plotly | 5.9.0 | prompt-toolkit | 3.0.36 | proto-plus | 1.23.0 |
protobuf | 4.24.1 | psutil | 5.9.0 | psycopg2 | 2.9.3 |
ptyprocess | 0.7.0 | pure-eval | 0.2.2 | pyarrow | 14.0.1 |
pyasn1 | 0.4.8 | pyasn1-modules | 0.2.8 | pyccolo | 0.0.52 |
pycparser | 2.21 | pydantic | 1.10.6 | Pygments | 2.15.1 |
PyGObject | 3.42.1 | PyJWT | 2.3.0 | pyodbc | 4.0.38 |
pyparsing | 3.0.9 | python-dateutil | 2.8.2 | python-lsp-jsonrpc | 1.1.1 |
pytz | 2022.7 | PyYAML | 6.0 | pyzmq | 23.2.0 |
requests | 2.31.0 | rsa | 4.9 | s3transfer | 0.10.1 |
scikit-learn | 1.3.0 | scipy | 1.11.1 | seaborn | 0.12.2 |
SecretStorage | 3.3.1 | setuptools | 68.0.0 | six | 1.16.0 |
smmap | 5.0.1 | sqlparse | 0.5.0 | ssh-import-id | 5.11 |
stack-data | 0.2.0 | statsmodels | 0.14.0 | tenacity | 8.2.2 |
threadpoolctl | 2.2.0 | tokenize-rt | 4.2.1 | tornado | 6.3.2 |
traitlets | 5.7.1 | typing_extensions | 4.10.0 | tzdata | 2022.1 |
ujson | 5.4.0 | unattended-upgrades | 0.1 | urllib3 | 1.26.16 |
virtualenv | 20.24.2 | wadllib | 1.3.6 | wcwidth | 0.2.5 |
wheel | 0.38.4 | zipp | 3.11.0 |
Installed R libraries
R libraries are installed from the Posit Package Manager CRAN snapshot.
Library | Version | Library | Version | Library | Version |
---|---|---|---|---|---|
arrow | 14.0.0.2 | askpass | 1.2.0 | assertthat | 0.2.1 |
backports | 1.4.1 | base | 4.3.2 | base64enc | 0.1-3 |
bigD | 0.2.0 | bit | 4.0.5 | bit64 | 4.0.5 |
bitops | 1.0-7 | blob | 1.2.4 | boot | 1.3-28 |
brew | 1.0-10 | brio | 1.1.4 | broom | 1.0.5 |
bslib | 0.6.1 | cachem | 1.0.8 | callr | 3.7.3 |
caret | 6.0-94 | cellranger | 1.1.0 | chron | 2.3-61 |
class | 7.3-22 | cli | 3.6.2 | clipr | 0.8.0 |
clock | 0.7.0 | cluster | 2.1.4 | codetools | 0.2-19 |
colorspace | 2.1-0 | commonmark | 1.9.1 | compiler | 4.3.2 |
config | 0.3.2 | conflicted | 1.2.0 | cpp11 | 0.4.7 |
crayon | 1.5.2 | credentials | 2.0.1 | curl | 5.2.0 |
data.table | 1.15.0 | datasets | 4.3.2 | DBI | 1.2.1 |
dbplyr | 2.4.0 | desc | 1.4.3 | devtools | 2.4.5 |
diagram | 1.6.5 | diffobj | 0.3.5 | digest | 0.6.34 |
downlit | 0.4.3 | dplyr | 1.1.4 | dtplyr | 1.3.1 |
e1071 | 1.7-14 | ellipsis | 0.3.2 | evaluate | 0.23 |
fansi | 1.0.6 | farver | 2.1.1 | fastmap | 1.1.1 |
fontawesome | 0.5.2 | forcats | 1.0.0 | foreach | 1.5.2 |
foreign | 0.8-85 | forge | 0.2.0 | fs | 1.6.3 |
future | 1.33.1 | future.apply | 1.11.1 | gargle | 1.5.2 |
generics | 0.1.3 | gert | 2.0.1 | ggplot2 | 3.4.4 |
gh | 1.4.0 | git2r | 0.33.0 | gitcreds | 0.1.2 |
glmnet | 4.1-8 | globals | 0.16.2 | glue | 1.7.0 |
googledrive | 2.1.1 | googlesheets4 | 1.1.1 | gower | 1.0.1 |
graphics | 4.3.2 | grDevices | 4.3.2 | grid | 4.3.2 |
gridExtra | 2.3 | gsubfn | 0.7 | gt | 0.10.1 |
gtable | 0.3.4 | hardhat | 1.3.1 | haven | 2.5.4 |
highr | 0.10 | hms | 1.1.3 | htmltools | 0.5.7 |
htmlwidgets | 1.6.4 | httpuv | 1.6.14 | httr | 1.4.7 |
httr2 | 1.0.0 | ids | 1.0.1 | ini | 0.3.1 |
ipred | 0.9-14 | isoband | 0.2.7 | iterators | 1.0.14 |
jquerylib | 0.1.4 | jsonlite | 1.8.8 | juicyjuice | 0.1.0 |
KernSmooth | 2.23-21 | knitr | 1.45 | labeling | 0.4.3 |
later | 1.3.2 | lattice | 0.21-8 | lava | 1.7.3 |
lifecycle | 1.0.4 | listenv | 0.9.1 | lubridate | 1.9.3 |
magrittr | 2.0.3 | markdown | 1.12 | MASS | 7.3-60 |
Matrix | 1.5-4.1 | memoise | 2.0.1 | methods | 4.3.2 |
mgcv | 1.8-42 | mime | 0.12 | miniUI | 0.1.1.1 |
mlflow | 2.10.0 | ModelMetrics | 1.2.2.2 | modelr | 0.1.11 |
munsell | 0.5.0 | nlme | 3.1-163 | nnet | 7.3-19 |
numDeriv | 2016.8-1.1 | openssl | 2.1.1 | parallel | 4.3.2 |
parallelly | 1.36.0 | pillar | 1.9.0 | pkgbuild | 1.4.3 |
pkgconfig | 2.0.3 | pkgdown | 2.0.7 | pkgload | 1.3.4 |
plogr | 0.2.0 | plyr | 1.8.9 | praise | 1.0.0 |
prettyunits | 1.2.0 | pROC | 1.18.5 | processx | 3.8.3 |
prodlim | 2023.08.28 | profvis | 0.3.8 | progress | 1.2.3 |
progressr | 0.14.0 | promises | 1.2.1 | proto | 1.0.0 |
proxy | 0.4-27 | ps | 1.7.6 | purrr | 1.0.2 |
R6 | 2.5.1 | ragg | 1.2.7 | randomForest | 4.7-1.1 |
rappdirs | 0.3.3 | rcmdcheck | 1.4.0 | RColorBrewer | 1.1-3 |
Rcpp | 1.0.12 | RcppEigen | 0.3.3.9.4 | reactable | 0.4.4 |
reactR | 0.5.0 | readr | 2.1.5 | readxl | 1.4.3 |
recipes | 1.0.9 | rematch | 2.0.0 | rematch2 | 2.1.2 |
remotes | 2.4.2.1 | reprex | 2.1.0 | reshape2 | 1.4.4 |
rlang | 1.1.3 | rmarkdown | 2.25 | RODBC | 1.3-23 |
roxygen2 | 7.3.1 | rpart | 4.1.21 | rprojroot | 2.0.4 |
Rserve | 1.8-13 | RSQLite | 2.3.5 | rstudioapi | 0.15.0 |
rversions | 2.1.2 | rvest | 1.0.3 | sass | 0.4.8 |
scales | 1.3.0 | selectr | 0.4-2 | sessioninfo | 1.2.2 |
shape | 1.4.6 | shiny | 1.8.0 | sourcetools | 0.1.7-1 |
sparklyr | 1.8.4 | spatial | 7.3-15 | splines | 4.3.2 |
sqldf | 0.4-11 | SQUAREM | 2021.1 | stats | 4.3.2 |
stats4 | 4.3.2 | stringi | 1.8.3 | stringr | 1.5.1 |
survival | 3.5-5 | swagger | 3.33.1 | sys | 3.4.2 |
systemfonts | 1.0.5 | tcltk | 4.3.2 | testthat | 3.2.1 |
textshaping | 0.3.7 | tibble | 3.2.1 | tidyr | 1.3.1 |
tidyselect | 1.2.0 | tidyverse | 2.0.0 | timechange | 0.3.0 |
timeDate | 4032.109 | tinytex | 0.49 | tools | 4.3.2 |
tzdb | 0.4.0 | urlchecker | 1.0.1 | usethis | 2.2.2 |
utf8 | 1.2.4 | utils | 4.3.2 | uuid | 1.2-0 |
V8 | 4.4.1 | vctrs | 0.6.5 | viridisLite | 0.4.2 |
vroom | 1.6.5 | waldo | 0.5.2 | whisker | 0.4.1 |
withr | 3.0.0 | xfun | 0.41 | xml2 | 1.3.6 |
xopen | 1.0.0 | xtable | 1.8-4 | yaml | 2.3.8 |
zeallot | 0.1.0 | zip | 2.3.1 |
Installed Java and Scala libraries (Scala 2.12 cluster version)
Group ID | Artifact ID | Version |
---|---|---|
antlr | antlr | 2.7.7 |
com.amazonaws | amazon-kinesis-client | 1.12.0 |
com.amazonaws | aws-java-sdk-autoscaling | 1.12.610 |
com.amazonaws | aws-java-sdk-cloudformation | 1.12.610 |
com.amazonaws | aws-java-sdk-cloudfront | 1.12.610 |
com.amazonaws | aws-java-sdk-cloudhsm | 1.12.610 |
com.amazonaws | aws-java-sdk-cloudsearch | 1.12.610 |
com.amazonaws | aws-java-sdk-cloudtrail | 1.12.610 |
com.amazonaws | aws-java-sdk-cloudwatch | 1.12.610 |
com.amazonaws | aws-java-sdk-cloudwatchmetrics | 1.12.610 |
com.amazonaws | aws-java-sdk-codedeploy | 1.12.610 |
com.amazonaws | aws-java-sdk-cognitoidentity | 1.12.610 |
com.amazonaws | aws-java-sdk-cognitosync | 1.12.610 |
com.amazonaws | aws-java-sdk-config | 1.12.610 |
com.amazonaws | aws-java-sdk-core | 1.12.610 |
com.amazonaws | aws-java-sdk-datapipeline | 1.12.610 |
com.amazonaws | aws-java-sdk-directconnect | 1.12.610 |
com.amazonaws | aws-java-sdk-directory | 1.12.610 |
com.amazonaws | aws-java-sdk-dynamodb | 1.12.610 |
com.amazonaws | aws-java-sdk-ec2 | 1.12.610 |
com.amazonaws | aws-java-sdk-ecs | 1.12.610 |
com.amazonaws | aws-java-sdk-efs | 1.12.610 |
com.amazonaws | aws-java-sdk-elasticache | 1.12.610 |
com.amazonaws | aws-java-sdk-elasticbeanstalk | 1.12.610 |
com.amazonaws | aws-java-sdk-elasticloadbalancing | 1.12.610 |
com.amazonaws | aws-java-sdk-elastictranscoder | 1.12.610 |
com.amazonaws | aws-java-sdk-emr | 1.12.610 |
com.amazonaws | aws-java-sdk-glacier | 1.12.610 |
com.amazonaws | aws-java-sdk-glue | 1.12.610 |
com.amazonaws | aws-java-sdk-iam | 1.12.610 |
com.amazonaws | aws-java-sdk-importexport | 1.12.610 |
com.amazonaws | aws-java-sdk-kinesis | 1.12.610 |
com.amazonaws | aws-java-sdk-kms | 1.12.610 |
com.amazonaws | aws-java-sdk-lambda | 1.12.610 |
com.amazonaws | aws-java-sdk-logs | 1.12.610 |
com.amazonaws | aws-java-sdk-machinelearning | 1.12.610 |
com.amazonaws | aws-java-sdk-opsworks | 1.12.610 |
com.amazonaws | aws-java-sdk-rds | 1.12.610 |
com.amazonaws | aws-java-sdk-redshift | 1.12.610 |
com.amazonaws | aws-java-sdk-route53 | 1.12.610 |
com.amazonaws | aws-java-sdk-s3 | 1.12.610 |
com.amazonaws | aws-java-sdk-ses | 1.12.610 |
com.amazonaws | aws-java-sdk-simpledb | 1.12.610 |
com.amazonaws | aws-java-sdk-simpleworkflow | 1.12.610 |
com.amazonaws | aws-java-sdk-sns | 1.12.610 |
com.amazonaws | aws-java-sdk-sqs | 1.12.610 |
com.amazonaws | aws-java-sdk-ssm | 1.12.610 |
com.amazonaws | aws-java-sdk-storagegateway | 1.12.610 |
com.amazonaws | aws-java-sdk-sts | 1.12.610 |
com.amazonaws | aws-java-sdk-support | 1.12.610 |
com.amazonaws | aws-java-sdk-swf-libraries | 1.11.22 |
com.amazonaws | aws-java-sdk-workspaces | 1.12.610 |
com.amazonaws | jmespath-java | 1.12.610 |
com.clearspring.analytics | stream | 2.9.6 |
com.databricks | Rserve | 1.8-3 |
com.databricks | databricks-sdk-java | 0.17.1 |
com.databricks | jets3t | 0.7.1-0 |
com.databricks.scalapb | compilerplugin_2.12 | 0.4.15-10 |
com.databricks.scalapb | scalapb-runtime_2.12 | 0.4.15-10 |
com.esotericsoftware | kryo-shaded | 4.0.2 |
com.esotericsoftware | minlog | 1.3.0 |
com.fasterxml | classmate | 1.3.4 |
com.fasterxml.jackson.core | jackson-annotations | 2.15.2 |
com.fasterxml.jackson.core | jackson-core | 2.15.2 |
com.fasterxml.jackson.core | jackson-databind | 2.15.2 |
com.fasterxml.jackson.dataformat | jackson-dataformat-cbor | 2.15.2 |
com.fasterxml.jackson.dataformat | jackson-dataformat-yaml | 2.15.2 |
com.fasterxml.jackson.datatype | jackson-datatype-joda | 2.15.2 |
com.fasterxml.jackson.datatype | jackson-datatype-jsr310 | 2.16.0 |
com.fasterxml.jackson.module | jackson-module-paranamer | 2.15.2 |
com.fasterxml.jackson.module | jackson-module-scala_2.12 | 2.15.2 |
com.github.ben-manes.caffeine | caffeine | 2.9.3 |
com.github.fommil | jniloader | 1.1 |
com.github.fommil.netlib | native_ref-java | 1.1 |
com.github.fommil.netlib | native_ref-java | 1.1-natives |
com.github.fommil.netlib | native_system-java | 1.1 |
com.github.fommil.netlib | native_system-java | 1.1-natives |
com.github.fommil.netlib | netlib-native_ref-linux-x86_64 | 1.1-natives |
com.github.fommil.netlib | netlib-native_system-linux-x86_64 | 1.1-natives |
com.github.luben | zstd-jni | 1.5.5-4 |
com.github.wendykierp | JTransforms | 3.1 |
com.google.code.findbugs | jsr305 | 3.0.0 |
com.google.code.gson | gson | 2.10.1 |
com.google.crypto.tink | tink | 1.9.0 |
com.google.errorprone | error_prone_annotations | 2.10.0 |
com.google.flatbuffers | flatbuffers-java | 23.5.26 |
com.google.guava | guava | 15.0 |
com.google.protobuf | protobuf-java | 2.6.1 |
com.helger | profiler | 1.1.1 |
com.ibm.icu | icu4j | 72.1 |
com.jcraft | jsch | 0.1.55 |
com.jolbox | bonecp | 0.8.0.RELEASE |
com.lihaoyi | sourcecode_2.12 | 0.1.9 |
com.microsoft.azure | azure-data-lake-store-sdk | 2.3.9 |
com.microsoft.sqlserver | mssql-jdbc | 11.2.2.jre8 |
com.ning | compress-lzf | 1.1.2 |
com.sun.mail | javax.mail | 1.5.2 |
com.sun.xml.bind | jaxb-core | 2.2.11 |
com.sun.xml.bind | jaxb-impl | 2.2.11 |
com.tdunning | json | 1.8 |
com.thoughtworks.paranamer | paranamer | 2.8 |
com.trueaccord.lenses | lenses_2.12 | 0.4.12 |
com.twitter | chill-java | 0.10.0 |
com.twitter | chill_2.12 | 0.10.0 |
com.twitter | util-app_2.12 | 7.1.0 |
com.twitter | util-core_2.12 | 7.1.0 |
com.twitter | util-function_2.12 | 7.1.0 |
com.twitter | util-jvm_2.12 | 7.1.0 |
com.twitter | util-lint_2.12 | 7.1.0 |
com.twitter | util-registry_2.12 | 7.1.0 |
com.twitter | util-stats_2.12 | 7.1.0 |
com.typesafe | config | 1.4.3 |
com.typesafe.scala-logging | scala-logging_2.12 | 3.7.2 |
com.uber | h3 | 3.7.3 |
com.univocity | univocity-parsers | 2.9.1 |
com.zaxxer | HikariCP | 4.0.3 |
commons-cli | commons-cli | 1.5.0 |
commons-codec | commons-codec | 1.16.0 |
commons-collections | commons-collections | 3.2.2 |
commons-dbcp | commons-dbcp | 1.4 |
commons-fileupload | commons-fileupload | 1.5 |
commons-httpclient | commons-httpclient | 3.1 |
commons-io | commons-io | 2.13.0 |
commons-lang | commons-lang | 2.6 |
commons-logging | commons-logging | 1.1.3 |
commons-pool | commons-pool | 1.5.4 |
dev.ludovic.netlib | arpack | 3.0.3 |
dev.ludovic.netlib | blas | 3.0.3 |
dev.ludovic.netlib | lapack | 3.0.3 |
info.ganglia.gmetric4j | gmetric4j | 1.0.10 |
io.airlift | aircompressor | 0.25 |
io.delta | delta-sharing-client_2.12 | 1.0.5 |
io.dropwizard.metrics | metrics-annotation | 4.2.19 |
io.dropwizard.metrics | metrics-core | 4.2.19 |
io.dropwizard.metrics | metrics-graphite | 4.2.19 |
io.dropwizard.metrics | metrics-healthchecks | 4.2.19 |
io.dropwizard.metrics | metrics-jetty9 | 4.2.19 |
io.dropwizard.metrics | metrics-jmx | 4.2.19 |
io.dropwizard.metrics | metrics-json | 4.2.19 |
io.dropwizard.metrics | metrics-jvm | 4.2.19 |
io.dropwizard.metrics | metrics-servlets | 4.2.19 |
io.netty | netty-all | 4.1.96.Final |
io.netty | netty-buffer | 4.1.96.Final |
io.netty | netty-codec | 4.1.96.Final |
io.netty | netty-codec-http | 4.1.96.Final |
io.netty | netty-codec-http2 | 4.1.96.Final |
io.netty | netty-codec-socks | 4.1.96.Final |
io.netty | netty-common | 4.1.96.Final |
io.netty | netty-handler | 4.1.96.Final |
io.netty | netty-handler-proxy | 4.1.96.Final |
io.netty | netty-resolver | 4.1.96.Final |
io.netty | netty-tcnative-boringssl-static | 2.0.61.Final-linux-aarch_64 |
io.netty | netty-tcnative-boringssl-static | 2.0.61.Final-linux-x86_64 |
io.netty | netty-tcnative-boringssl-static | 2.0.61.Final-osx-aarch_64 |
io.netty | netty-tcnative-boringssl-static | 2.0.61.Final-osx-x86_64 |
io.netty | netty-tcnative-boringssl-static | 2.0.61.Final-windows-x86_64 |
io.netty | netty-tcnative-classes | 2.0.61.Final |
io.netty | netty-transport | 4.1.96.Final |
io.netty | netty-transport-classes-epoll | 4.1.96.Final |
io.netty | netty-transport-classes-kqueue | 4.1.96.Final |
io.netty | netty-transport-native-epoll | 4.1.96.Final |
io.netty | netty-transport-native-epoll | 4.1.96.Final-linux-aarch_64 |
io.netty | netty-transport-native-epoll | 4.1.96.Final-linux-x86_64 |
io.netty | netty-transport-native-kqueue | 4.1.96.Final-osx-aarch_64 |
io.netty | netty-transport-native-kqueue | 4.1.96.Final-osx-x86_64 |
io.netty | netty-transport-native-unix-common | 4.1.96.Final |
io.prometheus | simpleclient | 0.7.0 |
io.prometheus | simpleclient_common | 0.7.0 |
io.prometheus | simpleclient_dropwizard | 0.7.0 |
io.prometheus | simpleclient_pushgateway | 0.7.0 |
io.prometheus | simpleclient_servlet | 0.7.0 |
io.prometheus.jmx | collector | 0.12.0 |
jakarta.annotation | jakarta.annotation-api | 1.3.5 |
jakarta.servlet | jakarta.servlet-api | 4.0.3 |
jakarta.validation | jakarta.validation-api | 2.0.2 |
jakarta.ws.rs | jakarta.ws.rs-api | 2.1.6 |
javax.activation | activation | 1.1.1 |
javax.el | javax.el-api | 2.2.4 |
javax.jdo | jdo-api | 3.0.1 |
javax.transaction | jta | 1.1 |
javax.transaction | transaction-api | 1.1 |
javax.xml.bind | jaxb-api | 2.2.11 |
javolution | javolution | 5.5.1 |
jline | jline | 2.14.6 |
joda-time | joda-time | 2.12.1 |
net.java.dev.jna | jna | 5.8.0 |
net.razorvine | pickle | 1.3 |
net.sf.jpam | jpam | 1.1 |
net.sf.opencsv | opencsv | 2.3 |
net.sf.supercsv | super-csv | 2.2.0 |
net.snowflake | snowflake-ingest-sdk | 0.9.6 |
net.sourceforge.f2j | arpack_combined_all | 0.1 |
org.acplt.remotetea | remotetea-oncrpc | 1.1.2 |
org.antlr | ST4 | 4.0.4 |
org.antlr | antlr-runtime | 3.5.2 |
org.antlr | antlr4-runtime | 4.9.3 |
org.antlr | stringtemplate | 3.2.1 |
org.apache.ant | ant | 1.10.11 |
org.apache.ant | ant-jsch | 1.10.11 |
org.apache.ant | ant-launcher | 1.10.11 |
org.apache.arrow | arrow-format | 15.0.0 |
org.apache.arrow | arrow-memory-core | 15.0.0 |
org.apache.arrow | arrow-memory-netty | 15.0.0 |
org.apache.arrow | arrow-vector | 15.0.0 |
org.apache.avro | avro | 1.11.3 |
org.apache.avro | avro-ipc | 1.11.3 |
org.apache.avro | avro-mapred | 1.11.3 |
org.apache.commons | commons-collections4 | 4.4 |
org.apache.commons | commons-compress | 1.23.0 |
org.apache.commons | commons-crypto | 1.1.0 |
org.apache.commons | commons-lang3 | 3.12.0 |
org.apache.commons | commons-math3 | 3.6.1 |
org.apache.commons | commons-text | 1.10.0 |
org.apache.curator | curator-client | 2.13.0 |
org.apache.curator | curator-framework | 2.13.0 |
org.apache.curator | curator-recipes | 2.13.0 |
org.apache.datasketches | datasketches-java | 3.1.0 |
org.apache.datasketches | datasketches-memory | 2.0.0 |
org.apache.derby | derby | 10.14.2.0 |
org.apache.hadoop | hadoop-client-runtime | 3.3.6 |
org.apache.hive | hive-beeline | 2.3.9 |
org.apache.hive | hive-cli | 2.3.9 |
org.apache.hive | hive-jdbc | 2.3.9 |
org.apache.hive | hive-llap-client | 2.3.9 |
org.apache.hive | hive-llap-common | 2.3.9 |
org.apache.hive | hive-serde | 2.3.9 |
org.apache.hive | hive-shims | 2.3.9 |
org.apache.hive | hive-storage-api | 2.8.1 |
org.apache.hive.shims | hive-shims-0.23 | 2.3.9 |
org.apache.hive.shims | hive-shims-common | 2.3.9 |
org.apache.hive.shims | hive-shims-scheduler | 2.3.9 |
org.apache.httpcomponents | httpclient | 4.5.14 |
org.apache.httpcomponents | httpcore | 4.4.16 |
org.apache.ivy | ivy | 2.5.1 |
org.apache.logging.log4j | log4j-1.2-api | 2.22.1 |
org.apache.logging.log4j | log4j-api | 2.22.1 |
org.apache.logging.log4j | log4j-core | 2.22.1 |
org.apache.logging.log4j | log4j-layout-template-json | 2.22.1 |
org.apache.logging.log4j | log4j-slf4j2-impl | 2.22.1 |
org.apache.orc | orc-core | 1.9.2-shaded-protobuf |
org.apache.orc | orc-mapreduce | 1.9.2-shaded-protobuf |
org.apache.orc | orc-shims | 1.9.2 |
org.apache.thrift | libfb303 | 0.9.3 |
org.apache.thrift | libthrift | 0.12.0 |
org.apache.ws.xmlschema | xmlschema-core | 2.3.0 |
org.apache.xbean | xbean-asm9-shaded | 4.23 |
org.apache.yetus | audience-annotations | 0.13.0 |
org.apache.zookeeper | zookeeper | 3.6.3 |
org.apache.zookeeper | zookeeper-jute | 3.6.3 |
org.checkerframework | checker-qual | 3.31.0 |
org.codehaus.jackson | jackson-core-asl | 1.9.13 |
org.codehaus.jackson | jackson-mapper-asl | 1.9.13 |
org.codehaus.janino | commons-compiler | 3.0.16 |
org.codehaus.janino | janino | 3.0.16 |
org.datanucleus | datanucleus-api-jdo | 4.2.4 |
org.datanucleus | datanucleus-core | 4.1.17 |
org.datanucleus | datanucleus-rdbms | 4.1.19 |
org.datanucleus | javax.jdo | 3.2.0-m3 |
org.eclipse.collections | eclipse-collections | 11.1.0 |
org.eclipse.collections | eclipse-collections-api | 11.1.0 |
org.eclipse.jetty | jetty-client | 9.4.52.v20230823 |
org.eclipse.jetty | jetty-continuation | 9.4.52.v20230823 |
org.eclipse.jetty | jetty-http | 9.4.52.v20230823 |
org.eclipse.jetty | jetty-io | 9.4.52.v20230823 |
org.eclipse.jetty | jetty-jndi | 9.4.52.v20230823 |
org.eclipse.jetty | jetty-plus | 9.4.52.v20230823 |
org.eclipse.jetty | jetty-proxy | 9.4.52.v20230823 |
org.eclipse.jetty | jetty-security | 9.4.52.v20230823 |
org.eclipse.jetty | jetty-server | 9.4.52.v20230823 |
org.eclipse.jetty | jetty-servlet | 9.4.52.v20230823 |
org.eclipse.jetty | jetty-servlets | 9.4.52.v20230823 |
org.eclipse.jetty | jetty-util | 9.4.52.v20230823 |
org.eclipse.jetty | jetty-util-ajax | 9.4.52.v20230823 |
org.eclipse.jetty | jetty-webapp | 9.4.52.v20230823 |
org.eclipse.jetty | jetty-xml | 9.4.52.v20230823 |
org.eclipse.jetty.websocket | websocket-api | 9.4.52.v20230823 |
org.eclipse.jetty.websocket | websocket-client | 9.4.52.v20230823 |
org.eclipse.jetty.websocket | websocket-common | 9.4.52.v20230823 |
org.eclipse.jetty.websocket | websocket-server | 9.4.52.v20230823 |
org.eclipse.jetty.websocket | websocket-servlet | 9.4.52.v20230823 |
org.fusesource.leveldbjni | leveldbjni-all | 1.8 |
org.glassfish.hk2 | hk2-api | 2.6.1 |
org.glassfish.hk2 | hk2-locator | 2.6.1 |
org.glassfish.hk2 | hk2-utils | 2.6.1 |
org.glassfish.hk2 | osgi-resource-locator | 1.0.3 |
org.glassfish.hk2.external | aopalliance-repackaged | 2.6.1 |
org.glassfish.hk2.external | jakarta.inject | 2.6.1 |
org.glassfish.jersey.containers | jersey-container-servlet | 2.40 |
org.glassfish.jersey.containers | jersey-container-servlet-core | 2.40 |
org.glassfish.jersey.core | jersey-client | 2.40 |
org.glassfish.jersey.core | jersey-common | 2.40 |
org.glassfish.jersey.core | jersey-server | 2.40 |
org.glassfish.jersey.inject | jersey-hk2 | 2.40 |
org.hibernate.validator | hibernate-validator | 6.1.7.Final |
org.ini4j | ini4j | 0.5.4 |
org.javassist | javassist | 3.29.2-GA |
org.jboss.logging | jboss-logging | 3.3.2.Final |
org.jdbi | jdbi | 2.63.1 |
org.jetbrains | annotations | 17.0.0 |
org.joda | joda-convert | 1.7 |
org.jodd | jodd-core | 3.5.2 |
org.json4s | json4s-ast_2.12 | 3.7.0-M11 |
org.json4s | json4s-core_2.12 | 3.7.0-M11 |
org.json4s | json4s-jackson_2.12 | 3.7.0-M11 |
org.json4s | json4s-scalap_2.12 | 3.7.0-M11 |
org.lz4 | lz4-java | 1.8.0 |
org.mlflow | mlflow-spark_2.12 | 2.9.1 |
org.objenesis | objenesis | 2.5.1 |
org.postgresql | postgresql | 42.6.1 |
org.roaringbitmap | RoaringBitmap | 0.9.45-databricks |
org.roaringbitmap | shims | 0.9.45-databricks |
org.rocksdb | rocksdbjni | 8.11.4 |
org.rosuda.REngine | REngine | 2.1.0 |
org.scala-lang | scala-compiler_2.12 | 2.12.15 |
org.scala-lang | scala-library_2.12 | 2.12.15 |
org.scala-lang | scala-reflect_2.12 | 2.12.15 |
org.scala-lang.modules | scala-collection-compat_2.12 | 2.11.0 |
org.scala-lang.modules | scala-parser-combinators_2.12 | 1.1.2 |
org.scala-lang.modules | scala-xml_2.12 | 1.2.0 |
org.scala-sbt | test-interface | 1.0 |
org.scalacheck | scalacheck_2.12 | 1.14.2 |
org.scalactic | scalactic_2.12 | 3.2.15 |
org.scalanlp | breeze-macros_2.12 | 2.1.0 |
org.scalanlp | breeze_2.12 | 2.1.0 |
org.scalatest | scalatest-compatible | 3.2.15 |
org.scalatest | scalatest-core_2.12 | 3.2.15 |
org.scalatest | scalatest-diagrams_2.12 | 3.2.15 |
org.scalatest | scalatest-featurespec_2.12 | 3.2.15 |
org.scalatest | scalatest-flatspec_2.12 | 3.2.15 |
org.scalatest | scalatest-freespec_2.12 | 3.2.15 |
org.scalatest | scalatest-funspec_2.12 | 3.2.15 |
org.scalatest | scalatest-funsuite_2.12 | 3.2.15 |
org.scalatest | scalatest-matchers-core_2.12 | 3.2.15 |
org.scalatest | scalatest-mustmatchers_2.12 | 3.2.15 |
org.scalatest | scalatest-propspec_2.12 | 3.2.15 |
org.scalatest | scalatest-refspec_2.12 | 3.2.15 |
org.scalatest | scalatest-shouldmatchers_2.12 | 3.2.15 |
org.scalatest | scalatest-wordspec_2.12 | 3.2.15 |
org.scalatest | scalatest_2.12 | 3.2.15 |
org.slf4j | jcl-over-slf4j | 2.0.7 |
org.slf4j | jul-to-slf4j | 2.0.7 |
org.slf4j | slf4j-api | 2.0.7 |
org.slf4j | slf4j-simple | 1.7.25 |
org.threeten | threeten-extra | 1.7.1 |
org.tukaani | xz | 1.9 |
org.typelevel | algebra_2.12 | 2.0.1 |
org.typelevel | cats-kernel_2.12 | 2.1.1 |
org.typelevel | spire-macros_2.12 | 0.17.0 |
org.typelevel | spire-platform_2.12 | 0.17.0 |
org.typelevel | spire-util_2.12 | 0.17.0 |
org.typelevel | spire_2.12 | 0.17.0 |
org.wildfly.openssl | wildfly-openssl | 1.1.3.Final |
org.xerial | sqlite-jdbc | 3.42.0.0 |
org.xerial.snappy | snappy-java | 1.1.10.3 |
org.yaml | snakeyaml | 2.0 |
oro | oro | 2.0.8 |
pl.edu.icm | JLargeArrays | 1.5 |
software.amazon.cryptools | AmazonCorrettoCryptoProvider | 1.6.1-linux-x86_64 |
software.amazon.ion | ion-java | 1.0.2 |
stax | stax-api | 1.0.1 |