Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
Returns the number of items collected in the KLL bigint sketch.
Syntax
from pyspark.sql import functions as sf
sf.kll_sketch_get_n_bigint(col)
Parameters
| Parameter | Type | Description |
|---|---|---|
col |
pyspark.sql.Column or str |
The KLL bigint sketch binary representation. |
Returns
pyspark.sql.Column: The count of items in the sketch.
Examples
Example 1: Get count of items in KLL bigint sketch
from pyspark.sql import functions as sf
df = spark.createDataFrame([1,2,3,4,5], "INT")
sketch_df = df.agg(sf.kll_sketch_agg_bigint("value").alias("sketch"))
sketch_df.select(sf.kll_sketch_get_n_bigint("sketch")).show()
+-------------------------------+
|kll_sketch_get_n_bigint(sketch)|
+-------------------------------+
| 5|
+-------------------------------+