GitHub Twitter Slack

# Release Notes

# 3.0.0-1.1.0 (latest)

  • Upgraded to Spark 3.0.0 with Scala 2.12 and Hadoop 2.9.2 support
  • Spark Operator based on version v1beta2-1.2.2
  • KUDO version updated to 0.15.0

# 2.4.5-1.0.1

  • Changed sparkJobNamespace parameter propagation logic, making the operator manage Spark jobs across all namespaces by default
  • Spark Operator based on version v1beta2-1.1.1
  • KUDO version updated to 0.13.0

# 2.4.5-1.0.0

  • Spark Operator Docker image based on apache/spark (opens new window) 2.4.5 with Hadoop 2.9.2 support
  • Spark Operator based on version v1beta2-1.1.0
  • Security features: RPC Auth with Encryption, TLS support, Kerberos
  • Additional features for Spark and Spark History Server integration with popular data stores, such as Amazon S3 and HDFS

# 2.4.4-0.2.0

  • Spark Operator Docker image based on apache/spark (opens new window) 2.4.4 with Hadoop 2.9.2 support
  • Added Python and R support to Spark Operator image
  • Added support for automatic installation of monitoring resources
  • Added configuration parameters and documentation for HA installation
  • Added documentation describing integration with Volcano batch scheduler

# beta1

  • Spark Operator Docker image based on mesosphere/spark (opens new window) 2.4.3 with Hadoop 2.9.2 support
  • Spark Operator based on version v1beta2-1.0.1
  • Added Spark History Server support
  • Added ServiceMonitors for integration with the Prometheus Operator
  • Prometheus Java agent updated to version 0.11.0
  • Kubernetes Java client library updated to version 4.4.2

← Security →