Spark on Kubernetes is growing in popularity due to improved isolation, better resource sharing, and the ability to leverage homogeneous and cloud-native infrastructure for the entire stack. However, running Spark on Kubernetes in a stable, performant, cost-efficient, and secure manner still presents complex challenges. In this webinar, Alex Pierce discusses the key performance metrics to focus on when monitoring and optimizing Spark performance on Kubernetes. Topics include: - Core concepts and setup of Spark on Kubernetes - Spark on Kubernetes architecture - Monitoring Spark on Kubernetes best practices - Why Prometheus alone is not enough for Kubernetes monitoring - Observability and optimization - Configuration tips for performance and efficient resource sharing - End-to-end visibility for Spark on Kubernetes