This is a performance testing framework for Spark SQL in Apache Spark 2.2+. The framework contains twelve benchmarks that can be executed in local mode. They are organized into three classes and ...

Data & MLOps Engineer building scalable ML systems. Passionate about cloud, data platforms, and responsible AI. I have deployed Kafka pipelines that ran cleanly in staging for two weeks. No lag. No ...