The Akamas Team is at work preparing a guide on how to optimize Spark applications and jobs for maximum performance and minimum cost. Stay tuned!
In the meantime, you may want to watch this video Optimizing Spark Costs on AWS with AI-Powered Tuning or read this blog entry Wouldn't it be nice to get faster Spark jobs and lower AWS costs? to learn:
- How Akamas AI was able to cut cloud costs by more than 50% in a real-life Spark application on AWS EMR
- How Akamas optimized both Spark settings and AWS EMR cluster infrastructure (EC2 instances) at the same time, for optimal performance and efficiency
- How Big Data performance tuning on cloud infrastructure involves complex trade-offs
- How AI-driven performance optimization does change the price-performance equation
© Akamas Spa 2018-present. Akamas and the Akamas logo are registered trademarks of Akamas Spa.