High Performance Spark: Best Practices for Scaling and Optimizing Apache Spark (Greyscale Indian Edition) by Holden Karau

Holden Karau . Unknown Year . English

"Apache Spark is amazing when everything clicks. But if you havenít seen the performance improvements you expected, or still donít feel confident enough to use Spark in production, this practical book is for you. Authors Holden Karau and Rachel Warren demonstrate performance optimizations to help your Spark queries run faster and handle larger data sizes, while using fewer resources. Ideal for software engineers, data engineers, developers and system administrators working with large-scale data applications, this book describes techniques that can reduce data infrastructure costs and developer hours. Not only will you gain a more comprehensive understanding of Spark, youíll also learn how to make it sing. With this book, youíll explore: How Spark SQLís new interfaces improve performance over SQLís RDD data structure The choice between data joins in Core Spark and Spark SQL Techniques for getting the most out of standard RDD transformations How to work around performance issues in Sparkís key/value pair paradigm Writing high-performance Spark code without Scala or the JVM How to test for functionality and performance when applying suggested improvements Using Spark MLlib and Spark ML machine learning libraries Sparkís Streaming components and external community packages "

Categories: Self-Help

About the Author

Holden is a transgender Canadian open source developer advocate with a focus on Apache Spark, related "big data" tools. She is the co-author of Learning Spark, High Performance Spark, and Kubeflow for ML. She is a committer and PMC on Apache Spark and ASF member. She was tricked into the world of big data while trying to improve search and recommendation systems and has long since forgotten her original goal. Outside of work she enjoys dancing, scooters, and playing with fire.

Books from Similar Categories

Books from the Same Genre

Download BookR now and choose mindful reading!

Download Now!