Getting Started with the Spark Web UI | MapR
This post will help you get started using the Apache Spark Web UI to understand how your Spark application is executing on a Hadoop cluster. The Spark Web UI displays useful information about your application, including:
- A list of scheduler stages and tasks
- A summary of RDD sizes and memory usage
- Environmental information
- Information about the running executors
This post will go over:
- Components and lifecycle of a Spark program
- How your Spark application runs on a Hadoop cluster
- Using the Spark web UI to view the behavior and performance of your Spark application
This post assumes a basic understanding of Spark concepts. If you have not already read the tutorial on Getting Started with Spark on MapR Sandbox, it would be good to read that first.
Read full article from Getting Started with the Spark Web UI | MapR
No comments:
Post a Comment