Apache Spark : How to change the port the Spark driver listens to - Stack Overflow

Apache Spark : How to change the port the Spark driver listens to - Stack Overflow

You could do that by setting spark.driver.port=20002

For example in your spark-submit you could use something lik:

$ spark-submit --master yarn-client --conf spark.driver.port=20002 ....

Read full article from Apache Spark : How to change the port the Spark driver listens to - Stack Overflow