Installation Issues

This page addresses some common errors and issues that you might have while installing Spark on your system.

Common issues/errors:

If you are getting the following error while installing Spark 3.2 try installing Spark 3.0.3

Alternate steps to resolve the error:

OPTION 1

Open a spark cluster manually using the command:

spark-class org.apache.spark.deploy.master.Master

Your output should be something like the image below:

This means that your UI is set at localhost:8080 and you have opened the master at localhost:7077.

So now the only thing that's left to do is open a 2nd cmd and execute the command:

spark-shell --master spark://localhost:7077

Your output should be something like the image below:

OPTION 2

Install an older spark version preferably Spark 3.0.3