How to get Spark running Standalone?
export SPARK_MASTER_IP='mylinodeip'
export SPARK_LOCAL_IP='127.0.0.0'
export SPARK_MASTER_PORT=80
export SPARK_WORKER_MEMORY='100MB'
export STANDALONE_SPARK_MASTER_HOST='mylinodeip'
java -jar server.jar
Am I doing anything wrong? If anyone has any insights, I would greatly appreciate them.
Thanks in advance!
EDIT: The webserver seems to stay alive ONLY when I launch it from the script, but I cannot connect to it on the port I specified. If I launch the jar itself without any of the above parameters (which would mean it runs on port 80 at 127.0.0.0), it just stops as soon as it starts.