Apache Spark Admin

Installation


[artemis] /tmp% gunzip spark-1.6.1.tgz
[artemis] /tmp% tar -xvf spark-1.6.1.tar
[artemis] /tmp% cd spark-1.6.1

[artemis] spark-1.6.1% setenv PATH /util/bin:${PATH}

[artemis] spark-1.6.1% ./build/mvn --force -DskipTests clean package

[wait six hours for Spark to build]

[artemis] spark-1.6.1% cd /util
[artemis] /util% sudo mv /tmp/spark-1.6.1 .
[artemis] /util% sudo chown -R root spark-1.6.1
[artemis] /util% sudo chgrp -R root spark-1.6.1
[artemis] /util% sudo ln -s spark-1.6.1 spark

References

  1. http://spark.apache.org/downloads.html