alluxio
参考:http://www.alluxio.com/2016/04/getting-started-with-alluxio-and-spark/
环境:
ubuntu14.04 64bit
scala2.10.5
openjdk1.7
hadoop2.6
spark1.6
webui:
http://localhost:19999/home
基本功能测试:
bin/alluxio bootstrap-conf localhost
bin/alluxio format
bin/alluxio-start.sh local
bin/spark-shell
val file = sc.textFile("/in/README.txt")
file.count
file.saveAsTextFile("alluxio://localhost:19998/README.txt")
val alluxiofile = sc.textFile("alluxio://localhost:19998/README.txt")
alluxiofile.count