Skip to content

Files

Latest commit

5f055b4 · Oct 17, 2017

History

History

spark-wordcount-scala

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
Oct 17, 2017
Oct 17, 2017
Oct 17, 2017

本例子是用scala写的一个spark的wordcount的例子。

将生成jar包提交到spark上运行的命令:

spark-submit --master spark://localhost:7077 --name WordCount \
--class org.cooze.hadoop.spark.wordcount.scala.WordCount --executor-memory 512M \
--total-executor-cores 2 ./spark-wordcount-scala.jar hdfs://localhost:9000/wordcount

spark-submit --master spark://localhost:7077 \
 --name WordCount --class org.cooze.hadoop.spark.wordcount.scala.WordCount \
  --executor-memory 512M --total-executor-cores 2 \
  ./spark-wordcount-scala.jar /wordcount