Java程序内提交spark,不经过spark-submit

设置以下便可访问远程hdfs文件并连接yarn的resourcemanagerjava

SparkConf conf = new SparkConf();
conf = conf.set("fs.defaultFS", "hdfs://test-master.flashdragon.com");
conf = conf.set("spark.hadoop.yarn.resourcemanager.address", "test-master.flashdragon.com:8032")
相关文章
相关标签/搜索