spark参数调优系列 目录地址：缓存
http://www.javashuo.com/article/p-dbqhpgif-ky.htmlspa
⑩ Dynamic Allocation 动态分配.net
spark.dynamicAllocation.enabledcode
是否开启动态资源配置，根据工做负载来衡量是否应该增长或减小executor，默认falseblog
如下相关参数：队列
spark.dynamicAllocation.minExecutors资源动态分配最小executor个数，在启动时就申请好的，默认0get
spark.dynamicAllocation.maxExecutorsit动态分配最大executor个数，默认infinityspark
spark.dynamicAllocation.initialExecutors动态分配初始executor个数默认值=spark.dynamicAllocation.minExecutors
spark.dynamicAllocation.executorIdleTimeout
当某个executor空闲超过这个设定值，就会被kill，默认60s
spark.dynamicAllocation.cachedExecutorIdleTimeout
当某个缓存数据的executor空闲时间超过这个设定值，就会被kill，默认infinity
spark.dynamicAllocation.schedulerBacklogTimeout
任务队列非空，资源不够，申请executor的时间间隔，默认1s
spark.dynamicAllocation.sustainedSchedulerBacklogTimeout
同schedulerBacklogTimeout，是申请了新executor以后继续申请的间隔，默认=schedulerBacklogTimeout