随笔分类 -  队列

yarn命令
摘要:#kill掉default队列中的任务 for i in `yarn application -list | grep -w default | awk '{print $1}' | grep application_`; do yarn application -kill $i; done 一, 阅读全文

posted @ 2020-02-17 21:06 锋锋2019 阅读(772) 评论(0) 推荐(0) 编辑

yarn调优
摘要:参考: https://www.cnblogs.com/yinzhengjie/articles/11064239.html yarn.scheduler.fair.allow-undeclared-pools false #不容许用户自己创建队列 yarn.scheduler.minimum-al 阅读全文

posted @ 2019-12-27 21:36 锋锋2019 阅读(142) 评论(0) 推荐(0) 编辑

队列原理
摘要:官网: https://hadoop.apache.org/docs/r2.8.5/hadoop-yarn/hadoop-yarn-site/FairScheduler.html 参数: https://hadoop.apache.org/docs/r2.8.5/hadoop-yarn/hadoop 阅读全文

posted @ 2019-12-26 17:36 锋锋2019 阅读(568) 评论(0) 推荐(0) 编辑

EMR的fair-scheduler.xml
摘要:注意点进emr的yarn里时,配置要选fair-scheduler.修改完点保存,再刷新. cat /etc/ecm/hadoop-conf/fair-scheduler.xml <?xml version="1.0"?> <allocations> <aclSubmitApps>*</aclSub 阅读全文

posted @ 2019-12-19 18:33 锋锋2019 阅读(565) 评论(0) 推荐(0) 编辑

CDH6.2的fair-scheduler.xml
摘要:#设置scheduler类型: yarn.resourcemanager.scheduler.class org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler <?xml version="1.0" en 阅读全文

posted @ 2019-12-19 18:31 锋锋2019 阅读(560) 评论(0) 推荐(0) 编辑

导航

点击右上角即可分享
微信分享提示