摘要: mapreduce.jobhistory.address 0.0.0.0:10020 MapReduce JobHistory Server IPC host:port注释:历史作业ipc的ip端口。 mapreduce.jobhistory.webapp.address 0.0.0.0:19888 MapReduce JobHistory Server Web UI host:port注释:历史作业的web端访问ip地址 mapreduce.jobhistory.keytab Location of the kerberos keytab file for the ... 阅读全文
posted @ 2014-03-07 13:01 weian404 阅读(170) 评论(0) 推荐(0) 编辑
摘要: mapreduce.job.end-notification.url http://localhost:8080/jobstatus.php?jobId=$jobId&jobStatus=$jobStatus--> Indicates url which will be called on completion of job to inform end status of job. User can give at most 2 variables with URI : $jobId and $jobStatus. ... 阅读全文
posted @ 2014-03-07 12:59 weian404 阅读(462) 评论(0) 推荐(0) 编辑
摘要: mapreduce.job.counters.limit 120 Limit on the number of user counters allowed per job. 注释: mapreduce.framework.name local The runtime framework for executing MapReduce jobs. Can be one of local, classic or yarn. 注释: yarn.app.mapreduce.am.staging-dir /tmp/hadoop-yarn/staging The staging d... 阅读全文
posted @ 2014-03-07 12:54 weian404 阅读(98) 评论(0) 推荐(0) 编辑
摘要: mapreduce.tasktracker.healthchecker.script.path Absolute path to the script which is periodicallyrun by the node health monitoring service to determine if the node is healthy or not. If the value of this key is empty or the file does not exist in the location configured here, the node health... 阅读全文
posted @ 2014-03-07 12:52 weian404 阅读(119) 评论(0) 推荐(0) 编辑
摘要: mapreduce.jobtracker.taskcache.levels 2 This is the max level of the task cache. For example, if the level is 2, the tasks cached are at the host level and at the rack level. 注释: mapreduce.job.queuename default Queue to which a job is submitted. This must match one of the queues d... 阅读全文
posted @ 2014-03-07 12:50 weian404 阅读(184) 评论(0) 推荐(0) 编辑
摘要: mapreduce.task.io.sort.factor 10 The number of streams to merge at once while sorting files. This determines the number of open file handles.注释: mapreduce.task.io.sort.mb 100 The total amount of buffer memory to use while sorting files, in megabytes. By default, gives each merge stream 1... 阅读全文
posted @ 2014-03-07 12:09 weian404 阅读(514) 评论(0) 推荐(0) 编辑
摘要: mapreduce.jobtracker.jobhistory.location If job tracker is static the history files are stored in this single well known place. If No value is set here, by default, it is in the local file system at ${hadoop.log.dir}/history. 注释: mapreduce.jobtracker.jobhistory.task.numberprogresssplits ... 阅读全文
posted @ 2014-03-07 11:35 weian404 阅读(235) 评论(0) 推荐(0) 编辑
摘要: The kerberos principal for the proxy, if the proxy is not running as part of the RM. yarn.web-proxy.principal 注释: Keytab for WebAppProxy, if the proxy is not running as part of the RM. yarn.web-proxy.keytab 注释: The address for the web proxy as HOST:PORT, if this is... 阅读全文
posted @ 2014-03-07 10:53 weian404 阅读(277) 评论(0) 推荐(0) 编辑
摘要: yarn.nodemanager.aux-services.mapreduce.shuffle.class org.apache.hadoop.mapred.ShuffleHandler 注释: mapreduce.job.jar 注释: mapreduce.job.hdfs-servers ${fs.defaultFS} 注释: 阅读全文
posted @ 2014-03-07 10:51 weian404 阅读(141) 评论(0) 推荐(0) 编辑
摘要: address of node manager IPC. yarn.nodemanager.address 0.0.0.0:0 注释: Environment variables that should be forwarded from the NodeManager's environment to the container's. yarn.nodemanager.admin-env MALLOC_ARENA_MAX=$MALLOC_ARENA_MAX 注释: Environment variables that contai... 阅读全文
posted @ 2014-03-07 10:49 weian404 阅读(1420) 评论(1) 推荐(0) 编辑
摘要: The address of the applications manager interface in the RM. yarn.resourcemanager.address 0.0.0.0:8032 注释: The number of threads used to handle applications manager requests. yarn.resourcemanager.client.thread-count 50 注释: The expiry interval for application master rep... 阅读全文
posted @ 2014-03-07 10:40 weian404 阅读(597) 评论(0) 推荐(0) 编辑
摘要: Factory to create client IPC classes. yarn.ipc.client.factory.class 注释: Type of serialization to use. yarn.ipc.serializer.type protocolbuffers 注释: Factory to create server IPC classes. yarn.ipc.server.factory.class 注释: Factory to create IPC exceptions. yarn.ipc... 阅读全文
posted @ 2014-03-07 10:32 weian404 阅读(184) 评论(0) 推荐(0) 编辑
摘要: hadoop.hdfs.configuration.version 1 version of this configuration file注释: dfs.namenode.logging.level info The logging level for dfs namenode. Other values are "dir"(trace namespace mutations), "block"(trace block under/over replications and blockcreations/deletions), or "all 阅读全文
posted @ 2014-03-07 10:14 weian404 阅读(562) 评论(0) 推荐(0) 编辑