2014年3月7日
hadoop2.2.0 mapred-site.xml--i/o properties
摘要： mapreduce.task.io.sort.factor 10 The number of streams to merge at once while sorting files. This determines the number of open file handles.注释： mapreduce.task.io.sort.mb 100 The total amount of buffer memory to use while sorting files, in megabytes. By default, gives each merge stream 1... 阅读全文
posted @ 2014-03-07 12:09 weian404 阅读(514) 评论(0) 推荐(0) 编辑
hadoop2.2.0 mapred-site.xml
摘要： mapreduce.jobtracker.jobhistory.location If job tracker is static the history files are stored in this single well known place. If No value is set here, by default, it is in the local file system at ${hadoop.log.dir}/history. 注释： mapreduce.jobtracker.jobhistory.task.numberprogresssplits ... 阅读全文
posted @ 2014-03-07 11:35 weian404 阅读(235) 评论(0) 推荐(0) 编辑
hadoop2.2.0 yarn-site.xml--WebAppProxy Configuration
摘要： The kerberos principal for the proxy, if the proxy is not running as part of the RM. yarn.web-proxy.principal 注释： Keytab for WebAppProxy, if the proxy is not running as part of the RM. yarn.web-proxy.keytab 注释： The address for the web proxy as HOST:PORT, if this is... 阅读全文
posted @ 2014-03-07 10:53 weian404 阅读(277) 评论(0) 推荐(0) 编辑
hadoop2.2.0 yarn-site.xml--Map Reduce configuration
摘要： yarn.nodemanager.aux-services.mapreduce.shuffle.class org.apache.hadoop.mapred.ShuffleHandler 注释： mapreduce.job.jar 注释： mapreduce.job.hdfs-servers ${fs.defaultFS} 注释： 阅读全文
posted @ 2014-03-07 10:51 weian404 阅读(141) 评论(0) 推荐(0) 编辑
hadoop2.2.0 yarn-site.xml--Node Manager Configs
摘要： address of node manager IPC. yarn.nodemanager.address 0.0.0.0:0 注释： Environment variables that should be forwarded from the NodeManager's environment to the container's. yarn.nodemanager.admin-env MALLOC_ARENA_MAX=$MALLOC_ARENA_MAX 注释： Environment variables that contai... 阅读全文
posted @ 2014-03-07 10:49 weian404 阅读(1420) 评论(1) 推荐(0) 编辑
hadoop2.2.0 yarn-site.xml--Resource Manager Configs
摘要： The address of the applications manager interface in the RM. yarn.resourcemanager.address 0.0.0.0:8032 注释： The number of threads used to handle applications manager requests. yarn.resourcemanager.client.thread-count 50 注释： The expiry interval for application master rep... 阅读全文
posted @ 2014-03-07 10:40 weian404 阅读(597) 评论(0) 推荐(0) 编辑
hadoop2.2.0 yarn-site.xml--IPC Configs
摘要： Factory to create client IPC classes. yarn.ipc.client.factory.class 注释： Type of serialization to use. yarn.ipc.serializer.type protocolbuffers 注释： Factory to create server IPC classes. yarn.ipc.server.factory.class 注释： Factory to create IPC exceptions. yarn.ipc... 阅读全文
posted @ 2014-03-07 10:32 weian404 阅读(184) 评论(0) 推荐(0) 编辑
hadoop2.2.0 hdfs-site.xml
摘要： hadoop.hdfs.configuration.version 1 version of this configuration file注释： dfs.namenode.logging.level info The logging level for dfs namenode. Other values are "dir"(trace namespace mutations), "block"(trace block under/over replications and blockcreations/deletions), or "all 阅读全文
posted @ 2014-03-07 10:14 weian404 阅读(562) 评论(0) 推荐(0) 编辑
2014年3月6日
hadoop2.2.0 core-site.xml--HTTP web-consoles Authentication
摘要： hadoop.http.authentication.type simple Defines authentication used for Oozie HTTP endpoint. Supported values are: simple | kerberos | #AUTHENTICATION_HANDLER_CLASSNAME# hadoop.http.authentication.token.validity 36000 Indicates how long (in seconds) an authentication token is vali... 阅读全文
posted @ 2014-03-06 17:57 weian404 阅读(275) 评论(0) 推荐(0) 编辑
hadoop2.2.0 core-site.xml--Tfile
摘要： tfile.io.chunk.size 1048576 Value chunk size in bytes. Default to 1MB. Values of the length less than the chunk size is guaranteed to have known value length in read time (See also TFile.Reader.Scanner.Entry.isValueLengthKnown()). tfile.fs.output.buffer.size 262144 Buffer ... 阅读全文
posted @ 2014-03-06 17:56 weian404 阅读(144) 评论(0) 推荐(0) 编辑