摘要：
【缘起】 最近两个月的工作重点是学习CDH（Cloudera's Distribution Including Hadoop）的安装部署和使用。在阅读CDH的官方文档时，其中一句话吸引了我的眼球：Cloudera Manager uses an open source supervisor... 阅读全文
posted @ 2014-05-24 23:59 Jason Koo 阅读(33281) 评论(0) 推荐(1) 编辑
摘要：
Tar can redirect extracted files to a different folder. This can be handy if you want to unpack a tar archive stored on a cd or other read-only media and want to eliminate the step of first copying the archive, extracting it, then deleting the extra tar. All you have to do is add a ‘-C’ to the tar c 阅读全文
posted @ 2014-04-04 10:00 Jason Koo 阅读(753) 评论(0) 推荐(0) 编辑
摘要：
Bash dot operator is also known as ‘source’.. filename [arguments]Read and execute commands from thefilenameargument in the current shell context. Iffilenamedoes not contain a slash, thePATHvariable is used to findfilename. When Bash is not inPOSIXmode, the current directory is searched iffilenameis 阅读全文
posted @ 2014-04-03 10:09 Jason Koo 阅读(422) 评论(0) 推荐(0) 编辑
摘要：
plot 命令的格式:Syntax: plot {[ranges]} {[function] | {"[datafile]" {datafile-modifiers}}} {axes [axes] } { [title-spec] } {with [style] } {, {definitions,} [function] ...}plot 一个数据文件。 例子文件 a.txt 的内容的一部分。1 611738 581056 593414 583590 502984 5538132 661569 5485... 阅读全文
posted @ 2013-12-07 17:11 Jason Koo 阅读(618) 评论(0) 推荐(0) 编辑
摘要：
1. CPU平均利用率真实图dataset Nodes Edges Hadoop Sparkwiki-Vote 0.7115 0.103689 25.71 28.18soc-Slashdot0902 8.2168 0.948464 30.03 34.4web-Google 87.5713 5.105039 31.62 30.6cit-Patents 377.4768 16.518948 28.59 28.42twitter-Small 1131.6811 85.331845 22.12 31.6模拟图dataset Nodes Edges Hadoop Sparkkronecker19 41. 阅读全文
posted @ 2013-12-06 09:15 Jason Koo 阅读(351) 评论(0) 推荐(0) 编辑
摘要：
1. 图规模与CPU平均利用率真实图dataset Nodes Edges Hadoop Sparkwiki-Vote 7115 103689 26.81 27.01soc-Slashdot0902 82168 948464 30.55 31.93web-Google 875713 5105039 30.82 29.05cit-Patents 3774768 16518948 29.01 28.37twitter-Small 11316811 85331845 22.53 30.77dataset Nodes Edges Hadoop Sparkkronecker19 416962 3206. 阅读全文
posted @ 2013-12-05 13:19 Jason Koo 阅读(239) 评论(0) 推荐(0) 编辑
摘要：
We recently had to make the format of a paper complaint with theIEEE PDF eXpressformat. The paper did not pass the check in the first few attempts. Hence this blog post. I'd like to thank my colleague Ning Shang who did the most of the fixes to get it working. I am listing the fixes here so that 阅读全文
posted @ 2013-11-18 21:16 Jason Koo 阅读(1225) 评论(0) 推荐(0) 编辑
摘要：
This article is copied fromhttp://www.pixelbeat.org/programming/stdio_buffering/I found it difficult to figure out what buffering was applied to the standard streams.Consider for example the following unix shell pipeline:$ command1 | command2Here the shell forks off 2 processes and connects them usi 阅读全文
posted @ 2013-10-30 15:57 Jason Koo 阅读(339) 评论(0) 推荐(0) 编辑
摘要：
It’s a common problem. You write some shell command like:$ tail -f /var/log/foo | egrep -v 'some|stuff' | sed | awkand wonder why nothing is printed, even though you know some text has matched. The problem is that stdio is being buffered, and there’s a very good write-up of the problemhereso 阅读全文
posted @ 2013-10-30 15:23 Jason Koo 阅读(245) 评论(0) 推荐(0) 编辑
摘要：
Bash functions, unlike functions in most programming languages do not allow you to return a value to the caller. When a bash function ends its return value is its status: zero for success, non-zero for failure. To return values, you can set a global variable with the result, or use command substitut 阅读全文
posted @ 2013-10-28 23:18 Jason Koo 阅读(224) 评论(0) 推荐(0) 编辑