上一页 1 ··· 17 18 19 20 21 22 23 24 25 ··· 53 下一页

Flink -- Barrier

摘要: CheckpointBarrierHandler 这个接口用于react从input channel过来的checkpoint barrier,这里可以通过不同的实现来,决定是简单的track barriers,还是要去真正的block inputs BarrierBuffer 最关键的函数, 其中 阅读全文
posted @ 2016-11-19 00:13 fxjwind 阅读(2030) 评论(0) 推荐(0) 编辑

Flink - Checkpoint

摘要: Flink在流上最大的特点,就是引入全局snapshot, CheckpointCoordinator 做snapshot的核心组件为, CheckpointCoordinator /** * The checkpoint coordinator coordinates the distributed snapshots of operators and state. * I... 阅读全文
posted @ 2016-11-19 00:11 fxjwind 阅读(4904) 评论(0) 推荐(0) 编辑

Flink - metrics

摘要: Metrics是以MetricsGroup来组织的 MetricGroup MetricGroup 这就是个metric容器,里面可以放subGroup,或者各种metric 所以主要的接口就是注册, /** * A MetricGroup is a named container for {@link Metric Metrics} and further metric ... 阅读全文
posted @ 2016-11-10 16:19 fxjwind 阅读(4026) 评论(1) 推荐(0) 编辑

Kafka - protocol

摘要: http://kafka.apache.org/protocol 翻译, http://colobu.com/2017/01/26/A-Guide-To-The-Kafka-Protocol/ 具体的协议看原文, Preliminaries Network Kafka uses a binary p 阅读全文
posted @ 2016-11-02 16:27 fxjwind 阅读(488) 评论(0) 推荐(0) 编辑

Deep Learning

摘要: http://www.deeplearningbook.org/ mark 阅读全文
posted @ 2016-10-26 13:35 fxjwind 阅读(254) 评论(0) 推荐(0) 编辑

Flink - FLIP

摘要: https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals FLIP-1 : Fine Grained Recovery from Task Failures When a task fails duri 阅读全文
posted @ 2016-10-13 11:59 fxjwind 阅读(1075) 评论(0) 推荐(1) 编辑

Open Sourcing Kafka Monitor

摘要: https://engineering.linkedin.com/blog/2016/05/open-sourcing-kafka-monitor https://github.com/linkedin/kafka-monitor https://github.com/Microsoft/Availability-Monitor-for-Kafka Design Ov... 阅读全文
posted @ 2016-09-13 15:17 fxjwind 阅读(538) 评论(0) 推荐(0) 编辑

Running Kafka At Scale

摘要: https://engineering.linkedin.com/kafka/running-kafka-scale If data is the lifeblood of high technology, Apache Kafka is the circulatory system in use at LinkedIn. We use Kafka for moving every type o... 阅读全文
posted @ 2016-09-13 13:40 fxjwind 阅读(611) 评论(0) 推荐(0) 编辑

Structured Streaming Programming Guide

摘要: https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html http://www.slideshare.net/databricks/a-deep-dive-into-structured-streaming Structured Streaming is a scalable and ... 阅读全文
posted @ 2016-08-24 16:42 fxjwind 阅读(799) 评论(0) 推荐(0) 编辑

Deep Learning Tutorial

摘要: http://www.slideshare.net/tw_dsconf/ss-62245351?qid=c0f0f97a-6ca8-4df0-97e2-984452215ee7&v=&b=&from_search=1 参考链接, Softmax 函数的特点和作用是什么? 如何直观的解释back propagation算法? 技术向:一文读懂卷积神经网络CNN 怎样通俗易懂地解释卷积... 阅读全文
posted @ 2016-08-23 11:43 fxjwind 阅读(265) 评论(0) 推荐(0) 编辑
上一页 1 ··· 17 18 19 20 21 22 23 24 25 ··· 53 下一页