streamsets 源码构建
依赖构建工具
git 1.9+
oracle jdk 8
docker 1.10+
maven 3.3.9+
nodejs
npm
grunt-cli
md5sum
预备构建任务
- data collector
git clone http://github.com/streamsets/datacollector-api
git clone http://github.com/streamsets/datacollector-plugin-api
mvn clean install -DskipTests
- edge
git clone https://github.com/streamsets/datacollector-edge.git
./gradlew clean dist publishToMavenLocal
编译
- clone 代码
git clone http://github.com/streamsets/datacollector
- 构建(dev)
mvn package -Pdist,ui -DskipTests
- 运行集成测试
mvn install -Pdist -DskipTests
mvn failsafe:integration-test -DfailIfNoTests=false
- release
mvn clean package -Drelease -DskipTests -P-rpm
说明
streamsets 依赖东西多（数据处理组件多），对于国内来说稍有漫长（maven 下载依赖），我运行一个测试跑了快一天，才运行起来
参考资料
https://github.com/streamsets/datacollector/blob/master/BUILD.md
