摘要： extends Introduced in GitLab 11.3. extends defines entry names that a job that uses extends is going to inherit from. It’s an alternative to using YAM 阅读全文

摘要： script script is the only required keyword that a job needs. It's a shell script which is executed by the Runner. For example: job: script: "bundle ex 阅读全文

摘要： Parameter details The following are detailed explanations for parameters used to configure CI/CD pipelines. image Used to specify a Docker image to us 阅读全文

摘要： GitLab CI/CD pipelines are configured using a YAML file called .gitlab-ci.yml within each project. The .gitlab-ci.yml file defines the structure and o 阅读全文

摘要： 核心概念 Columnar Data Store Kudu is a columnar data store. A columnar data store stores data in strongly-typed columns. With a proper design, it is super 阅读全文

摘要： 1.DataSet相关概念 Dataset是一个分布式的数据集。Dataset是Spark 1.6开始新引入的一个接口，它结合了RDD API的很多优点（包括强类型，支持lambda表达式等），以及Spark SQL的优点（优化后的执行引擎）。Dataset可以通过JVM对象来构造，然后通过tran 阅读全文

摘要： HDFS到HDFS过程 看看map 和flatmap的位置 Flatmap 和map 的定义 map()是将函数用于RDD中的每个元素，将返回值构成新的RDD。 flatmap()是将函数应用于RDD中的每个元素，将返回的迭代器的所有内容构成新的RDD 例子： val rdd = sc.parall 阅读全文

摘要： Apache Spark Examples These examples give a quick overview of the Spark API. Spark is built on the concept of distributed datasets, which contain arbi 阅读全文

摘要： Apache Parquet is a columnar storage format available to any project in the Hadoop ecosystem, regardless of the choice of data processing framework, d 阅读全文

摘要： 官网传送：http://avro.apache.org/docs/current/ Introduction Apache Avro™ is a data serialization system. Avro provides: Rich data structures. A compact, fa 阅读全文