DataX 离线跨网场景的实施配置

配置仅限于跨不同网情况,网络互通情况方案和配置会更简单一点

内网A:MySql数据转换成Csv

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
{
  "job": {
      "setting": {
          "speed": {
               "channel":1
          }
      },
      "content": [
          {
              "reader": {
                  "name": "mysqlreader",
                  "parameter": {
                      "username": "root",
                      "password": "",
                      "connection": [
                          {
                              "querySql": [
                                  "select id,name from table;"
                              ],
                              "jdbcUrl": [
                                  "jdbc:mysql://127.0.0.1/database"
                              ]
                          }
                      ]
                  }
              },
              "writer": {
                  "name": "txtfilewriter",
                  "parameter": {
                      "print": true,
                      "encoding": "UTF-8",
                      "path": "/result",
                      "fileName": "result.csv",
                      "writeMode": "truncate",
                      "dateFormat": "YYYY-MM-dd hh:mm:ss",
                      "header":["id", "name"]
                  }
              }
          }
      ]
  }
}

  

内网B:CSV导入到内网B配置:

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
{
    "job": {
        "setting": {
            "speed": {
                "channel": 2
            }
        },
        "content": [
            {
                 "reader": {
                    "name": "txtfilereader",
                    "parameter": {
                        "path":["D:/result/result.csv"],
                        "encoding": "UTF-8",
                        "column": [
                            {
                                "index": 0,
                                "name":"id",
                                "type": "long"
                            },
                            {
                                "index": 1,
                                "name":"name",
                                "type": "string"
                            }
                        ],
                        "skipHeader": "true"
                    }
                },
                "writer": {
                    "name": "mysqlwriter",
                    "parameter": {
                        "writeMode": "insert",
                        "username": "root",
                        "password": "",
                        "column": [
                            "id", "name"
                        ],
                        "preSql": [
                            "truncate table table;"
                        ],
                        "connection": [
                            {
                                "jdbcUrl": "jdbc:mysql://127.0.0.1:3306/table?characterEncoding=utf-8",
                                "table": [
                                    "table"
                                ]
                            }
                        ]
                    }
                }
            }
        ]
    }
}

  

 注意编码和字段支持的类型,详细可查看DataX官方文档。

posted @   leeolevis  阅读(616)  评论(0编辑  收藏  举报
编辑推荐:
· go语言实现终端里的倒计时
· 如何编写易于单元测试的代码
· 10年+ .NET Coder 心语,封装的思维:从隐藏、稳定开始理解其本质意义
· .NET Core 中如何实现缓存的预热?
· 从 HTTP 原因短语缺失研究 HTTP/2 和 HTTP/3 的设计差异
阅读排行:
· 使用C#创建一个MCP客户端
· 分享一个免费、快速、无限量使用的满血 DeepSeek R1 模型,支持深度思考和联网搜索!
· ollama系列1:轻松3步本地部署deepseek,普通电脑可用
· 基于 Docker 搭建 FRP 内网穿透开源项目(很简单哒)
· 按钮权限的设计及实现
点击右上角即可分享
微信分享提示