DataxWeb 设置运行错误

2021-09-09 09:21:15 [JobThread.run-130] <br>----------- datax-web job execute start -----------<br>----------- Param:
2021-09-09 09:21:15 [BuildCommand.buildDataXParam-100] ------------------Command parameters:
2021-09-09 09:21:15 [ExecutorJobHandler.execute-57] ------------------DataX process id: 1948
2021-09-09 09:21:15 [AnalysisStatistics.analysisStatisticsLog-53] 
2021-09-09 09:21:15 [AnalysisStatistics.analysisStatisticsLog-53] DataX (DATAX-OPENSOURCE-3.0), From Alibaba !
2021-09-09 09:21:15 [AnalysisStatistics.analysisStatisticsLog-53] Copyright (C) 2010-2017, Alibaba Group. All Rights Reserved.
2021-09-09 09:21:15 [AnalysisStatistics.analysisStatisticsLog-53] 
2021-09-09 09:21:15 [AnalysisStatistics.analysisStatisticsLog-53] 
2021-09-09 09:21:15 [ProcessCallbackThread.callbackLog-186] <br>----------- datax-web job callback finish.
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.234 [main] INFO  VMInfo - VMInfo# operatingSystem class => sun.management.OperatingSystemImpl
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.240 [main] INFO  Engine - the machine info  => 
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     osInfo:    Oracle Corporation 1.8 25.202-b08
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     jvmInfo:    Windows 10 amd64 10.0
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     cpu num:    8
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     totalPhysicalMemory:    -0.00G
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     freePhysicalMemory:    -0.00G
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     maxFileDescriptorCount:    -1
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     currentOpenFileDescriptorCount:    -1
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     GC Names    [PS MarkSweep, PS Scavenge]
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     MEMORY_NAME                    | allocation_size                | init_size                      
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     PS Eden Space                  | 256.00MB                       | 256.00MB                       
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     Code Cache                     | 240.00MB                       | 2.44MB                         
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     Compressed Class Space         | 1,024.00MB                     | 0.00MB                         
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     PS Survivor Space              | 42.50MB                        | 42.50MB                        
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     PS Old Gen                     | 683.00MB                       | 683.00MB                       
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     Metaspace                      | -0.00MB                        | 0.00MB                         
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.260 [main] INFO  Engine - 
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] {
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     "content":[
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]         {
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]             "reader":{
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                 "name":"mysqlreader",
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                 "parameter":{
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     "column":[
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         "`id`",
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         "`name`",
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         "`content`",
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         "`createdate`"
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     ],
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     "connection":[
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         {
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                             "jdbcUrl":[
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                                 "jdbc:mysql://192.168.8.248:3306/sourcedb?serverTimezone=Asia/Shanghai&useLegacyDatetimeCode=false&useSSL=false&nullNamePatternMatchesAll=true&useUnicode=true&characterEncoding=UTF-8"
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                             ],
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                             "table":[
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                                 "t_user_info"
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                             ]
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         }
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     ],
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     "password":"****",
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     "splitPk":"id",
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     "username":"root"
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                 }
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]             },
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]             "writer":{
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                 "name":"mysqlwriter",
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                 "parameter":{
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     "column":[
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         "`id`",
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         "`name`",
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         "`content`",
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         "`createdate`"
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     ],
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     "connection":[
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         {
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                             "jdbcUrl":"jdbc:mysql://192.168.8.248:3306/targetdb?serverTimezone=Asia/Shanghai&useLegacyDatetimeCode=false&useSSL=false&nullNamePatternMatchesAll=true&useUnicode=true&characterEncoding=UTF-8",
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                             "table":[
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                                 "t_user_info"
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                             ]
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         }
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     ],
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     "password":"****",
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     "preSql":[
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         "delete from t_user_info"
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     ],
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     "username":"root"
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                 }
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]             }
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]         }
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     ],
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     "setting":{
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]         "errorLimit":{
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]             "percentage":0.02,
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]             "record":0
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]         },
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]         "speed":{
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]             "byte":1048576,
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]             "channel":3
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]         }
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     }
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] }
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.284 [main] WARN  Engine - prioriy set to 0, because NumberFormatException, the value is: null
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.286 [main] INFO  PerfTrace - PerfTrace traceId=job_-1, isEnable=false, priority=0
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.286 [main] INFO  JobContainer - DataX jobContainer starts job.
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.287 [main] INFO  JobContainer - Set jobId = 0
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.496 [job-0] INFO  OriginalConfPretreatmentUtil - Available jdbcUrl:jdbc:mysql://192.168.8.248:3306/sourcedb?serverTimezone=Asia/Shanghai&useLegacyDatetimeCode=false&useSSL=false&nullNamePatternMatchesAll=true&useUnicode=true&characterEncoding=UTF-8&yearIsDateType=false&zeroDateTimeBehavior=CONVERT_TO_NULL&tinyInt1isBit=false&rewriteBatchedStatements=true.
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.522 [job-0] INFO  OriginalConfPretreatmentUtil - table:[t_user_info] has columns:[id,name,content,createdate].
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.676 [job-0] INFO  OriginalConfPretreatmentUtil - table:[t_user_info] all columns:[
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] id,name,content,createdate
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] ].
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.699 [job-0] INFO  OriginalConfPretreatmentUtil - Write data [
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] INSERT INTO %s (`id`,`name`,`content`,`createdate`) VALUES(?,?,?,?)
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] ], which jdbcUrl like:[jdbc:mysql://192.168.8.248:3306/targetdb?serverTimezone=Asia/Shanghai&useLegacyDatetimeCode=false&useSSL=false&nullNamePatternMatchesAll=true&useUnicode=true&characterEncoding=UTF-8&yearIsDateType=false&zeroDateTimeBehavior=CONVERT_TO_NULL&rewriteBatchedStatements=true&tinyInt1isBit=false]
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.700 [job-0] INFO  JobContainer - jobContainer starts to do prepare ...
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.700 [job-0] INFO  JobContainer - DataX Reader.Job [mysqlreader] do prepare work .
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.700 [job-0] INFO  JobContainer - DataX Writer.Job [mysqlwriter] do prepare work .
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.711 [job-0] INFO  CommonRdbmsWriter$Job - Begin to execute preSqls:[delete from t_user_info]. context info:jdbc:mysql://192.168.8.248:3306/targetdb?serverTimezone=Asia/Shanghai&useLegacyDatetimeCode=false&useSSL=false&nullNamePatternMatchesAll=true&useUnicode=true&characterEncoding=UTF-8&yearIsDateType=false&zeroDateTimeBehavior=CONVERT_TO_NULL&rewriteBatchedStatements=true&tinyInt1isBit=false.
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.712 [job-0] INFO  JobContainer - jobContainer starts to do split ...
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.818 [job-0] ERROR JobContainer - Exception when job run
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] com.alibaba.datax.common.exception.DataXException: Code:[Framework-03], Description:[DataX引擎配置错误,该问题通常是由于DataX安装错误引起,请联系您的运维解决 .].  - 在有总bps限速条件下,单个channel的bps值不能为空,也不能为非正数
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:26) ~[datax-common-0.0.1-SNAPSHOT.jar:na]
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.core.job.JobContainer.adjustChannelNumber(JobContainer.java:430) ~[datax-core-0.0.1-SNAPSHOT.jar:na]
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.core.job.JobContainer.split(JobContainer.java:387) ~[datax-core-0.0.1-SNAPSHOT.jar:na]
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.core.job.JobContainer.start(JobContainer.java:117) ~[datax-core-0.0.1-SNAPSHOT.jar:na]
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.core.Engine.start(Engine.java:92) [datax-core-0.0.1-SNAPSHOT.jar:na]
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.core.Engine.entry(Engine.java:171) [datax-core-0.0.1-SNAPSHOT.jar:na]
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.core.Engine.main(Engine.java:204) [datax-core-0.0.1-SNAPSHOT.jar:na]
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.823 [job-0] INFO  StandAloneJobContainerCommunicator - Total 0 records, 0 bytes | Speed 0B/s, 0 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 0.000s |  All Task WaitReaderTime 0.000s | Percentage 0.00%
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.825 [job-0] ERROR Engine - 
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 经DataX智能分析,该任务最可能的错误原因是:
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] com.alibaba.datax.common.exception.DataXException: Code:[Framework-03], Description:[DataX引擎配置错误,该问题通常是由于DataX安装错误引起,请联系您的运维解决 .].  - 在有总bps限速条件下,单个channel的bps值不能为空,也不能为非正数
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:26)
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.core.job.JobContainer.adjustChannelNumber(JobContainer.java:430)
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.core.job.JobContainer.split(JobContainer.java:387)
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.core.job.JobContainer.start(JobContainer.java:117)
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.core.Engine.start(Engine.java:92)
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.core.Engine.entry(Engine.java:171)
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.core.Engine.main(Engine.java:204)
2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 
2021-09-09 09:21:16 [JobThread.run-165] <br>----------- datax-web job execute end(finish) -----------<br>----------- ReturnT:ReturnT [code=500, msg=command exit value(1) is failed, content=null]
2021-09-09 09:21:16 [TriggerCallbackThread.callbackLog-186] <br>----------- datax-web job callback finish.

 去掉    "byte": 1048576

"errorLimit": {
"record": 0,
"percentage": 0.02
}
},

posted @ 2021-09-09 09:40  DarJeely  阅读(2068)  评论(0编辑  收藏  举报