datax Task execution failed
ysq5202121 opened this issue · comments
Search before asking
- I had searched in the issues and found no similar issues.
What happened
Standalone mode
[LOG-PATH]: /opt/apache-dolphinscheduler-3.1.7-bin/standalone-server/logs/20240506/13510223263456_2-319-319.log, [HOST]: Host{address='10.1.1.241:1234', ip='10.1.1.241', port=1234}
[INFO] 2024-05-06 07:19:58.225 +0000 - Begin to pulling task
[INFO] 2024-05-06 07:19:58.227 +0000 - Begin to initialize task
[INFO] 2024-05-06 07:19:58.227 +0000 - Set task startTime: Mon May 06 07:19:58 UTC 2024
[INFO] 2024-05-06 07:19:58.228 +0000 - Set task envFile: /opt/apache-dolphinscheduler-3.1.7-bin/standalone-server/conf/dolphinscheduler_env.sh
[INFO] 2024-05-06 07:19:58.228 +0000 - Set task appId: 319_319
[INFO] 2024-05-06 07:19:58.228 +0000 - End initialize task
[INFO] 2024-05-06 07:19:58.228 +0000 - Set task status to TaskExecutionStatus{code=1, desc='running'}
[INFO] 2024-05-06 07:19:58.229 +0000 - TenantCode:admin check success
[INFO] 2024-05-06 07:19:58.229 +0000 - ProcessExecDir:/tmp/dolphinscheduler/exec/process/admin/13376015454688/13510223263456_2/319/319 check success
[INFO] 2024-05-06 07:19:58.229 +0000 - Resources:{} check success
[INFO] 2024-05-06 07:19:58.230 +0000 - Task plugin: DATAX create success
[INFO] 2024-05-06 07:19:58.230 +0000 - datax task params {"localParams":[],"resourceList":[],"customConfig":0,"dsType":"SQLSERVER","dataSource":2,"dtType":"CLICKHOUSE","dataTarget":1,"sql":"SELECT CurrencyMonthID as Id,DayPeriod,CurrencyName,ExchangeRate from ODS_Base_CurrencyMonth\r\n","targetTable":"ODS_Base_CurrencyMonth_test","jobSpeedByte":0,"jobSpeedRecord":1000,"preStatements":[],"postStatements":[],"xms":1,"xmx":1}
[INFO] 2024-05-06 07:19:58.233 +0000 - Success initialized task plugin instance success
[INFO] 2024-05-06 07:19:58.233 +0000 - Success set taskVarPool: null
[INFO] 2024-05-06 07:19:58.234 +0000 - Begin to create command file:/tmp/dolphinscheduler/exec/process/admin/13376015454688/13510223263456_2/319/319/319_319.command
[INFO] 2024-05-06 07:19:58.235 +0000 - Success create command file, command: #!/bin/bash
BASEDIR=$(cd dirname $0; pwd)
cd $BASEDIR
source /opt/apache-dolphinscheduler-3.1.7-bin/standalone-server/conf/dolphinscheduler_env.sh
/tmp/dolphinscheduler/exec/process/admin/13376015454688/13510223263456_2/319/319/319_319_node.sh
[INFO] 2024-05-06 07:19:58.238 +0000 - task run command: sudo -u admin -E bash /tmp/dolphinscheduler/exec/process/admin/13376015454688/13510223263456_2/319/319/319_319.command
[INFO] 2024-05-06 07:19:58.238 +0000 - process start, process id is: 24341
[INFO] 2024-05-06 07:19:58.270 +0000 - process has exited. execute path:/tmp/dolphinscheduler/exec/process/admin/13376015454688/13510223263456_2/319/319, processId:24341 ,exitStatusCode:127 ,processWaitForStatus:true ,processExitValue:127
[INFO] 2024-05-06 07:19:58.271 +0000 - Send task execute result to master, the current task status: TaskExecutionStatus{code=6, desc='failure'}
[INFO] 2024-05-06 07:19:58.271 +0000 - Remove the current task execute context from worker cache
[INFO] 2024-05-06 07:19:58.271 +0000 - The current execute mode isn't develop mode, will clear the task execute file: /tmp/dolphinscheduler/exec/process/admin/13376015454688/13510223263456_2/319/319
[INFO] 2024-05-06 07:19:58.272 +0000 - Success clear the task execute file: /tmp/dolphinscheduler/exec/process/admin/13376015454688/13510223263456_2/319/319
[INFO] 2024-05-06 07:19:59.239 +0000 - -> /tmp/dolphinscheduler/exec/process/admin/13376015454688/13510223263456_2/319/319/319_319_node.sh:行1: /opt/soft/python/bin/python2.7: 没有那个文件或目录
[INFO] 2024-05-06 07:19:59.240 +0000 - FINALIZE_SESSION
What you expected to happen
How to reproduce
Anything else
Version
3.1.x
Are you willing to submit PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project's Code of Conduct
Search before asking
- I had searched in the issues and found no similar issues.
What happened
[LOG-PATH]: /opt/apache-dolphinscheduler-3.1.7-bin/standalone-server/logs/20240506/13510223263456_2-319-319.log, [HOST]: Host{address='10.1.1.241:1234', ip='10.1.1.241', port=1234}
[INFO] 2024-05-06 07:19:58.225 +0000 - Begin to pulling task
[INFO] 2024-05-06 07:19:58.227 +0000 - Begin to initialize task
[INFO] 2024-05-06 07:19:58.227 +0000 - Set task startTime: Mon May 06 07:19:58 UTC 2024
[INFO] 2024-05-06 07:19:58.228 +0000 - Set task envFile: /opt/apache-dolphinscheduler-3.1.7-bin/standalone-server/conf/dolphinscheduler_env.sh
[INFO] 2024-05-06 07:19:58.228 +0000 - Set task appId: 319_319
[INFO] 2024-05-06 07:19:58.228 +0000 - End initialize task
[INFO] 2024-05-06 07:19:58.228 +0000 - Set task status to TaskExecutionStatus{code=1, desc='running'}
[INFO] 2024-05-06 07:19:58.229 +0000 - TenantCode:admin check success
[INFO] 2024-05-06 07:19:58.229 +0000 - ProcessExecDir:/tmp/dolphinscheduler/exec/process/admin/13376015454688/13510223263456_2/319/319 check success
[INFO] 2024-05-06 07:19:58.229 +0000 - Resources:{} check success
[INFO] 2024-05-06 07:19:58.230 +0000 - Task plugin: DATAX create success
[INFO] 2024-05-06 07:19:58.230 +0000 - datax task params {"localParams":[],"resourceList":[],"customConfig":0,"dsType":"SQLSERVER","dataSource":2,"dtType":"CLICKHOUSE","dataTarget":1,"sql":"SELECT CurrencyMonthID as Id,DayPeriod,CurrencyName,ExchangeRate from ODS_Base_CurrencyMonth\r\n","targetTable":"ODS_Base_CurrencyMonth_test","jobSpeedByte":0,"jobSpeedRecord":1000,"preStatements":[],"postStatements":[],"xms":1,"xmx":1}
[INFO] 2024-05-06 07:19:58.233 +0000 - Success initialized task plugin instance success
[INFO] 2024-05-06 07:19:58.233 +0000 - Success set taskVarPool: null
[INFO] 2024-05-06 07:19:58.234 +0000 - Begin to create command file:/tmp/dolphinscheduler/exec/process/admin/13376015454688/13510223263456_2/319/319/319_319.command
[INFO] 2024-05-06 07:19:58.235 +0000 - Success create command file, command: #!/bin/bash
BASEDIR=$(cd dirname $0; pwd)
cd $BASEDIR
source /opt/apache-dolphinscheduler-3.1.7-bin/standalone-server/conf/dolphinscheduler_env.sh
/tmp/dolphinscheduler/exec/process/admin/13376015454688/13510223263456_2/319/319/319_319_node.sh
[INFO] 2024-05-06 07:19:58.238 +0000 - task run command: sudo -u admin -E bash /tmp/dolphinscheduler/exec/process/admin/13376015454688/13510223263456_2/319/319/319_319.command
[INFO] 2024-05-06 07:19:58.238 +0000 - process start, process id is: 24341
[INFO] 2024-05-06 07:19:58.270 +0000 - process has exited. execute path:/tmp/dolphinscheduler/exec/process/admin/13376015454688/13510223263456_2/319/319, processId:24341 ,exitStatusCode:127 ,processWaitForStatus:true ,processExitValue:127
[INFO] 2024-05-06 07:19:58.271 +0000 - Send task execute result to master, the current task status: TaskExecutionStatus{code=6, desc='failure'}
[INFO] 2024-05-06 07:19:58.271 +0000 - Remove the current task execute context from worker cache
[INFO] 2024-05-06 07:19:58.271 +0000 - The current execute mode isn't develop mode, will clear the task execute file: /tmp/dolphinscheduler/exec/process/admin/13376015454688/13510223263456_2/319/319
[INFO] 2024-05-06 07:19:58.272 +0000 - Success clear the task execute file: /tmp/dolphinscheduler/exec/process/admin/13376015454688/13510223263456_2/319/319
[INFO] 2024-05-06 07:19:59.239 +0000 - -> /tmp/dolphinscheduler/exec/process/admin/13376015454688/13510223263456_2/319/319/319_319_node.sh:行1: /opt/soft/python/bin/python2.7: 没有那个文件或目录
[INFO] 2024-05-06 07:19:59.240 +0000 - FINALIZE_SESSION
What you expected to happen
How to reproduce
Anything else
Version
3.1.x
Are you willing to submit PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project's Code of Conduct
已解决，未配置python目录