apache / seatunnel

SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.

Home Page:https://seatunnel.apache.org/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

flink on yarn execute fail (Provider org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSource not a subtype)

ljl568419709 opened this issue · comments

Search before asking

  • I had searched in the feature and found no similar feature requirement.

Description

version seatunall 2.3.3 flink 1.3.6
cmd : ./bin/start-seatunnel-flink-13-connector-v2.sh -e run-application --master yarn-application --config /apps/hive/apache-seatunnel-2.3.3/config/v2.batch.config.mysql_mysql.template --name SeaTunnel

env {
parallelism = 4
job.mode = "BATCH"
}
source{
jdbc {
url = "jdbc:mysql://10.26.32.16:3306/communal_new?serverTimezone=GMT%2b8&useUnicode=true&characterEncoding=UTF-8&rewriteBatchedStatements=true"
driver = "com.mysql.cj.jdbc.Driver"
connection_check_timeout_sec = 100
user = "root"
password = "Meicloud12#$"
query = "select * from sys_menu"
}
}

transform {
# If you would like to get more information about how to configure seatunnel and see full list of transform plugins,
# please go to https://seatunnel.apache.org/docs/transform-v2/sql
}

sink {
jdbc {
url = "jdbc:mysql://10.26.32.16:3306/test"
driver = "com.mysql.cj.jdbc.Driver"
user = "root"
password = "Meicloud12#$"
# Automatically generate sql statements based on database table names
generate_sink_sql = true
database = test
table = sys_menu
}
}

1
2
3
我怀疑有没有人测试过

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

jdbc jar sumbited yarn
5

4

而且seatunnel提交到yarn时,并没有将connectors/seatunnel提交到yarn,导致seatunnel找不到,上面的日志截图也有说明,这个是还有遗漏其他配置吗

I have also encountered this problem,same as you . and it is not work for this solution #6068

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.